[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:55:04 dist-test-slave-h3ft krb5kdc[15655](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:55:04 dist-test-slave-h3ft krb5kdc[15655](info): set up 2 sockets
Aug 11 00:55:04 dist-test-slave-h3ft krb5kdc[15655](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260811 00:55:06.074329 15640 mini_kdc.cc:121] Time spent starting KDC: real 1.436s user 0.000s sys 0.011s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Aug 11 00:55:06 dist-test-slave-h3ft krb5kdc[15655](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409706, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:55:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:55:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.70.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
I20260811 00:55:06.249925 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:45723
--webserver_interface=127.15.70.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:40799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:45723
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:06.361261 15679 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:06.361590 15679 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:06.361622 15679 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:06.363050 15679 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:55:06.363106 15679 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:06.363119 15679 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:06.363133 15679 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:55:06.363147 15679 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:55:06.364907 15679 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:40799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:45723
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:45723
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15679
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:06.365242 15679 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:06.365540 15679 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:06.372640 15690 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:06.372640 15688 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:06.372642 15686 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:06.373172 15679 server_base.cc:1034] running on GCE node
I20260811 00:55:06.373623 15679 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:06.374104 15679 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:06.375298 15679 hybrid_clock.cc:648] HybridClock initialized: now 1786409706375229 us; error 91 us; skew 500 ppm
Aug 11 00:55:06 dist-test-slave-h3ft krb5kdc[15655](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409706, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:06.378688 15679 init.cc:377] Logged in from keytab as kudu/127.15.70.62@KRBTEST.COM (short username kudu)
I20260811 00:55:06.379443 15679 webserver.cc:460] Webserver started at http://127.15.70.62:43863/ using document root <none> and password file <none>
I20260811 00:55:06.379779 15679 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:06.379858 15679 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:06.380038 15679 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:06.381575 15679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "903132f322b94ec1acba2bf644e08f90"
format_stamp: "Formatted at 2026-08-11 00:55:06 on dist-test-slave-h3ft"
server_key: "e9dcefa7c0308aa66326e89421e64b01"
server_key_iv: "126616981de8eef0a2e19f9f6fc7eee9"
server_key_version: "encryptionkey@0"
I20260811 00:55:06.382102 15679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "903132f322b94ec1acba2bf644e08f90"
format_stamp: "Formatted at 2026-08-11 00:55:06 on dist-test-slave-h3ft"
server_key: "e9dcefa7c0308aa66326e89421e64b01"
server_key_iv: "126616981de8eef0a2e19f9f6fc7eee9"
server_key_version: "encryptionkey@0"
I20260811 00:55:06.384356 15679 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260811 00:55:06.385408 15703 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:06.385754 15679 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:06.385942 15679 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "903132f322b94ec1acba2bf644e08f90"
format_stamp: "Formatted at 2026-08-11 00:55:06 on dist-test-slave-h3ft"
server_key: "e9dcefa7c0308aa66326e89421e64b01"
server_key_iv: "126616981de8eef0a2e19f9f6fc7eee9"
server_key_version: "encryptionkey@0"
I20260811 00:55:06.386065 15679 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:06.408865 15679 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:06.411729 15679 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:06.411973 15679 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:06.418845 15679 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:45723
I20260811 00:55:06.418910 15784 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:45723 every 8 connection(s)
I20260811 00:55:06.419407 15679 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:55:06.420533 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 15679
I20260811 00:55:06.420672 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 00:55:06.420778 15785 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:06.421455 15640 external_mini_cluster.cc:1428] Setting key c3f6c58dea1aa08c490cc2be0bcc612b
I20260811 00:55:06.424783 15785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 903132f322b94ec1acba2bf644e08f90: Bootstrap starting.
I20260811 00:55:06.425755 15785 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 903132f322b94ec1acba2bf644e08f90: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:06.426151 15785 log.cc:824] T 00000000000000000000000000000000 P 903132f322b94ec1acba2bf644e08f90: Log is configured to *not* fsync() on all Append() calls
I20260811 00:55:06.427322 15785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 903132f322b94ec1acba2bf644e08f90: No bootstrap required, opened a new log
I20260811 00:55:06.429611 15785 raft_consensus.cc:348] T 00000000000000000000000000000000 P 903132f322b94ec1acba2bf644e08f90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "903132f322b94ec1acba2bf644e08f90" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 45723 } }
I20260811 00:55:06.429801 15785 raft_consensus.cc:374] T 00000000000000000000000000000000 P 903132f322b94ec1acba2bf644e08f90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:06.429860 15785 raft_consensus.cc:729] T 00000000000000000000000000000000 P 903132f322b94ec1acba2bf644e08f90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 903132f322b94ec1acba2bf644e08f90, State: Initialized, Role: FOLLOWER
I20260811 00:55:06.430068 15785 consensus_queue.cc:260] T 00000000000000000000000000000000 P 903132f322b94ec1acba2bf644e08f90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "903132f322b94ec1acba2bf644e08f90" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 45723 } }
I20260811 00:55:06.430188 15785 raft_consensus.cc:388] T 00000000000000000000000000000000 P 903132f322b94ec1acba2bf644e08f90 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:55:06.430239 15785 raft_consensus.cc:482] T 00000000000000000000000000000000 P 903132f322b94ec1acba2bf644e08f90 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:55:06.430297 15785 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 903132f322b94ec1acba2bf644e08f90 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:06.431455 15785 raft_consensus.cc:504] T 00000000000000000000000000000000 P 903132f322b94ec1acba2bf644e08f90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "903132f322b94ec1acba2bf644e08f90" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 45723 } }
I20260811 00:55:06.431612 15785 leader_election.cc:302] T 00000000000000000000000000000000 P 903132f322b94ec1acba2bf644e08f90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 903132f322b94ec1acba2bf644e08f90; no voters:
I20260811 00:55:06.431872 15785 leader_election.cc:288] T 00000000000000000000000000000000 P 903132f322b94ec1acba2bf644e08f90 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:55:06.431918 15790 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 903132f322b94ec1acba2bf644e08f90 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:55:06.432143 15790 raft_consensus.cc:686] T 00000000000000000000000000000000 P 903132f322b94ec1acba2bf644e08f90 [term 1 LEADER]: Becoming Leader. State: Replica: 903132f322b94ec1acba2bf644e08f90, State: Running, Role: LEADER
I20260811 00:55:06.432263 15790 consensus_queue.cc:237] T 00000000000000000000000000000000 P 903132f322b94ec1acba2bf644e08f90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "903132f322b94ec1acba2bf644e08f90" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 45723 } }
I20260811 00:55:06.432415 15785 sys_catalog.cc:564] T 00000000000000000000000000000000 P 903132f322b94ec1acba2bf644e08f90 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:55:06.432801 15795 sys_catalog.cc:455] T 00000000000000000000000000000000 P 903132f322b94ec1acba2bf644e08f90 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 903132f322b94ec1acba2bf644e08f90. Latest consensus state: current_term: 1 leader_uuid: "903132f322b94ec1acba2bf644e08f90" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "903132f322b94ec1acba2bf644e08f90" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 45723 } } }
I20260811 00:55:06.432839 15794 sys_catalog.cc:455] T 00000000000000000000000000000000 P 903132f322b94ec1acba2bf644e08f90 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "903132f322b94ec1acba2bf644e08f90" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "903132f322b94ec1acba2bf644e08f90" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 45723 } } }
I20260811 00:55:06.433007 15795 sys_catalog.cc:458] T 00000000000000000000000000000000 P 903132f322b94ec1acba2bf644e08f90 [sys.catalog]: This master's current role is: LEADER
I20260811 00:55:06.433043 15794 sys_catalog.cc:458] T 00000000000000000000000000000000 P 903132f322b94ec1acba2bf644e08f90 [sys.catalog]: This master's current role is: LEADER
I20260811 00:55:06.433570 15798 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:55:06.434474 15798 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 00:55:06 dist-test-slave-h3ft krb5kdc[15655](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409706, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:06.440933 15798 catalog_manager.cc:1347] Generated new cluster ID: ea6a03fb50824e1482ffd439f573e1e3
I20260811 00:55:06.441031 15798 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:55:06.446384 15787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:06.422743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43118 (local address 127.15.70.62:45723)
0811 00:55:06.422967 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:06.422976 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:06.423414 (+ 438us) server_negotiation.cc:407] Connection header received
0811 00:55:06.426710 (+ 3296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:06.426721 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:06.426802 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:06.427186 (+ 384us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:06.429256 (+ 2070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:06.430879 (+ 1623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:06.432679 (+ 1800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:06.433428 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:06.433550 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:06.439506 (+ 5956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:06.439512 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:06.439512 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:06.439528 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:06.443288 (+ 3760us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:06.443972 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:06.443976 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:06.443977 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:06.444107 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:06.444413 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:06.444413 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:06.444414 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:06.444807 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:06.445699 (+ 892us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:06.445844 (+ 145us) server_negotiation.cc:299] Negotiation successful
0811 00:55:06.446056 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":119,"threads_started":1}
I20260811 00:55:06.455963 15798 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:55:06.456918 15798 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:55:06.464638 15798 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 903132f322b94ec1acba2bf644e08f90: Generated new TSK 0
I20260811 00:55:06.464946 15798 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.70.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab.
Entry for principal kudu/127.15.70.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab.
I20260811 00:55:06.507237 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.1:0
--local_ip_for_outbound_sockets=127.15.70.1
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:45723
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:40799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:06.613457 15819 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:06.613803 15819 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:06.613839 15819 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:06.615521 15819 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:06.615590 15819 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:06.615628 15819 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.1
I20260811 00:55:06.617488 15819 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:40799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:45723
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15819
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.1
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:06.617854 15819 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:06.618227 15819 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:06.624891 15834 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:06.624967 15829 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:06.624907 15828 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:06.624939 15819 server_base.cc:1034] running on GCE node
I20260811 00:55:06.625478 15819 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:06.625880 15819 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:06.627084 15819 hybrid_clock.cc:648] HybridClock initialized: now 1786409706627056 us; error 41 us; skew 500 ppm
Aug 11 00:55:06 dist-test-slave-h3ft krb5kdc[15655](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409706, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:06.630496 15819 init.cc:377] Logged in from keytab as kudu/127.15.70.1@KRBTEST.COM (short username kudu)
I20260811 00:55:06.631492 15819 webserver.cc:460] Webserver started at http://127.15.70.1:43157/ using document root <none> and password file <none>
I20260811 00:55:06.631800 15819 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:06.631886 15819 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:06.632084 15819 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:06.633651 15819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-0/data/instance:
uuid: "75e5f0298a9d45e885aff09f27f96db0"
format_stamp: "Formatted at 2026-08-11 00:55:06 on dist-test-slave-h3ft"
server_key: "8da6037c28732cdbdad987edeb26aac1"
server_key_iv: "21ae233b1e37fc36649912ab47ae1038"
server_key_version: "encryptionkey@0"
I20260811 00:55:06.634289 15819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance:
uuid: "75e5f0298a9d45e885aff09f27f96db0"
format_stamp: "Formatted at 2026-08-11 00:55:06 on dist-test-slave-h3ft"
server_key: "8da6037c28732cdbdad987edeb26aac1"
server_key_iv: "21ae233b1e37fc36649912ab47ae1038"
server_key_version: "encryptionkey@0"
I20260811 00:55:06.636824 15819 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.003s
I20260811 00:55:06.637807 15845 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:06.638036 15819 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:06.638163 15819 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-0/wal
uuid: "75e5f0298a9d45e885aff09f27f96db0"
format_stamp: "Formatted at 2026-08-11 00:55:06 on dist-test-slave-h3ft"
server_key: "8da6037c28732cdbdad987edeb26aac1"
server_key_iv: "21ae233b1e37fc36649912ab47ae1038"
server_key_version: "encryptionkey@0"
I20260811 00:55:06.638269 15819 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:06.674496 15819 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:06.677896 15819 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:06.678190 15819 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:06.678665 15819 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:55:06.679237 15819 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:55:06.679304 15819 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:06.679347 15819 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:55:06.679391 15819 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:06.693008 15819 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.1:43925
I20260811 00:55:06.693073 16021 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.1:43925 every 8 connection(s)
I20260811 00:55:06.693567 15819 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
I20260811 00:55:06.696236 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 15819
I20260811 00:55:06.696380 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance
I20260811 00:55:06.696617 15640 external_mini_cluster.cc:1428] Setting key a78c2956025906f1f0f3adc7c10c80eb
Aug 11 00:55:06 dist-test-slave-h3ft krb5kdc[15655](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409706, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:06.707826 15787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:06.694806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:41525 (local address 127.15.70.62:45723)
0811 00:55:06.694908 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:06.694911 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:06.695275 (+ 364us) server_negotiation.cc:407] Connection header received
0811 00:55:06.695935 (+ 660us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:06.695937 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:06.695955 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:06.696060 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:06.697696 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:06.698294 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:06.700181 (+ 1887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:06.700490 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:06.700594 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:06.704002 (+ 3408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:06.704005 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:06.704005 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:06.704016 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:06.705839 (+ 1823us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:06.706479 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:06.706480 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:06.706481 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:06.706553 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:06.706895 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:06.706895 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:06.706896 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:06.707110 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:06.707172 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:06.707631 (+ 459us) server_negotiation.cc:299] Negotiation successful
0811 00:55:06.707733 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 00:55:06.708141 16026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:06.694794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:45723 (local address 127.15.70.1:41525)
0811 00:55:06.695085 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:06.695147 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:06.695820 (+ 673us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:06.696180 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:06.696187 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:06.697225 (+ 1038us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:06.697577 (+ 352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:06.697586 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:06.698434 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:06.698437 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:06.700063 (+ 1626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:06.700068 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:06.700629 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:06.700630 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:06.700791 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:06.701528 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:06.701539 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:06.703842 (+ 2303us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:06.705955 (+ 2113us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:06.705969 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:06.705974 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:06.706374 (+ 400us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:06.706630 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:06.706631 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:06.706631 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:06.706820 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:06.707181 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:06.707190 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:06.707421 (+ 231us) client_negotiation.cc:769] Sending connection context
0811 00:55:06.707572 (+ 151us) client_negotiation.cc:240] Negotiation successful
0811 00:55:06.707813 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":163,"threads_started":1}
I20260811 00:55:06.708803 16022 heartbeater.cc:347] Connected to a master server at 127.15.70.62:45723
WARNING: no policy specified for kudu/127.15.70.2@KRBTEST.COM; defaulting to no policy
I20260811 00:55:06.708961 16022 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:06.709206 16022 heartbeater.cc:511] Master 127.15.70.62:45723 requested a full tablet report, sending...
I20260811 00:55:06.709980 15728 ts_manager.cc:194] Registered new tserver with Master: 75e5f0298a9d45e885aff09f27f96db0 (127.15.70.1:43925)
I20260811 00:55:06.710819 15728 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.1@KRBTEST.COM'} at 127.15.70.1:41525
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab.
Entry for principal kudu/127.15.70.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab.
I20260811 00:55:06.737025 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.2:0
--local_ip_for_outbound_sockets=127.15.70.2
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:45723
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:40799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:06.844468 16031 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:06.844826 16031 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:06.844893 16031 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:06.846896 16031 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:06.847075 16031 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:06.847159 16031 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.2
I20260811 00:55:06.851138 16031 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:40799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:45723
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16031
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.2
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:06.851644 16031 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:06.852080 16031 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:06.860280 16041 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:06.860786 16039 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:06.860127 16037 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:06.861506 16031 server_base.cc:1034] running on GCE node
I20260811 00:55:06.862030 16031 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:06.862412 16031 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:06.863605 16031 hybrid_clock.cc:648] HybridClock initialized: now 1786409706863517 us; error 114 us; skew 500 ppm
Aug 11 00:55:06 dist-test-slave-h3ft krb5kdc[15655](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409706, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:06.868139 16031 init.cc:377] Logged in from keytab as kudu/127.15.70.2@KRBTEST.COM (short username kudu)
I20260811 00:55:06.869004 16031 webserver.cc:460] Webserver started at http://127.15.70.2:43093/ using document root <none> and password file <none>
I20260811 00:55:06.869315 16031 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:06.869397 16031 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:06.869604 16031 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:06.871148 16031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-1/data/instance:
uuid: "9e27b3bf81204dc19aa959b5cbe314fd"
format_stamp: "Formatted at 2026-08-11 00:55:06 on dist-test-slave-h3ft"
server_key: "b194dc661c05f0d2f4a0f44ef3f8659c"
server_key_iv: "1f7cf10a0c0ff1ee5e6e7edb887d056a"
server_key_version: "encryptionkey@0"
I20260811 00:55:06.871704 16031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance:
uuid: "9e27b3bf81204dc19aa959b5cbe314fd"
format_stamp: "Formatted at 2026-08-11 00:55:06 on dist-test-slave-h3ft"
server_key: "b194dc661c05f0d2f4a0f44ef3f8659c"
server_key_iv: "1f7cf10a0c0ff1ee5e6e7edb887d056a"
server_key_version: "encryptionkey@0"
I20260811 00:55:06.873805 16031 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 00:55:06.875155 16052 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:06.875409 16031 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:06.875563 16031 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-1/wal
uuid: "9e27b3bf81204dc19aa959b5cbe314fd"
format_stamp: "Formatted at 2026-08-11 00:55:06 on dist-test-slave-h3ft"
server_key: "b194dc661c05f0d2f4a0f44ef3f8659c"
server_key_iv: "1f7cf10a0c0ff1ee5e6e7edb887d056a"
server_key_version: "encryptionkey@0"
I20260811 00:55:06.875679 16031 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:06.917385 16031 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:06.920907 16031 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:06.921167 16031 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:06.921540 16031 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:55:06.922083 16031 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:55:06.922152 16031 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:06.922194 16031 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:55:06.922226 16031 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:06.936276 16031 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.2:38573
I20260811 00:55:06.936329 16240 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.2:38573 every 8 connection(s)
I20260811 00:55:06.936867 16031 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
Aug 11 00:55:06 dist-test-slave-h3ft krb5kdc[15655](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409706, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:06.947131 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 16031
I20260811 00:55:06.947252 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance
I20260811 00:55:06.947520 15640 external_mini_cluster.cc:1428] Setting key 9bbef64c362fdaf8de8ade64d9d24fb6
I20260811 00:55:06.952167 15787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:06.938241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:33067 (local address 127.15.70.62:45723)
0811 00:55:06.938354 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:06.938358 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:06.938650 (+ 292us) server_negotiation.cc:407] Connection header received
0811 00:55:06.939399 (+ 749us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:06.939401 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:06.939419 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:06.939508 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:06.941054 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:06.941751 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:06.943221 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:06.943437 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:06.943512 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:06.946795 (+ 3283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:06.946797 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:06.946798 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:06.946807 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:06.949190 (+ 2383us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:06.950105 (+ 915us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:06.950107 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:06.950107 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:06.950222 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:06.950861 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:06.950863 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:06.950863 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:06.951147 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:06.951242 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:06.951898 (+ 656us) server_negotiation.cc:299] Negotiation successful
0811 00:55:06.952045 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 00:55:06.952435 16243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:06.938146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:45723 (local address 127.15.70.2:33067)
0811 00:55:06.938398 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:06.938480 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:06.939254 (+ 774us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:06.939678 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:06.939683 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:06.940562 (+ 879us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:06.940875 (+ 313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:06.940883 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:06.941882 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:06.941883 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:06.943122 (+ 1239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:06.943126 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:06.943557 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:06.943558 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:06.943707 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:06.944635 (+ 928us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:06.944647 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:06.946637 (+ 1990us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:06.949328 (+ 2691us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:06.949344 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:06.949348 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:06.949897 (+ 549us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:06.950355 (+ 458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:06.950356 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:06.950356 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:06.950580 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:06.951270 (+ 690us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:06.951291 (+ 21us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:06.951662 (+ 371us) client_negotiation.cc:769] Sending connection context
0811 00:55:06.951828 (+ 166us) client_negotiation.cc:240] Negotiation successful
0811 00:55:06.952100 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":138,"threads_started":1}
I20260811 00:55:06.953269 16241 heartbeater.cc:347] Connected to a master server at 127.15.70.62:45723
I20260811 00:55:06.953423 16241 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:06.953675 16241 heartbeater.cc:511] Master 127.15.70.62:45723 requested a full tablet report, sending...
I20260811 00:55:06.954252 15728 ts_manager.cc:194] Registered new tserver with Master: 9e27b3bf81204dc19aa959b5cbe314fd (127.15.70.2:38573)
I20260811 00:55:06.954916 15728 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.2@KRBTEST.COM'} at 127.15.70.2:33067
WARNING: no policy specified for kudu/127.15.70.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab.
Entry for principal kudu/127.15.70.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab.
I20260811 00:55:06.992563 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.3:0
--local_ip_for_outbound_sockets=127.15.70.3
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:45723
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:40799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:07.110244 16246 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:07.110864 16246 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:07.110956 16246 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:07.113968 16246 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:07.114099 16246 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:07.114163 16246 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.3
I20260811 00:55:07.117404 16246 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:40799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:45723
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16246
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.3
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:07.117849 16246 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:07.118208 16246 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:07.125608 16255 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:07.125628 16251 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:07.125674 16246 server_base.cc:1034] running on GCE node
W20260811 00:55:07.125604 16252 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:07.126272 16246 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:07.126724 16246 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:07.127987 16246 hybrid_clock.cc:648] HybridClock initialized: now 1786409707128004 us; error 110 us; skew 500 ppm
Aug 11 00:55:07 dist-test-slave-h3ft krb5kdc[15655](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409707, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:07.131847 16246 init.cc:377] Logged in from keytab as kudu/127.15.70.3@KRBTEST.COM (short username kudu)
I20260811 00:55:07.132740 16246 webserver.cc:460] Webserver started at http://127.15.70.3:32823/ using document root <none> and password file <none>
I20260811 00:55:07.133092 16246 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:07.133177 16246 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:07.133349 16246 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:07.135151 16246 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-2/data/instance:
uuid: "6026f37b88ac4e3bae0e8e2fd292a0b1"
format_stamp: "Formatted at 2026-08-11 00:55:07 on dist-test-slave-h3ft"
server_key: "7b60e54d619bb2dc1dcf9c2e07def452"
server_key_iv: "aee6f45c63e06fe2f7c85f4e56b17de6"
server_key_version: "encryptionkey@0"
I20260811 00:55:07.135761 16246 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance:
uuid: "6026f37b88ac4e3bae0e8e2fd292a0b1"
format_stamp: "Formatted at 2026-08-11 00:55:07 on dist-test-slave-h3ft"
server_key: "7b60e54d619bb2dc1dcf9c2e07def452"
server_key_iv: "aee6f45c63e06fe2f7c85f4e56b17de6"
server_key_version: "encryptionkey@0"
I20260811 00:55:07.137800 16246 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 00:55:07.139128 16264 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:07.139428 16246 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:07.139619 16246 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-2/wal
uuid: "6026f37b88ac4e3bae0e8e2fd292a0b1"
format_stamp: "Formatted at 2026-08-11 00:55:07 on dist-test-slave-h3ft"
server_key: "7b60e54d619bb2dc1dcf9c2e07def452"
server_key_iv: "aee6f45c63e06fe2f7c85f4e56b17de6"
server_key_version: "encryptionkey@0"
I20260811 00:55:07.139725 16246 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:07.167125 16246 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:07.170492 16246 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:07.170719 16246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:07.171149 16246 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:55:07.171603 16246 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:55:07.171645 16246 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:07.171674 16246 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:55:07.171685 16246 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:07.181828 16246 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.3:33695
I20260811 00:55:07.181931 16443 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.3:33695 every 8 connection(s)
I20260811 00:55:07.182370 16246 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
I20260811 00:55:07.185124 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 16246
I20260811 00:55:07.185243 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance
I20260811 00:55:07.185467 15640 external_mini_cluster.cc:1428] Setting key 514acf674bb198f637e5b6042df4de78
Aug 11 00:55:07 dist-test-slave-h3ft krb5kdc[15655](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409707, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:07.195909 15787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:07.183542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:44593 (local address 127.15.70.62:45723)
0811 00:55:07.183659 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:07.183662 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:07.183952 (+ 290us) server_negotiation.cc:407] Connection header received
0811 00:55:07.184913 (+ 961us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:07.184916 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:07.184938 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:07.185041 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:07.186764 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:07.187506 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:07.188756 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:07.189029 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:07.189134 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:07.192174 (+ 3040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:07.192177 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:07.192177 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:07.192187 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:07.194057 (+ 1870us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:07.194634 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:07.194635 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:07.194636 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:07.194706 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:07.195091 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:07.195092 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:07.195092 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:07.195244 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:07.195310 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:07.195713 (+ 403us) server_negotiation.cc:299] Negotiation successful
0811 00:55:07.195813 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 00:55:07.196273 16446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:07.183520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:45723 (local address 127.15.70.3:44593)
0811 00:55:07.183729 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:07.183782 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:07.184718 (+ 936us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:07.185116 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:07.185120 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:07.186096 (+ 976us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:07.186458 (+ 362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:07.186467 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:07.187633 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:07.187635 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:07.188653 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:07.188656 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:07.189135 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:07.189136 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:07.189275 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:07.190029 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:07.190040 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:07.192050 (+ 2010us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:07.194177 (+ 2127us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:07.194186 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:07.194189 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:07.194495 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:07.194780 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:07.194780 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:07.194781 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:07.194963 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:07.195333 (+ 370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:07.195340 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:07.195536 (+ 196us) client_negotiation.cc:769] Sending connection context
0811 00:55:07.195655 (+ 119us) client_negotiation.cc:240] Negotiation successful
0811 00:55:07.195852 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":121,"threads_started":1}
I20260811 00:55:07.197093 16444 heartbeater.cc:347] Connected to a master server at 127.15.70.62:45723
I20260811 00:55:07.197257 16444 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:07.197607 16444 heartbeater.cc:511] Master 127.15.70.62:45723 requested a full tablet report, sending...
I20260811 00:55:07.198166 15728 ts_manager.cc:194] Registered new tserver with Master: 6026f37b88ac4e3bae0e8e2fd292a0b1 (127.15.70.3:33695)
I20260811 00:55:07.198714 15728 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.3@KRBTEST.COM'} at 127.15.70.3:44593
I20260811 00:55:07.209971 15640 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 00:55:07 dist-test-slave-h3ft krb5kdc[15655](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409707, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 00:55:07 dist-test-slave-h3ft krb5kdc[15655](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409707, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.15.70.1@KRBTEST.COM
I20260811 00:55:07.245646 16460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:07.234425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41738 (local address 127.15.70.1:43925)
0811 00:55:07.234622 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:07.234630 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:07.234653 (+ 23us) server_negotiation.cc:407] Connection header received
0811 00:55:07.234691 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:07.234694 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:07.234713 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:07.234790 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:07.235731 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:07.236804 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:07.237741 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:07.238240 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:07.238329 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:07.241365 (+ 3036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:07.241381 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:07.241381 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:07.241395 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:07.243910 (+ 2515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:07.244474 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:07.244479 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:07.244479 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:07.244591 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:07.244854 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:07.244855 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:07.244855 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:07.245072 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:07.245234 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:07.245373 (+ 139us) server_negotiation.cc:299] Negotiation successful
0811 00:55:07.245472 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":125,"threads_started":1}
W20260811 00:55:07.246197 15889 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41738
Aug 11 00:55:07 dist-test-slave-h3ft krb5kdc[15655](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409707, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 00:55:07 dist-test-slave-h3ft krb5kdc[15655](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409707, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.70.1@KRBTEST.COM
I20260811 00:55:07.280826 16460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:07.270086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41748 (local address 127.15.70.1:43925)
0811 00:55:07.270210 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:07.270213 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:07.270353 (+ 140us) server_negotiation.cc:407] Connection header received
0811 00:55:07.270429 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:07.270430 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:07.270445 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:07.270497 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:07.271384 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:07.271999 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:07.272862 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:07.273118 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:07.273188 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:07.276962 (+ 3774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:07.276965 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:07.276966 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:07.276979 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:07.278847 (+ 1868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:07.279487 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:07.279488 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:07.279489 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:07.279565 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:07.279950 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:07.279952 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:07.279952 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:07.280106 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:07.280257 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:07.280527 (+ 270us) server_negotiation.cc:299] Negotiation successful
0811 00:55:07.280632 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 00:55:07.281744 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 15819
I20260811 00:55:07.304034 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 16031
I20260811 00:55:07.330574 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 16246
I20260811 00:55:07.341531 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 15679
2026-08-11T00:55:07Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2751 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:55:07 dist-test-slave-h3ft krb5kdc[16469](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:55:07 dist-test-slave-h3ft krb5kdc[16469](info): set up 2 sockets
Aug 11 00:55:07 dist-test-slave-h3ft krb5kdc[16469](info): commencing operation
krb5kdc: starting...
W20260811 00:55:08.772801 15640 mini_kdc.cc:121] Time spent starting KDC: real 1.392s user 0.001s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Aug 11 00:55:08 dist-test-slave-h3ft krb5kdc[16469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409708, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:55:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:55:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.70.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
I20260811 00:55:08.956918 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:40319
--webserver_interface=127.15.70.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:43105
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:40319
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:09.065140 16491 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:09.065502 16491 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:09.065536 16491 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:09.067123 16491 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:55:09.067189 16491 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:09.067205 16491 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:09.067219 16491 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:55:09.067232 16491 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:55:09.069322 16491 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:43105
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:40319
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:40319
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16491
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:09.069706 16491 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:09.069983 16491 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 00:55:09.077831 16491 server_base.cc:1034] running on GCE node
W20260811 00:55:09.077749 16499 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:09.077788 16504 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:09.077752 16507 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:09.078640 16491 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:09.079327 16491 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:09.080549 16491 hybrid_clock.cc:648] HybridClock initialized: now 1786409709080529 us; error 53 us; skew 500 ppm
Aug 11 00:55:09 dist-test-slave-h3ft krb5kdc[16469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409709, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:09.084728 16491 init.cc:377] Logged in from keytab as kudu/127.15.70.62@KRBTEST.COM (short username kudu)
I20260811 00:55:09.085570 16491 webserver.cc:460] Webserver started at http://127.15.70.62:36521/ using document root <none> and password file <none>
I20260811 00:55:09.085912 16491 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:09.086002 16491 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:09.086195 16491 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:09.087808 16491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "f8dbc4c77999413b9955d0c8c02c4d09"
format_stamp: "Formatted at 2026-08-11 00:55:09 on dist-test-slave-h3ft"
server_key: "aff628a987af507b4a05fdf89f046243"
server_key_iv: "b5de13cb924338b9efe9590d93f4177d"
server_key_version: "encryptionkey@0"
I20260811 00:55:09.088754 16491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "f8dbc4c77999413b9955d0c8c02c4d09"
format_stamp: "Formatted at 2026-08-11 00:55:09 on dist-test-slave-h3ft"
server_key: "aff628a987af507b4a05fdf89f046243"
server_key_iv: "b5de13cb924338b9efe9590d93f4177d"
server_key_version: "encryptionkey@0"
I20260811 00:55:09.091359 16491 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.001s
I20260811 00:55:09.092747 16526 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:09.093169 16491 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:09.093364 16491 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "f8dbc4c77999413b9955d0c8c02c4d09"
format_stamp: "Formatted at 2026-08-11 00:55:09 on dist-test-slave-h3ft"
server_key: "aff628a987af507b4a05fdf89f046243"
server_key_iv: "b5de13cb924338b9efe9590d93f4177d"
server_key_version: "encryptionkey@0"
I20260811 00:55:09.093536 16491 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:09.116962 16491 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:09.120306 16491 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:09.120571 16491 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:09.128618 16491 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:40319
I20260811 00:55:09.128718 16603 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:40319 every 8 connection(s)
I20260811 00:55:09.129310 16491 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:55:09.130847 16605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:09.134730 16605 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8dbc4c77999413b9955d0c8c02c4d09: Bootstrap starting.
I20260811 00:55:09.135732 16605 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f8dbc4c77999413b9955d0c8c02c4d09: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:09.136183 16605 log.cc:824] T 00000000000000000000000000000000 P f8dbc4c77999413b9955d0c8c02c4d09: Log is configured to *not* fsync() on all Append() calls
I20260811 00:55:09.137419 16605 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8dbc4c77999413b9955d0c8c02c4d09: No bootstrap required, opened a new log
I20260811 00:55:09.138154 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 16491
I20260811 00:55:09.138268 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 00:55:09.138532 15640 external_mini_cluster.cc:1428] Setting key 85dc0283ad857a51602fd7d2b52e4869
I20260811 00:55:09.141002 16605 raft_consensus.cc:348] T 00000000000000000000000000000000 P f8dbc4c77999413b9955d0c8c02c4d09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8dbc4c77999413b9955d0c8c02c4d09" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 40319 } }
I20260811 00:55:09.141463 16605 raft_consensus.cc:374] T 00000000000000000000000000000000 P f8dbc4c77999413b9955d0c8c02c4d09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:09.141590 16605 raft_consensus.cc:729] T 00000000000000000000000000000000 P f8dbc4c77999413b9955d0c8c02c4d09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dbc4c77999413b9955d0c8c02c4d09, State: Initialized, Role: FOLLOWER
I20260811 00:55:09.141820 16605 consensus_queue.cc:260] T 00000000000000000000000000000000 P f8dbc4c77999413b9955d0c8c02c4d09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8dbc4c77999413b9955d0c8c02c4d09" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 40319 } }
I20260811 00:55:09.141950 16605 raft_consensus.cc:388] T 00000000000000000000000000000000 P f8dbc4c77999413b9955d0c8c02c4d09 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:55:09.142035 16605 raft_consensus.cc:482] T 00000000000000000000000000000000 P f8dbc4c77999413b9955d0c8c02c4d09 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:55:09.142130 16605 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f8dbc4c77999413b9955d0c8c02c4d09 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:09.143220 16605 raft_consensus.cc:504] T 00000000000000000000000000000000 P f8dbc4c77999413b9955d0c8c02c4d09 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8dbc4c77999413b9955d0c8c02c4d09" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 40319 } }
I20260811 00:55:09.143396 16605 leader_election.cc:302] T 00000000000000000000000000000000 P f8dbc4c77999413b9955d0c8c02c4d09 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f8dbc4c77999413b9955d0c8c02c4d09; no voters:
I20260811 00:55:09.143678 16605 leader_election.cc:288] T 00000000000000000000000000000000 P f8dbc4c77999413b9955d0c8c02c4d09 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:55:09.143747 16614 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f8dbc4c77999413b9955d0c8c02c4d09 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:55:09.143972 16614 raft_consensus.cc:686] T 00000000000000000000000000000000 P f8dbc4c77999413b9955d0c8c02c4d09 [term 1 LEADER]: Becoming Leader. State: Replica: f8dbc4c77999413b9955d0c8c02c4d09, State: Running, Role: LEADER
I20260811 00:55:09.144097 16605 sys_catalog.cc:564] T 00000000000000000000000000000000 P f8dbc4c77999413b9955d0c8c02c4d09 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:55:09.144325 16614 consensus_queue.cc:237] T 00000000000000000000000000000000 P f8dbc4c77999413b9955d0c8c02c4d09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8dbc4c77999413b9955d0c8c02c4d09" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 40319 } }
I20260811 00:55:09.145216 16618 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8dbc4c77999413b9955d0c8c02c4d09 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f8dbc4c77999413b9955d0c8c02c4d09. Latest consensus state: current_term: 1 leader_uuid: "f8dbc4c77999413b9955d0c8c02c4d09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8dbc4c77999413b9955d0c8c02c4d09" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 40319 } } }
I20260811 00:55:09.145453 16617 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8dbc4c77999413b9955d0c8c02c4d09 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f8dbc4c77999413b9955d0c8c02c4d09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8dbc4c77999413b9955d0c8c02c4d09" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 40319 } } }
I20260811 00:55:09.145550 16617 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8dbc4c77999413b9955d0c8c02c4d09 [sys.catalog]: This master's current role is: LEADER
I20260811 00:55:09.145531 16618 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8dbc4c77999413b9955d0c8c02c4d09 [sys.catalog]: This master's current role is: LEADER
I20260811 00:55:09.146723 16626 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:55:09.147634 16626 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 00:55:09 dist-test-slave-h3ft krb5kdc[16469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409708, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:09.151603 16626 catalog_manager.cc:1347] Generated new cluster ID: e009d4c3d8a2419a88fb82311b174376
I20260811 00:55:09.151695 16626 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:55:09.157089 16626 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:55:09.157933 16626 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:55:09.161466 16613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:09.139396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50640 (local address 127.15.70.62:40319)
0811 00:55:09.139925 (+ 529us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:09.139936 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:09.139983 (+ 47us) server_negotiation.cc:407] Connection header received
0811 00:55:09.140785 (+ 802us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:09.140798 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:09.140885 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:09.141150 (+ 265us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:09.142285 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:09.144740 (+ 2455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:09.146098 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:09.146850 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:09.147030 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:09.150927 (+ 3897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:09.150932 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:09.150932 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:09.150954 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:09.158244 (+ 7290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:09.158993 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:09.159000 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:09.159000 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:09.159614 (+ 614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:09.160098 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:09.160099 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:09.160100 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:09.160582 (+ 482us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:09.160774 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:09.160927 (+ 153us) server_negotiation.cc:299] Negotiation successful
0811 00:55:09.161144 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":447,"thread_start_us":198,"threads_started":1}
I20260811 00:55:09.165742 16626 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f8dbc4c77999413b9955d0c8c02c4d09: Generated new TSK 0
I20260811 00:55:09.166121 16626 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.70.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab.
Entry for principal kudu/127.15.70.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab.
I20260811 00:55:09.212319 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.1:0
--local_ip_for_outbound_sockets=127.15.70.1
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:40319
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:43105
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:09.322731 16648 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:09.323132 16648 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:09.323194 16648 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:09.324609 16648 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:09.324687 16648 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:09.324734 16648 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.1
I20260811 00:55:09.326577 16648 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:43105
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:40319
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16648
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.1
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:09.326920 16648 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:09.327278 16648 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:09.333765 16658 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:09.333788 16660 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:09.333765 16665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:09.334817 16648 server_base.cc:1034] running on GCE node
I20260811 00:55:09.335213 16648 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:09.335537 16648 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:09.336702 16648 hybrid_clock.cc:648] HybridClock initialized: now 1786409709336679 us; error 48 us; skew 500 ppm
Aug 11 00:55:09 dist-test-slave-h3ft krb5kdc[16469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409709, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:09.340713 16648 init.cc:377] Logged in from keytab as kudu/127.15.70.1@KRBTEST.COM (short username kudu)
I20260811 00:55:09.341413 16648 webserver.cc:460] Webserver started at http://127.15.70.1:38461/ using document root <none> and password file <none>
I20260811 00:55:09.341696 16648 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:09.341773 16648 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:09.341954 16648 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:09.343447 16648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-0/data/instance:
uuid: "4d4ea6a480134ebb8a7d078fd2624f55"
format_stamp: "Formatted at 2026-08-11 00:55:09 on dist-test-slave-h3ft"
server_key: "25b5722191a8239cb3acc3a72e539c95"
server_key_iv: "072080f386a571ba53b6b284358ad2a9"
server_key_version: "encryptionkey@0"
I20260811 00:55:09.343942 16648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance:
uuid: "4d4ea6a480134ebb8a7d078fd2624f55"
format_stamp: "Formatted at 2026-08-11 00:55:09 on dist-test-slave-h3ft"
server_key: "25b5722191a8239cb3acc3a72e539c95"
server_key_iv: "072080f386a571ba53b6b284358ad2a9"
server_key_version: "encryptionkey@0"
I20260811 00:55:09.345975 16648 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.001s
I20260811 00:55:09.347154 16675 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:09.347493 16648 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:09.347636 16648 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-0/wal
uuid: "4d4ea6a480134ebb8a7d078fd2624f55"
format_stamp: "Formatted at 2026-08-11 00:55:09 on dist-test-slave-h3ft"
server_key: "25b5722191a8239cb3acc3a72e539c95"
server_key_iv: "072080f386a571ba53b6b284358ad2a9"
server_key_version: "encryptionkey@0"
I20260811 00:55:09.347746 16648 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:09.357088 16648 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:09.360116 16648 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:09.360335 16648 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:09.360646 16648 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:55:09.361065 16648 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:55:09.361125 16648 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:09.361171 16648 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:55:09.361219 16648 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:09.369488 16648 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.1:40131
I20260811 00:55:09.369527 16855 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.1:40131 every 8 connection(s)
I20260811 00:55:09.370018 16648 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
I20260811 00:55:09.371848 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 16648
I20260811 00:55:09.371978 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance
I20260811 00:55:09.372231 15640 external_mini_cluster.cc:1428] Setting key 0f9f580bbb8209b69986e98d0479b6bf
Aug 11 00:55:09 dist-test-slave-h3ft krb5kdc[16469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409709, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:09.384632 16613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:09.371461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:35699 (local address 127.15.70.62:40319)
0811 00:55:09.371527 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:09.371530 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:09.371784 (+ 254us) server_negotiation.cc:407] Connection header received
0811 00:55:09.373300 (+ 1516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:09.373301 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:09.373319 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:09.373391 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:09.374259 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:09.375141 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:09.377040 (+ 1899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:09.377322 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:09.377398 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:09.380574 (+ 3176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:09.380577 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:09.380577 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:09.380590 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:09.382591 (+ 2001us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:09.383258 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:09.383260 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:09.383261 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:09.383337 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:09.383675 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:09.383676 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:09.383676 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:09.383868 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:09.383961 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:09.384359 (+ 398us) server_negotiation.cc:299] Negotiation successful
0811 00:55:09.384487 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 00:55:09.384776 16859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:09.371390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:40319 (local address 127.15.70.1:35699)
0811 00:55:09.371602 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:09.371658 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:09.373140 (+ 1482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:09.373495 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:09.373500 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:09.373882 (+ 382us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:09.374144 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:09.374149 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:09.375260 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:09.375261 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:09.376904 (+ 1643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:09.376909 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:09.377437 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:09.377438 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:09.377608 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:09.378377 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:09.378389 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:09.380393 (+ 2004us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:09.382708 (+ 2315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:09.382717 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:09.382721 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:09.383168 (+ 447us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:09.383436 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:09.383437 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:09.383438 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:09.383590 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:09.383988 (+ 398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:09.383996 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:09.384178 (+ 182us) client_negotiation.cc:769] Sending connection context
0811 00:55:09.384304 (+ 126us) client_negotiation.cc:240] Negotiation successful
0811 00:55:09.384492 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":112,"threads_started":1}
WARNING: no policy specified for kudu/127.15.70.2@KRBTEST.COM; defaulting to no policy
I20260811 00:55:09.385541 16856 heartbeater.cc:347] Connected to a master server at 127.15.70.62:40319
I20260811 00:55:09.385712 16856 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:09.386034 16856 heartbeater.cc:511] Master 127.15.70.62:40319 requested a full tablet report, sending...
I20260811 00:55:09.387223 16550 ts_manager.cc:194] Registered new tserver with Master: 4d4ea6a480134ebb8a7d078fd2624f55 (127.15.70.1:40131)
I20260811 00:55:09.388221 16550 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.1@KRBTEST.COM'} at 127.15.70.1:35699
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab.
Entry for principal kudu/127.15.70.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab.
I20260811 00:55:09.412714 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.2:0
--local_ip_for_outbound_sockets=127.15.70.2
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:40319
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:43105
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:09.523582 16862 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:09.524277 16862 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:09.524346 16862 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:09.526404 16862 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:09.526515 16862 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:09.526559 16862 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.2
I20260811 00:55:09.528910 16862 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:43105
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:40319
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16862
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.2
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:09.529381 16862 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:09.529914 16862 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:09.537623 16873 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:09.537628 16875 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:09.537624 16872 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:09.538528 16862 server_base.cc:1034] running on GCE node
I20260811 00:55:09.539151 16862 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:09.539520 16862 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:09.540686 16862 hybrid_clock.cc:648] HybridClock initialized: now 1786409709540657 us; error 47 us; skew 500 ppm
Aug 11 00:55:09 dist-test-slave-h3ft krb5kdc[16469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409709, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:09.545043 16862 init.cc:377] Logged in from keytab as kudu/127.15.70.2@KRBTEST.COM (short username kudu)
I20260811 00:55:09.545921 16862 webserver.cc:460] Webserver started at http://127.15.70.2:33015/ using document root <none> and password file <none>
I20260811 00:55:09.546275 16862 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:09.546332 16862 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:09.546491 16862 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:09.547930 16862 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-1/data/instance:
uuid: "ded31b1113174671865a6bcda0e7cc0b"
format_stamp: "Formatted at 2026-08-11 00:55:09 on dist-test-slave-h3ft"
server_key: "0ead5bf86fca4c1a32567fe660b35b44"
server_key_iv: "2430cd91959062f6fba6498b8c88e4c8"
server_key_version: "encryptionkey@0"
I20260811 00:55:09.548378 16862 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance:
uuid: "ded31b1113174671865a6bcda0e7cc0b"
format_stamp: "Formatted at 2026-08-11 00:55:09 on dist-test-slave-h3ft"
server_key: "0ead5bf86fca4c1a32567fe660b35b44"
server_key_iv: "2430cd91959062f6fba6498b8c88e4c8"
server_key_version: "encryptionkey@0"
I20260811 00:55:09.550427 16862 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 00:55:09.551901 16887 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:09.552321 16862 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 00:55:09.552541 16862 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-1/wal
uuid: "ded31b1113174671865a6bcda0e7cc0b"
format_stamp: "Formatted at 2026-08-11 00:55:09 on dist-test-slave-h3ft"
server_key: "0ead5bf86fca4c1a32567fe660b35b44"
server_key_iv: "2430cd91959062f6fba6498b8c88e4c8"
server_key_version: "encryptionkey@0"
I20260811 00:55:09.552680 16862 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:09.569540 16862 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:09.572399 16862 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:09.572553 16862 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:09.572822 16862 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:55:09.573316 16862 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:55:09.573359 16862 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:09.573416 16862 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:55:09.573446 16862 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:09.582607 16862 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.2:39983
I20260811 00:55:09.582657 17064 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.2:39983 every 8 connection(s)
I20260811 00:55:09.583180 16862 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
Aug 11 00:55:09 dist-test-slave-h3ft krb5kdc[16469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409709, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:09.591969 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 16862
I20260811 00:55:09.592073 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance
I20260811 00:55:09.592296 15640 external_mini_cluster.cc:1428] Setting key 248771d245e06630187c55cc4a99716e
I20260811 00:55:09.596675 16613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:09.584268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:52937 (local address 127.15.70.62:40319)
0811 00:55:09.584375 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:09.584378 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:09.584626 (+ 248us) server_negotiation.cc:407] Connection header received
0811 00:55:09.585871 (+ 1245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:09.585873 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:09.585893 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:09.585960 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:09.586825 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:09.587477 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:09.588665 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:09.588893 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:09.588993 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:09.592456 (+ 3463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:09.592459 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:09.592459 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:09.592473 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:09.594683 (+ 2210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:09.595410 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:09.595412 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:09.595412 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:09.595494 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:09.595784 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:09.595785 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:09.595786 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:09.595972 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:09.596058 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:09.596488 (+ 430us) server_negotiation.cc:299] Negotiation successful
0811 00:55:09.596581 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 00:55:09.597095 17069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:09.584230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:40319 (local address 127.15.70.2:52937)
0811 00:55:09.584452 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:09.584511 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:09.585710 (+ 1199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:09.586054 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:09.586059 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:09.586424 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:09.586688 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:09.586693 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:09.587596 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:09.587597 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:09.588557 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:09.588561 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:09.589009 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:09.589010 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:09.589167 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:09.589982 (+ 815us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:09.589993 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:09.592266 (+ 2273us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:09.594822 (+ 2556us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:09.594835 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:09.594838 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:09.595309 (+ 471us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:09.595573 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:09.595574 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:09.595575 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:09.595715 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:09.596056 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:09.596064 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:09.596316 (+ 252us) client_negotiation.cc:769] Sending connection context
0811 00:55:09.596458 (+ 142us) client_negotiation.cc:240] Negotiation successful
0811 00:55:09.596741 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":110,"threads_started":1}
I20260811 00:55:09.597796 17066 heartbeater.cc:347] Connected to a master server at 127.15.70.62:40319
I20260811 00:55:09.597946 17066 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:09.598196 17066 heartbeater.cc:511] Master 127.15.70.62:40319 requested a full tablet report, sending...
I20260811 00:55:09.598783 16550 ts_manager.cc:194] Registered new tserver with Master: ded31b1113174671865a6bcda0e7cc0b (127.15.70.2:39983)
I20260811 00:55:09.599354 16550 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.2@KRBTEST.COM'} at 127.15.70.2:52937
WARNING: no policy specified for kudu/127.15.70.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab.
Entry for principal kudu/127.15.70.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab.
I20260811 00:55:09.633230 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.3:0
--local_ip_for_outbound_sockets=127.15.70.3
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:40319
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:43105
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:09.756234 17073 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:09.756618 17073 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:09.756702 17073 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:09.758801 17073 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:09.758931 17073 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:09.758994 17073 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.3
I20260811 00:55:09.761327 17073 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:43105
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:40319
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17073
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.3
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:09.761777 17073 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:09.762126 17073 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:09.768921 17080 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:09.768909 17087 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:09.768909 17083 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:09.768949 17073 server_base.cc:1034] running on GCE node
I20260811 00:55:09.769508 17073 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:09.769860 17073 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:09.771092 17073 hybrid_clock.cc:648] HybridClock initialized: now 1786409709771069 us; error 38 us; skew 500 ppm
Aug 11 00:55:09 dist-test-slave-h3ft krb5kdc[16469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409709, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:09.775318 17073 init.cc:377] Logged in from keytab as kudu/127.15.70.3@KRBTEST.COM (short username kudu)
I20260811 00:55:09.776005 17073 webserver.cc:460] Webserver started at http://127.15.70.3:34663/ using document root <none> and password file <none>
I20260811 00:55:09.776310 17073 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:09.776387 17073 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:09.776567 17073 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:09.778059 17073 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-2/data/instance:
uuid: "7cdce4a0cd834d46aa679abdbfa5c552"
format_stamp: "Formatted at 2026-08-11 00:55:09 on dist-test-slave-h3ft"
server_key: "459daf8a0d5b9265bb8f69e9bfe83a74"
server_key_iv: "f3df9d95d3fa1059e5e1a4f389111608"
server_key_version: "encryptionkey@0"
I20260811 00:55:09.778622 17073 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance:
uuid: "7cdce4a0cd834d46aa679abdbfa5c552"
format_stamp: "Formatted at 2026-08-11 00:55:09 on dist-test-slave-h3ft"
server_key: "459daf8a0d5b9265bb8f69e9bfe83a74"
server_key_iv: "f3df9d95d3fa1059e5e1a4f389111608"
server_key_version: "encryptionkey@0"
I20260811 00:55:09.780731 17073 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.001s
I20260811 00:55:09.781832 17097 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:09.782137 17073 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:09.782281 17073 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-2/wal
uuid: "7cdce4a0cd834d46aa679abdbfa5c552"
format_stamp: "Formatted at 2026-08-11 00:55:09 on dist-test-slave-h3ft"
server_key: "459daf8a0d5b9265bb8f69e9bfe83a74"
server_key_iv: "f3df9d95d3fa1059e5e1a4f389111608"
server_key_version: "encryptionkey@0"
I20260811 00:55:09.782387 17073 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:09.795645 17073 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:09.798571 17073 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:09.798804 17073 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:09.799285 17073 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:55:09.799855 17073 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:55:09.799925 17073 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:09.799975 17073 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:55:09.800010 17073 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:09.808787 17073 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.3:45271
I20260811 00:55:09.808847 17271 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.3:45271 every 8 connection(s)
I20260811 00:55:09.809309 17073 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
I20260811 00:55:09.813603 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 17073
I20260811 00:55:09.813766 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance
I20260811 00:55:09.813978 15640 external_mini_cluster.cc:1428] Setting key 6fb785a02771b84f91a543c395c2105e
Aug 11 00:55:09 dist-test-slave-h3ft krb5kdc[16469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409709, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:09.823341 16613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:09.810953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:34961 (local address 127.15.70.62:40319)
0811 00:55:09.811094 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:09.811097 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:09.811440 (+ 343us) server_negotiation.cc:407] Connection header received
0811 00:55:09.812699 (+ 1259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:09.812701 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:09.812722 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:09.812796 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:09.813775 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:09.814612 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:09.816017 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:09.816259 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:09.816373 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:09.819389 (+ 3016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:09.819392 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:09.819392 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:09.819412 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:09.821232 (+ 1820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:09.821951 (+ 719us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:09.821954 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:09.821954 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:09.822032 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:09.822373 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:09.822374 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:09.822375 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:09.822545 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:09.822635 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:09.823073 (+ 438us) server_negotiation.cc:299] Negotiation successful
0811 00:55:09.823212 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 00:55:09.823639 17274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:09.810850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:40319 (local address 127.15.70.3:34961)
0811 00:55:09.811189 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:09.811247 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:09.812528 (+ 1281us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:09.812904 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:09.812909 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:09.813323 (+ 414us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:09.813626 (+ 303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:09.813631 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:09.814747 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:09.814749 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:09.815878 (+ 1129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:09.815881 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:09.816391 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:09.816393 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:09.816563 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:09.817297 (+ 734us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:09.817308 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:09.819252 (+ 1944us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:09.821392 (+ 2140us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:09.821407 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:09.821411 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:09.821820 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:09.822121 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:09.822122 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:09.822122 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:09.822286 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:09.822635 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:09.822645 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:09.822849 (+ 204us) client_negotiation.cc:769] Sending connection context
0811 00:55:09.822984 (+ 135us) client_negotiation.cc:240] Negotiation successful
0811 00:55:09.823250 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":173,"threads_started":1}
I20260811 00:55:09.824528 17272 heartbeater.cc:347] Connected to a master server at 127.15.70.62:40319
I20260811 00:55:09.824788 17272 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:09.825184 17272 heartbeater.cc:511] Master 127.15.70.62:40319 requested a full tablet report, sending...
I20260811 00:55:09.826107 16550 ts_manager.cc:194] Registered new tserver with Master: 7cdce4a0cd834d46aa679abdbfa5c552 (127.15.70.3:45271)
I20260811 00:55:09.826722 16550 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.3@KRBTEST.COM'} at 127.15.70.3:34961
I20260811 00:55:09.827087 15640 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 00:55:09.840154 16613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:09.829609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50652 (local address 127.15.70.62:40319)
0811 00:55:09.829702 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:09.829704 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:09.829963 (+ 259us) server_negotiation.cc:407] Connection header received
0811 00:55:09.830003 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:09.830003 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:09.830019 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:09.830103 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:09.830901 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:09.831633 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:09.832566 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:09.832803 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:09.832869 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:09.835413 (+ 2544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:09.835415 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:09.835415 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:09.835428 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:09.837782 (+ 2354us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:09.838479 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:09.838481 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:09.838482 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:09.838636 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:09.838931 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:09.838933 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:09.838933 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:09.839326 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:09.839448 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:09.839785 (+ 337us) server_negotiation.cc:299] Negotiation successful
0811 00:55:09.839902 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 00:55:09.844558 16550 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50652:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:55:09.847321 16550 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:55:09.858223 17290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:09.851689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:40131 (local address 127.0.0.1:54766)
0811 00:55:09.852488 (+ 799us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:09.852499 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:09.852571 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:09.852962 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:09.852964 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:09.852966 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:09.853030 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:09.853032 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:09.854558 (+ 1526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:09.854559 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:09.856340 (+ 1781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:09.856346 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:09.857701 (+ 1355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:09.857702 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:09.857849 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:09.857874 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 00:55:09.857976 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 00:55:09.858077 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":757,"mutex_wait_us":80,"thread_start_us":171,"threads_started":1}
I20260811 00:55:09.858319 17293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:09.852110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54766 (local address 127.15.70.1:40131)
0811 00:55:09.852364 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:09.852369 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:09.852669 (+ 300us) server_negotiation.cc:407] Connection header received
0811 00:55:09.852731 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:09.852734 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:09.852778 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:09.852868 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:09.853157 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:09.854303 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:09.856509 (+ 2206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:09.857478 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:09.857568 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:09.857657 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:09.858117 (+ 460us) server_negotiation.cc:299] Negotiation successful
0811 00:55:09.858188 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":221,"thread_start_us":85,"threads_started":1}
I20260811 00:55:09.858831 17291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:09.851907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39200 (local address 127.15.70.2:39983)
0811 00:55:09.852157 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:09.852164 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:09.852181 (+ 17us) server_negotiation.cc:407] Connection header received
0811 00:55:09.852244 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:09.852247 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:09.852268 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:09.852413 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:09.852845 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:09.854132 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:09.856768 (+ 2636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:09.857920 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:09.857995 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:09.858055 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:09.858320 (+ 265us) server_negotiation.cc:299] Negotiation successful
0811 00:55:09.858745 (+ 425us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":196,"thread_start_us":137,"threads_started":1}
I20260811 00:55:09.859242 17288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:09.851688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.2:39983 (local address 127.0.0.1:39200)
0811 00:55:09.851954 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:09.852015 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:09.852106 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:09.852572 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:09.852576 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:09.852578 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:09.852727 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:09.852731 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:09.854330 (+ 1599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:09.854332 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:09.856414 (+ 2082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:09.856588 (+ 174us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:09.858095 (+ 1507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:09.858096 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:09.858161 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:09.858164 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:55:09.858213 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 00:55:09.858269 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"mutex_wait_us":577,"thread_start_us":117,"threads_started":1}
I20260811 00:55:09.859804 17294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:09.852204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42040 (local address 127.15.70.3:45271)
0811 00:55:09.852674 (+ 470us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:09.852680 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:09.853118 (+ 438us) server_negotiation.cc:407] Connection header received
0811 00:55:09.853184 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:09.853186 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:09.853204 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:09.853312 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:09.853432 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:09.854760 (+ 1328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:09.856731 (+ 1971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:09.858052 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:09.858160 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:09.858231 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:09.859224 (+ 993us) server_negotiation.cc:299] Negotiation successful
0811 00:55:09.859295 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":422,"thread_start_us":135,"threads_started":1}
I20260811 00:55:09.859601 16751 tablet_service.cc:1467] Processing CreateTablet for tablet 34a3db0c94254dae9b2425d17f9205c0 (DEFAULT_TABLE table=test-table [id=9d878ad992d34c8f82f5db1ed58b9d1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:55:09.860018 17289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:09.851702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:45271 (local address 127.0.0.1:42040)
0811 00:55:09.853017 (+ 1315us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:09.853027 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:09.853109 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:09.853308 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:09.853309 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:09.853311 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:09.853371 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:09.853373 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:09.854882 (+ 1509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:09.854884 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:09.856340 (+ 1456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:09.856346 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:09.858277 (+ 1931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:09.858278 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:09.858902 (+ 624us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:09.858912 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 00:55:09.858984 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 00:55:09.859076 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1294,"mutex_wait_us":60,"thread_start_us":154,"threads_started":1}
I20260811 00:55:09.860268 16751 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34a3db0c94254dae9b2425d17f9205c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:09.860422 16964 tablet_service.cc:1467] Processing CreateTablet for tablet 34a3db0c94254dae9b2425d17f9205c0 (DEFAULT_TABLE table=test-table [id=9d878ad992d34c8f82f5db1ed58b9d1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:55:09.860917 16964 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34a3db0c94254dae9b2425d17f9205c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:09.860869 17170 tablet_service.cc:1467] Processing CreateTablet for tablet 34a3db0c94254dae9b2425d17f9205c0 (DEFAULT_TABLE table=test-table [id=9d878ad992d34c8f82f5db1ed58b9d1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:55:09.861312 17170 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34a3db0c94254dae9b2425d17f9205c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:09.864815 17295 tablet_bootstrap.cc:492] T 34a3db0c94254dae9b2425d17f9205c0 P ded31b1113174671865a6bcda0e7cc0b: Bootstrap starting.
I20260811 00:55:09.865593 17298 tablet_bootstrap.cc:492] T 34a3db0c94254dae9b2425d17f9205c0 P 4d4ea6a480134ebb8a7d078fd2624f55: Bootstrap starting.
I20260811 00:55:09.866366 17295 tablet_bootstrap.cc:654] T 34a3db0c94254dae9b2425d17f9205c0 P ded31b1113174671865a6bcda0e7cc0b: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:09.866580 17299 tablet_bootstrap.cc:492] T 34a3db0c94254dae9b2425d17f9205c0 P 7cdce4a0cd834d46aa679abdbfa5c552: Bootstrap starting.
I20260811 00:55:09.866773 17298 tablet_bootstrap.cc:654] T 34a3db0c94254dae9b2425d17f9205c0 P 4d4ea6a480134ebb8a7d078fd2624f55: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:09.867465 17299 tablet_bootstrap.cc:654] T 34a3db0c94254dae9b2425d17f9205c0 P 7cdce4a0cd834d46aa679abdbfa5c552: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:09.867759 17298 log.cc:824] T 34a3db0c94254dae9b2425d17f9205c0 P 4d4ea6a480134ebb8a7d078fd2624f55: Log is configured to *not* fsync() on all Append() calls
I20260811 00:55:09.867794 17295 log.cc:824] T 34a3db0c94254dae9b2425d17f9205c0 P ded31b1113174671865a6bcda0e7cc0b: Log is configured to *not* fsync() on all Append() calls
I20260811 00:55:09.868144 17299 log.cc:824] T 34a3db0c94254dae9b2425d17f9205c0 P 7cdce4a0cd834d46aa679abdbfa5c552: Log is configured to *not* fsync() on all Append() calls
I20260811 00:55:09.869025 17298 tablet_bootstrap.cc:492] T 34a3db0c94254dae9b2425d17f9205c0 P 4d4ea6a480134ebb8a7d078fd2624f55: No bootstrap required, opened a new log
I20260811 00:55:09.869024 17295 tablet_bootstrap.cc:492] T 34a3db0c94254dae9b2425d17f9205c0 P ded31b1113174671865a6bcda0e7cc0b: No bootstrap required, opened a new log
I20260811 00:55:09.869127 17295 ts_tablet_manager.cc:1397] T 34a3db0c94254dae9b2425d17f9205c0 P ded31b1113174671865a6bcda0e7cc0b: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.002s
I20260811 00:55:09.869127 17298 ts_tablet_manager.cc:1397] T 34a3db0c94254dae9b2425d17f9205c0 P 4d4ea6a480134ebb8a7d078fd2624f55: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260811 00:55:09.869233 17299 tablet_bootstrap.cc:492] T 34a3db0c94254dae9b2425d17f9205c0 P 7cdce4a0cd834d46aa679abdbfa5c552: No bootstrap required, opened a new log
I20260811 00:55:09.869340 17299 ts_tablet_manager.cc:1397] T 34a3db0c94254dae9b2425d17f9205c0 P 7cdce4a0cd834d46aa679abdbfa5c552: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 00:55:09.871773 17299 raft_consensus.cc:348] T 34a3db0c94254dae9b2425d17f9205c0 P 7cdce4a0cd834d46aa679abdbfa5c552 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4ea6a480134ebb8a7d078fd2624f55" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 40131 } } peers { permanent_uuid: "ded31b1113174671865a6bcda0e7cc0b" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39983 } } peers { permanent_uuid: "7cdce4a0cd834d46aa679abdbfa5c552" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 45271 } }
I20260811 00:55:09.872040 17299 raft_consensus.cc:374] T 34a3db0c94254dae9b2425d17f9205c0 P 7cdce4a0cd834d46aa679abdbfa5c552 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:09.872099 17299 raft_consensus.cc:729] T 34a3db0c94254dae9b2425d17f9205c0 P 7cdce4a0cd834d46aa679abdbfa5c552 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cdce4a0cd834d46aa679abdbfa5c552, State: Initialized, Role: FOLLOWER
I20260811 00:55:09.872097 17298 raft_consensus.cc:348] T 34a3db0c94254dae9b2425d17f9205c0 P 4d4ea6a480134ebb8a7d078fd2624f55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4ea6a480134ebb8a7d078fd2624f55" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 40131 } } peers { permanent_uuid: "ded31b1113174671865a6bcda0e7cc0b" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39983 } } peers { permanent_uuid: "7cdce4a0cd834d46aa679abdbfa5c552" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 45271 } }
I20260811 00:55:09.872128 17295 raft_consensus.cc:348] T 34a3db0c94254dae9b2425d17f9205c0 P ded31b1113174671865a6bcda0e7cc0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4ea6a480134ebb8a7d078fd2624f55" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 40131 } } peers { permanent_uuid: "ded31b1113174671865a6bcda0e7cc0b" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39983 } } peers { permanent_uuid: "7cdce4a0cd834d46aa679abdbfa5c552" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 45271 } }
I20260811 00:55:09.872325 17295 raft_consensus.cc:374] T 34a3db0c94254dae9b2425d17f9205c0 P ded31b1113174671865a6bcda0e7cc0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:09.872325 17298 raft_consensus.cc:374] T 34a3db0c94254dae9b2425d17f9205c0 P 4d4ea6a480134ebb8a7d078fd2624f55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:09.872377 17298 raft_consensus.cc:729] T 34a3db0c94254dae9b2425d17f9205c0 P 4d4ea6a480134ebb8a7d078fd2624f55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d4ea6a480134ebb8a7d078fd2624f55, State: Initialized, Role: FOLLOWER
I20260811 00:55:09.872377 17295 raft_consensus.cc:729] T 34a3db0c94254dae9b2425d17f9205c0 P ded31b1113174671865a6bcda0e7cc0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ded31b1113174671865a6bcda0e7cc0b, State: Initialized, Role: FOLLOWER
I20260811 00:55:09.872536 17299 consensus_queue.cc:260] T 34a3db0c94254dae9b2425d17f9205c0 P 7cdce4a0cd834d46aa679abdbfa5c552 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4ea6a480134ebb8a7d078fd2624f55" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 40131 } } peers { permanent_uuid: "ded31b1113174671865a6bcda0e7cc0b" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39983 } } peers { permanent_uuid: "7cdce4a0cd834d46aa679abdbfa5c552" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 45271 } }
I20260811 00:55:09.872541 17298 consensus_queue.cc:260] T 34a3db0c94254dae9b2425d17f9205c0 P 4d4ea6a480134ebb8a7d078fd2624f55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4ea6a480134ebb8a7d078fd2624f55" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 40131 } } peers { permanent_uuid: "ded31b1113174671865a6bcda0e7cc0b" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39983 } } peers { permanent_uuid: "7cdce4a0cd834d46aa679abdbfa5c552" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 45271 } }
I20260811 00:55:09.872535 17295 consensus_queue.cc:260] T 34a3db0c94254dae9b2425d17f9205c0 P ded31b1113174671865a6bcda0e7cc0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4ea6a480134ebb8a7d078fd2624f55" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 40131 } } peers { permanent_uuid: "ded31b1113174671865a6bcda0e7cc0b" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39983 } } peers { permanent_uuid: "7cdce4a0cd834d46aa679abdbfa5c552" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 45271 } }
I20260811 00:55:09.873046 17299 ts_tablet_manager.cc:1428] T 34a3db0c94254dae9b2425d17f9205c0 P 7cdce4a0cd834d46aa679abdbfa5c552: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260811 00:55:09.873051 17066 heartbeater.cc:503] Master 127.15.70.62:40319 was elected leader, sending a full tablet report...
I20260811 00:55:09.873205 17272 heartbeater.cc:503] Master 127.15.70.62:40319 was elected leader, sending a full tablet report...
I20260811 00:55:09.873219 17298 ts_tablet_manager.cc:1428] T 34a3db0c94254dae9b2425d17f9205c0 P 4d4ea6a480134ebb8a7d078fd2624f55: Time spent starting tablet: real 0.004s user 0.004s sys 0.001s
I20260811 00:55:09.873365 16856 heartbeater.cc:503] Master 127.15.70.62:40319 was elected leader, sending a full tablet report...
I20260811 00:55:09.873049 17295 ts_tablet_manager.cc:1428] T 34a3db0c94254dae9b2425d17f9205c0 P ded31b1113174671865a6bcda0e7cc0b: Time spent starting tablet: real 0.004s user 0.003s sys 0.001s
I20260811 00:55:09.912693 17309 raft_consensus.cc:482] T 34a3db0c94254dae9b2425d17f9205c0 P ded31b1113174671865a6bcda0e7cc0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:55:09.912967 17309 raft_consensus.cc:504] T 34a3db0c94254dae9b2425d17f9205c0 P ded31b1113174671865a6bcda0e7cc0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4ea6a480134ebb8a7d078fd2624f55" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 40131 } } peers { permanent_uuid: "ded31b1113174671865a6bcda0e7cc0b" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39983 } } peers { permanent_uuid: "7cdce4a0cd834d46aa679abdbfa5c552" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 45271 } }
I20260811 00:55:09.913545 17309 leader_election.cc:288] T 34a3db0c94254dae9b2425d17f9205c0 P ded31b1113174671865a6bcda0e7cc0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d4ea6a480134ebb8a7d078fd2624f55 (127.15.70.1:40131), 7cdce4a0cd834d46aa679abdbfa5c552 (127.15.70.3:45271)
I20260811 00:55:09.918416 17294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:09.913997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:42753 (local address 127.15.70.3:45271)
0811 00:55:09.914065 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:09.914068 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:09.914083 (+ 15us) server_negotiation.cc:407] Connection header received
0811 00:55:09.914124 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:09.914125 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:09.914137 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:09.914215 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:09.914528 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:09.915370 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:09.917099 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:09.917805 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:09.917909 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:09.917925 (+ 16us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:09.918253 (+ 328us) server_negotiation.cc:299] Negotiation successful
0811 00:55:09.918314 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 00:55:09.918416 17293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:09.913948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:53661 (local address 127.15.70.1:40131)
0811 00:55:09.914008 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:09.914010 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:09.914500 (+ 490us) server_negotiation.cc:407] Connection header received
0811 00:55:09.914561 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:09.914562 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:09.914580 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:09.914653 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:09.914977 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:09.915652 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:09.917113 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:09.917821 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:09.917909 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:09.917925 (+ 16us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:09.918253 (+ 328us) server_negotiation.cc:299] Negotiation successful
0811 00:55:09.918315 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 00:55:09.918459 17069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:09.913810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:45271 (local address 127.15.70.2:42753)
0811 00:55:09.913881 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:09.913898 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:09.913965 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:09.914269 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:09.914271 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:09.914274 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:09.914395 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:09.914398 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:09.915495 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:09.915496 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:09.916915 (+ 1419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:09.916916 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:09.918009 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:09.918010 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:09.918133 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:09.918139 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 00:55:09.918211 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 00:55:09.918278 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":4}
I20260811 00:55:09.918476 17312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:09.913818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:40131 (local address 127.15.70.2:53661)
0811 00:55:09.914291 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:09.914305 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:09.914396 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:09.914762 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:09.914763 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:09.914766 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:09.914850 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:09.914851 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:09.915750 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:09.915751 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:09.916908 (+ 1157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:09.916911 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:09.918009 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:09.918010 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:09.918133 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:09.918139 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 00:55:09.918211 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 00:55:09.918278 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":446,"mutex_wait_us":153,"thread_start_us":175,"threads_started":1}
I20260811 00:55:09.919118 17198 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34a3db0c94254dae9b2425d17f9205c0" candidate_uuid: "ded31b1113174671865a6bcda0e7cc0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cdce4a0cd834d46aa679abdbfa5c552" is_pre_election: true
I20260811 00:55:09.919358 17198 raft_consensus.cc:2454] T 34a3db0c94254dae9b2425d17f9205c0 P 7cdce4a0cd834d46aa679abdbfa5c552 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ded31b1113174671865a6bcda0e7cc0b in term 0.
I20260811 00:55:09.919441 16785 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34a3db0c94254dae9b2425d17f9205c0" candidate_uuid: "ded31b1113174671865a6bcda0e7cc0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4ea6a480134ebb8a7d078fd2624f55" is_pre_election: true
I20260811 00:55:09.919664 16785 raft_consensus.cc:2454] T 34a3db0c94254dae9b2425d17f9205c0 P 4d4ea6a480134ebb8a7d078fd2624f55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ded31b1113174671865a6bcda0e7cc0b in term 0.
I20260811 00:55:09.919764 16892 leader_election.cc:302] T 34a3db0c94254dae9b2425d17f9205c0 P ded31b1113174671865a6bcda0e7cc0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7cdce4a0cd834d46aa679abdbfa5c552, ded31b1113174671865a6bcda0e7cc0b; no voters:
I20260811 00:55:09.919976 17309 raft_consensus.cc:2781] T 34a3db0c94254dae9b2425d17f9205c0 P ded31b1113174671865a6bcda0e7cc0b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:55:09.920068 17309 raft_consensus.cc:482] T 34a3db0c94254dae9b2425d17f9205c0 P ded31b1113174671865a6bcda0e7cc0b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:55:09.920109 17309 raft_consensus.cc:3037] T 34a3db0c94254dae9b2425d17f9205c0 P ded31b1113174671865a6bcda0e7cc0b [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:09.921041 17309 raft_consensus.cc:504] T 34a3db0c94254dae9b2425d17f9205c0 P ded31b1113174671865a6bcda0e7cc0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4ea6a480134ebb8a7d078fd2624f55" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 40131 } } peers { permanent_uuid: "ded31b1113174671865a6bcda0e7cc0b" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39983 } } peers { permanent_uuid: "7cdce4a0cd834d46aa679abdbfa5c552" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 45271 } }
I20260811 00:55:09.921231 17309 leader_election.cc:288] T 34a3db0c94254dae9b2425d17f9205c0 P ded31b1113174671865a6bcda0e7cc0b [CANDIDATE]: Term 1 election: Requested vote from peers 4d4ea6a480134ebb8a7d078fd2624f55 (127.15.70.1:40131), 7cdce4a0cd834d46aa679abdbfa5c552 (127.15.70.3:45271)
I20260811 00:55:09.921428 17198 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34a3db0c94254dae9b2425d17f9205c0" candidate_uuid: "ded31b1113174671865a6bcda0e7cc0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cdce4a0cd834d46aa679abdbfa5c552"
I20260811 00:55:09.921468 16785 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34a3db0c94254dae9b2425d17f9205c0" candidate_uuid: "ded31b1113174671865a6bcda0e7cc0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4ea6a480134ebb8a7d078fd2624f55"
I20260811 00:55:09.921566 16785 raft_consensus.cc:3037] T 34a3db0c94254dae9b2425d17f9205c0 P 4d4ea6a480134ebb8a7d078fd2624f55 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:09.921576 17198 raft_consensus.cc:3037] T 34a3db0c94254dae9b2425d17f9205c0 P 7cdce4a0cd834d46aa679abdbfa5c552 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:09.923098 17198 raft_consensus.cc:2454] T 34a3db0c94254dae9b2425d17f9205c0 P 7cdce4a0cd834d46aa679abdbfa5c552 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ded31b1113174671865a6bcda0e7cc0b in term 1.
I20260811 00:55:09.923125 16785 raft_consensus.cc:2454] T 34a3db0c94254dae9b2425d17f9205c0 P 4d4ea6a480134ebb8a7d078fd2624f55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ded31b1113174671865a6bcda0e7cc0b in term 1.
I20260811 00:55:09.923343 16892 leader_election.cc:302] T 34a3db0c94254dae9b2425d17f9205c0 P ded31b1113174671865a6bcda0e7cc0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7cdce4a0cd834d46aa679abdbfa5c552, ded31b1113174671865a6bcda0e7cc0b; no voters:
I20260811 00:55:09.923596 17309 raft_consensus.cc:2781] T 34a3db0c94254dae9b2425d17f9205c0 P ded31b1113174671865a6bcda0e7cc0b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:55:09.923866 17309 raft_consensus.cc:686] T 34a3db0c94254dae9b2425d17f9205c0 P ded31b1113174671865a6bcda0e7cc0b [term 1 LEADER]: Becoming Leader. State: Replica: ded31b1113174671865a6bcda0e7cc0b, State: Running, Role: LEADER
I20260811 00:55:09.924031 17309 consensus_queue.cc:237] T 34a3db0c94254dae9b2425d17f9205c0 P ded31b1113174671865a6bcda0e7cc0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4ea6a480134ebb8a7d078fd2624f55" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 40131 } } peers { permanent_uuid: "ded31b1113174671865a6bcda0e7cc0b" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39983 } } peers { permanent_uuid: "7cdce4a0cd834d46aa679abdbfa5c552" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 45271 } }
I20260811 00:55:09.925379 16544 catalog_manager.cc:5495] T 34a3db0c94254dae9b2425d17f9205c0 P ded31b1113174671865a6bcda0e7cc0b reported cstate change: term changed from 0 to 1, leader changed from <none> to ded31b1113174671865a6bcda0e7cc0b (127.15.70.2). New cstate: current_term: 1 leader_uuid: "ded31b1113174671865a6bcda0e7cc0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4ea6a480134ebb8a7d078fd2624f55" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 40131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ded31b1113174671865a6bcda0e7cc0b" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7cdce4a0cd834d46aa679abdbfa5c552" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 45271 } health_report { overall_health: UNKNOWN } } }
Aug 11 00:55:09 dist-test-slave-h3ft krb5kdc[16469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409708, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.70.1@KRBTEST.COM
I20260811 00:55:09.951507 17293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:09.939814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54774 (local address 127.15.70.1:40131)
0811 00:55:09.939963 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:09.939967 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:09.940153 (+ 186us) server_negotiation.cc:407] Connection header received
0811 00:55:09.940289 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:09.940290 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:09.940306 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:09.940400 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:09.941193 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:09.941822 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:09.942719 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:09.942967 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:09.943133 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:09.946806 (+ 3673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:09.946833 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:09.946834 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:09.946846 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:09.949502 (+ 2656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:09.950131 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:09.950138 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:09.950138 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:09.950243 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:09.950627 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:09.950629 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:09.950629 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:09.950897 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:09.951221 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:09.951268 (+ 47us) server_negotiation.cc:299] Negotiation successful
0811 00:55:09.951376 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
Aug 11 00:55:09 dist-test-slave-h3ft krb5kdc[16469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409709, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 00:55:09 dist-test-slave-h3ft krb5kdc[16469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409709, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.15.70.1@KRBTEST.COM
I20260811 00:55:09.986913 17293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:09.976986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54782 (local address 127.15.70.1:40131)
0811 00:55:09.977062 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:09.977065 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:09.977396 (+ 331us) server_negotiation.cc:407] Connection header received
0811 00:55:09.977509 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:09.977510 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:09.977524 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:09.977599 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:09.978299 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:09.978867 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:09.979806 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:09.980024 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:09.980122 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:09.983471 (+ 3349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:09.983473 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:09.983473 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:09.983483 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:09.985323 (+ 1840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:09.985818 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:09.985820 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:09.985820 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:09.985895 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:09.986128 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:09.986130 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:09.986130 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:09.986267 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:09.986420 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:09.986670 (+ 250us) server_negotiation.cc:299] Negotiation successful
0811 00:55:09.986780 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
Aug 11 00:55:10 dist-test-slave-h3ft krb5kdc[16469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409710, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 00:55:10 dist-test-slave-h3ft krb5kdc[16469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409710, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.70.1@KRBTEST.COM
I20260811 00:55:10.021652 17293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:10.011138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54796 (local address 127.15.70.1:40131)
0811 00:55:10.011229 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:10.011233 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:10.011393 (+ 160us) server_negotiation.cc:407] Connection header received
0811 00:55:10.011574 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:10.011576 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:10.011589 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:10.011665 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:10.012454 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:10.013080 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:10.014001 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:10.014236 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:10.014333 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:10.018198 (+ 3865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:10.018201 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:10.018202 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:10.018214 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:10.020182 (+ 1968us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:10.020649 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:10.020651 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:10.020651 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:10.020725 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:10.020972 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:10.020973 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:10.020973 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:10.021126 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:10.021250 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:10.021401 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 00:55:10.021519 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
W20260811 00:55:10.022567 16719 tablet_service.cc:2908] Rejecting scan request for tablet 34a3db0c94254dae9b2425d17f9205c0: Uninitialized: clean time has not yet been initialized
I20260811 00:55:10.024097 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 16648
I20260811 00:55:10.053334 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 16862
W20260811 00:55:10.066098 17273 tablet.cc:2369] T 34a3db0c94254dae9b2425d17f9205c0 P 7cdce4a0cd834d46aa679abdbfa5c552: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 00:55:10.076393 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 17073
I20260811 00:55:10.123407 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 16491
2026-08-11T00:55:10Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2775 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:55:10 dist-test-slave-h3ft krb5kdc[17333](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:55:10 dist-test-slave-h3ft krb5kdc[17333](info): set up 2 sockets
Aug 11 00:55:10 dist-test-slave-h3ft krb5kdc[17333](info): commencing operation
krb5kdc: starting...
W20260811 00:55:11.550948 15640 mini_kdc.cc:121] Time spent starting KDC: real 1.395s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Aug 11 00:55:11 dist-test-slave-h3ft krb5kdc[17333](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409711, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:55:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:55:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.70.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
I20260811 00:55:11.727993 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:44985
--webserver_interface=127.15.70.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:38147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:44985
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:11.840962 17357 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:11.841370 17357 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:11.841425 17357 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:11.843189 17357 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:55:11.843313 17357 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 00:55:11.843338 17357 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:11.843360 17357 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:11.843382 17357 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:55:11.843415 17357 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:55:11.845587 17357 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:38147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:44985
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:44985
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17357
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:11.846035 17357 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:11.846378 17357 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:11.853025 17363 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:11.853152 17364 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:11.853302 17357 server_base.cc:1034] running on GCE node
W20260811 00:55:11.853415 17373 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:11.853833 17357 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:11.854255 17357 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:11.855501 17357 hybrid_clock.cc:648] HybridClock initialized: now 1786409711855466 us; error 47 us; skew 500 ppm
Aug 11 00:55:11 dist-test-slave-h3ft krb5kdc[17333](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409711, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:11.859086 17357 init.cc:377] Logged in from keytab as kudu/127.15.70.62@KRBTEST.COM (short username kudu)
I20260811 00:55:11.859817 17357 webserver.cc:460] Webserver started at http://127.15.70.62:35227/ using document root <none> and password file <none>
I20260811 00:55:11.860159 17357 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:11.860214 17357 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:11.860420 17357 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:11.861918 17357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "ea1cd6494c0b44adaba55aa880b1f31f"
format_stamp: "Formatted at 2026-08-11 00:55:11 on dist-test-slave-h3ft"
server_key: "2179c8c459c0a81b977f21c6ff227c42"
server_key_iv: "bd78f759ffcb7803a26ad22ee651934e"
server_key_version: "encryptionkey@0"
I20260811 00:55:11.862713 17357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "ea1cd6494c0b44adaba55aa880b1f31f"
format_stamp: "Formatted at 2026-08-11 00:55:11 on dist-test-slave-h3ft"
server_key: "2179c8c459c0a81b977f21c6ff227c42"
server_key_iv: "bd78f759ffcb7803a26ad22ee651934e"
server_key_version: "encryptionkey@0"
I20260811 00:55:11.865180 17357 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.005s sys 0.000s
I20260811 00:55:11.866405 17381 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:11.866788 17357 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:11.866930 17357 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "ea1cd6494c0b44adaba55aa880b1f31f"
format_stamp: "Formatted at 2026-08-11 00:55:11 on dist-test-slave-h3ft"
server_key: "2179c8c459c0a81b977f21c6ff227c42"
server_key_iv: "bd78f759ffcb7803a26ad22ee651934e"
server_key_version: "encryptionkey@0"
I20260811 00:55:11.867156 17357 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:11.881788 17357 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:11.885491 17357 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:11.885739 17357 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:11.893682 17357 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:44985
I20260811 00:55:11.893765 17476 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:44985 every 8 connection(s)
I20260811 00:55:11.894250 17357 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:55:11.895246 17482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:11.897532 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 17357
I20260811 00:55:11.897655 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 00:55:11.897876 15640 external_mini_cluster.cc:1428] Setting key 0b53e2ee73ea8231bd550becd5085668
I20260811 00:55:11.899148 17482 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea1cd6494c0b44adaba55aa880b1f31f: Bootstrap starting.
I20260811 00:55:11.900009 17482 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ea1cd6494c0b44adaba55aa880b1f31f: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:11.900396 17482 log.cc:824] T 00000000000000000000000000000000 P ea1cd6494c0b44adaba55aa880b1f31f: Log is configured to *not* fsync() on all Append() calls
I20260811 00:55:11.901386 17482 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea1cd6494c0b44adaba55aa880b1f31f: No bootstrap required, opened a new log
I20260811 00:55:11.903884 17482 raft_consensus.cc:348] T 00000000000000000000000000000000 P ea1cd6494c0b44adaba55aa880b1f31f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea1cd6494c0b44adaba55aa880b1f31f" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 44985 } }
I20260811 00:55:11.904143 17482 raft_consensus.cc:374] T 00000000000000000000000000000000 P ea1cd6494c0b44adaba55aa880b1f31f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:11.904194 17482 raft_consensus.cc:729] T 00000000000000000000000000000000 P ea1cd6494c0b44adaba55aa880b1f31f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea1cd6494c0b44adaba55aa880b1f31f, State: Initialized, Role: FOLLOWER
I20260811 00:55:11.904421 17482 consensus_queue.cc:260] T 00000000000000000000000000000000 P ea1cd6494c0b44adaba55aa880b1f31f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea1cd6494c0b44adaba55aa880b1f31f" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 44985 } }
I20260811 00:55:11.904551 17482 raft_consensus.cc:388] T 00000000000000000000000000000000 P ea1cd6494c0b44adaba55aa880b1f31f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:55:11.904594 17482 raft_consensus.cc:482] T 00000000000000000000000000000000 P ea1cd6494c0b44adaba55aa880b1f31f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:55:11.904663 17482 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ea1cd6494c0b44adaba55aa880b1f31f [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:11.905850 17482 raft_consensus.cc:504] T 00000000000000000000000000000000 P ea1cd6494c0b44adaba55aa880b1f31f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea1cd6494c0b44adaba55aa880b1f31f" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 44985 } }
I20260811 00:55:11.906031 17482 leader_election.cc:302] T 00000000000000000000000000000000 P ea1cd6494c0b44adaba55aa880b1f31f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ea1cd6494c0b44adaba55aa880b1f31f; no voters:
I20260811 00:55:11.906330 17482 leader_election.cc:288] T 00000000000000000000000000000000 P ea1cd6494c0b44adaba55aa880b1f31f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:55:11.906410 17487 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ea1cd6494c0b44adaba55aa880b1f31f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:55:11.906687 17487 raft_consensus.cc:686] T 00000000000000000000000000000000 P ea1cd6494c0b44adaba55aa880b1f31f [term 1 LEADER]: Becoming Leader. State: Replica: ea1cd6494c0b44adaba55aa880b1f31f, State: Running, Role: LEADER
I20260811 00:55:11.906771 17482 sys_catalog.cc:564] T 00000000000000000000000000000000 P ea1cd6494c0b44adaba55aa880b1f31f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:55:11.906809 17487 consensus_queue.cc:237] T 00000000000000000000000000000000 P ea1cd6494c0b44adaba55aa880b1f31f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea1cd6494c0b44adaba55aa880b1f31f" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 44985 } }
Aug 11 00:55:11 dist-test-slave-h3ft krb5kdc[17333](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409711, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:11.907255 17487 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea1cd6494c0b44adaba55aa880b1f31f [sys.catalog]: SysCatalogTable state changed. Reason: New leader ea1cd6494c0b44adaba55aa880b1f31f. Latest consensus state: current_term: 1 leader_uuid: "ea1cd6494c0b44adaba55aa880b1f31f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea1cd6494c0b44adaba55aa880b1f31f" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 44985 } } }
I20260811 00:55:11.907352 17487 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea1cd6494c0b44adaba55aa880b1f31f [sys.catalog]: This master's current role is: LEADER
I20260811 00:55:11.907294 17488 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea1cd6494c0b44adaba55aa880b1f31f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ea1cd6494c0b44adaba55aa880b1f31f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea1cd6494c0b44adaba55aa880b1f31f" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 44985 } } }
I20260811 00:55:11.907629 17488 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea1cd6494c0b44adaba55aa880b1f31f [sys.catalog]: This master's current role is: LEADER
W20260811 00:55:11.909586 17512 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ea1cd6494c0b44adaba55aa880b1f31f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 00:55:11.909679 17512 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 00:55:11.909742 17495 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:55:11.909967 17495 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:55:11.912312 17495 catalog_manager.cc:1347] Generated new cluster ID: fa12212d02fd4ddd8d8feb9d30c0dbe5
I20260811 00:55:11.912387 17495 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:55:11.912909 17485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:11.898648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60322 (local address 127.15.70.62:44985)
0811 00:55:11.898901 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:11.898912 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:11.898945 (+ 33us) server_negotiation.cc:407] Connection header received
0811 00:55:11.899677 (+ 732us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:11.899687 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:11.899751 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:11.899939 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:11.900792 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:11.901920 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:11.902833 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:11.903437 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:11.903763 (+ 326us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:11.907654 (+ 3891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:11.907661 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:11.907661 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:11.907679 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:11.910237 (+ 2558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:11.910821 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:11.910825 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:11.910825 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:11.911082 (+ 257us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:11.911532 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:11.911533 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:11.911534 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:11.911949 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:11.912176 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:11.912411 (+ 235us) server_negotiation.cc:299] Negotiation successful
0811 00:55:11.912631 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":116,"threads_started":1}
I20260811 00:55:11.937763 17495 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:55:11.938553 17495 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:55:11.948196 17495 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ea1cd6494c0b44adaba55aa880b1f31f: Generated new TSK 0
I20260811 00:55:11.948644 17495 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.70.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab.
Entry for principal kudu/127.15.70.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab.
I20260811 00:55:11.991060 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.1:0
--local_ip_for_outbound_sockets=127.15.70.1
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:44985
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:38147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:12.102276 17521 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:12.102653 17521 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:12.102712 17521 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:12.104286 17521 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:12.104393 17521 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:12.104435 17521 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 00:55:12.104470 17521 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.1
I20260811 00:55:12.106593 17521 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:38147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.70.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.70.62:44985
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17521
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.1
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:12.107048 17521 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:12.107422 17521 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:12.114450 17532 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:12.114468 17531 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:12.114450 17535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:12.115036 17521 server_base.cc:1034] running on GCE node
I20260811 00:55:12.115396 17521 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:12.115798 17521 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:12.117003 17521 hybrid_clock.cc:648] HybridClock initialized: now 1786409712116968 us; error 61 us; skew 500 ppm
Aug 11 00:55:12 dist-test-slave-h3ft krb5kdc[17333](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409712, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:12.121905 17521 init.cc:377] Logged in from keytab as kudu/127.15.70.1@KRBTEST.COM (short username kudu)
I20260811 00:55:12.122565 17521 webserver.cc:460] Webserver started at http://127.15.70.1:41275/ using document root <none> and password file <none>
I20260811 00:55:12.122906 17521 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:12.122988 17521 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:12.123224 17521 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:12.124557 17521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-0/data/instance:
uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b"
format_stamp: "Formatted at 2026-08-11 00:55:12 on dist-test-slave-h3ft"
server_key: "ca0f5dca255a770a34663d1c3b82b94a"
server_key_iv: "74c217ac3efee067629bab443aa38a24"
server_key_version: "encryptionkey@0"
I20260811 00:55:12.125018 17521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance:
uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b"
format_stamp: "Formatted at 2026-08-11 00:55:12 on dist-test-slave-h3ft"
server_key: "ca0f5dca255a770a34663d1c3b82b94a"
server_key_iv: "74c217ac3efee067629bab443aa38a24"
server_key_version: "encryptionkey@0"
I20260811 00:55:12.127586 17521 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260811 00:55:12.131138 17544 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:12.131414 17521 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 00:55:12.131552 17521 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-0/wal
uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b"
format_stamp: "Formatted at 2026-08-11 00:55:12 on dist-test-slave-h3ft"
server_key: "ca0f5dca255a770a34663d1c3b82b94a"
server_key_iv: "74c217ac3efee067629bab443aa38a24"
server_key_version: "encryptionkey@0"
I20260811 00:55:12.131681 17521 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:12.156248 17521 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:12.159459 17521 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:12.159706 17521 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:12.160477 17521 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:55:12.160553 17521 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:12.160595 17521 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:55:12.160625 17521 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:12.170954 17724 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.1:44883 every 8 connection(s)
I20260811 00:55:12.170871 17521 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.1:44883
Aug 11 00:55:12 dist-test-slave-h3ft krb5kdc[17333](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409712, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:12.171530 17521 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
I20260811 00:55:12.171866 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 17521
I20260811 00:55:12.171986 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance
I20260811 00:55:12.172240 15640 external_mini_cluster.cc:1428] Setting key e02577e00f705d201e4c173611a89360
I20260811 00:55:12.176549 17485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:12.161413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:48325 (local address 127.15.70.62:44985)
0811 00:55:12.161510 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:12.161514 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:12.161838 (+ 324us) server_negotiation.cc:407] Connection header received
0811 00:55:12.162673 (+ 835us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:12.162675 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:12.162694 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:12.162794 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:12.164336 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.165364 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.167580 (+ 2216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.167838 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.167908 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:12.172304 (+ 4396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:12.172307 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:12.172307 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:12.172322 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:12.174536 (+ 2214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:12.175069 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:12.175071 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:12.175071 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:12.175154 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:12.175616 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:12.175618 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:12.175618 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:12.175788 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:12.175844 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:12.176337 (+ 493us) server_negotiation.cc:299] Negotiation successful
0811 00:55:12.176454 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 00:55:12.176905 17564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:12.161389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:44985 (local address 127.15.70.1:48325)
0811 00:55:12.161673 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:12.161729 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:12.162541 (+ 812us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:12.162939 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:12.162947 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:12.163724 (+ 777us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:12.164145 (+ 421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:12.164156 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.165508 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.165510 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:12.167373 (+ 1863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:12.167381 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.167949 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.167951 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:12.168159 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:12.169224 (+ 1065us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:12.169243 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:12.172138 (+ 2895us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:12.174648 (+ 2510us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:12.174655 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:12.174658 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:12.174944 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:12.175250 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:12.175251 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:12.175251 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:12.175499 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:12.175863 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:12.175872 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:12.176128 (+ 256us) client_negotiation.cc:769] Sending connection context
0811 00:55:12.176277 (+ 149us) client_negotiation.cc:240] Negotiation successful
0811 00:55:12.176554 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":192,"threads_started":1}
I20260811 00:55:12.177706 17725 heartbeater.cc:347] Connected to a master server at 127.15.70.62:44985
I20260811 00:55:12.177835 17725 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:12.178088 17725 heartbeater.cc:511] Master 127.15.70.62:44985 requested a full tablet report, sending...
I20260811 00:55:12.178927 17404 ts_manager.cc:194] Registered new tserver with Master: 0d64e51f4c7b4a0eb633ce45f85f2d2b (127.15.70.1:44883)
I20260811 00:55:12.179917 17404 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.1@KRBTEST.COM'} at 127.15.70.1:48325
WARNING: no policy specified for kudu/127.15.70.2@KRBTEST.COM; defaulting to no policy
I20260811 00:55:12.188653 17485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:12.179447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:43703 (local address 127.15.70.62:44985)
0811 00:55:12.179498 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:12.179500 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:12.180400 (+ 900us) server_negotiation.cc:407] Connection header received
0811 00:55:12.180466 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:12.180468 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:12.180482 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:12.180545 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:12.181047 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.181921 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.182876 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.183230 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.183312 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:12.184734 (+ 1422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:12.184735 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:12.184736 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:12.184746 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:12.186809 (+ 2063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:12.187454 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:12.187456 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:12.187457 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:12.187594 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:12.187920 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:12.187921 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:12.187922 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:12.188154 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:12.188241 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:12.188452 (+ 211us) server_negotiation.cc:299] Negotiation successful
0811 00:55:12.188558 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 00:55:12.188681 17734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:12.179381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:44985 (local address 127.15.70.1:43703)
0811 00:55:12.180300 (+ 919us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:12.180315 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:12.180404 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:12.180565 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:12.180566 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:12.180842 (+ 276us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:12.180948 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:12.180952 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.182088 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.182089 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:12.182764 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:12.182767 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.183325 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.183327 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:12.183422 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:12.184140 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:12.184146 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:12.184546 (+ 400us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:12.186964 (+ 2418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:12.186966 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:12.186967 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:12.187349 (+ 382us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:12.187688 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:12.187690 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:12.187690 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:12.187802 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:12.188273 (+ 471us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:12.188274 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:12.188336 (+ 62us) client_negotiation.cc:769] Sending connection context
0811 00:55:12.188421 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 00:55:12.188556 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":885,"thread_start_us":97,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab.
Entry for principal kudu/127.15.70.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab.
I20260811 00:55:12.216682 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.2:0
--local_ip_for_outbound_sockets=127.15.70.2
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:44985
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:38147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:12.335332 17741 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:12.335779 17741 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:12.335817 17741 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:12.337482 17741 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:12.337565 17741 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:12.337592 17741 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 00:55:12.337612 17741 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.2
I20260811 00:55:12.339663 17741 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:38147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.70.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.70.62:44985
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17741
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.2
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:12.340010 17741 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:12.340363 17741 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:12.347218 17751 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:12.347132 17747 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:12.347235 17741 server_base.cc:1034] running on GCE node
W20260811 00:55:12.347132 17746 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:12.347729 17741 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:12.348086 17741 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:12.349303 17741 hybrid_clock.cc:648] HybridClock initialized: now 1786409712349262 us; error 62 us; skew 500 ppm
Aug 11 00:55:12 dist-test-slave-h3ft krb5kdc[17333](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409712, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:12.353116 17741 init.cc:377] Logged in from keytab as kudu/127.15.70.2@KRBTEST.COM (short username kudu)
I20260811 00:55:12.353700 17741 webserver.cc:460] Webserver started at http://127.15.70.2:36781/ using document root <none> and password file <none>
I20260811 00:55:12.354017 17741 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:12.354075 17741 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:12.354247 17741 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:12.355749 17741 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-1/data/instance:
uuid: "78966f88c7e0455d84f06aa75badf743"
format_stamp: "Formatted at 2026-08-11 00:55:12 on dist-test-slave-h3ft"
server_key: "836980f742754f02dfd47720e26b281c"
server_key_iv: "42f69a0a9240573770031baee9b90017"
server_key_version: "encryptionkey@0"
I20260811 00:55:12.356288 17741 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance:
uuid: "78966f88c7e0455d84f06aa75badf743"
format_stamp: "Formatted at 2026-08-11 00:55:12 on dist-test-slave-h3ft"
server_key: "836980f742754f02dfd47720e26b281c"
server_key_iv: "42f69a0a9240573770031baee9b90017"
server_key_version: "encryptionkey@0"
I20260811 00:55:12.358398 17741 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 00:55:12.359753 17761 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:12.360080 17741 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:12.360221 17741 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-1/wal
uuid: "78966f88c7e0455d84f06aa75badf743"
format_stamp: "Formatted at 2026-08-11 00:55:12 on dist-test-slave-h3ft"
server_key: "836980f742754f02dfd47720e26b281c"
server_key_iv: "42f69a0a9240573770031baee9b90017"
server_key_version: "encryptionkey@0"
I20260811 00:55:12.360337 17741 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:12.373805 17741 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:12.376986 17741 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:12.377291 17741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:12.378064 17741 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:55:12.378132 17741 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:12.378175 17741 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:55:12.378222 17741 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 00:55:12 dist-test-slave-h3ft krb5kdc[17333](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409712, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:12.387598 17741 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.2:37553
I20260811 00:55:12.387871 17941 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.2:37553 every 8 connection(s)
I20260811 00:55:12.388120 17741 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
I20260811 00:55:12.390792 17485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:12.378588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:55641 (local address 127.15.70.62:44985)
0811 00:55:12.378641 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:12.378644 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:12.378970 (+ 326us) server_negotiation.cc:407] Connection header received
0811 00:55:12.379674 (+ 704us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:12.379676 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:12.379693 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:12.379750 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:12.380869 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.381792 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.383556 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.383786 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.383879 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:12.387188 (+ 3309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:12.387190 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:12.387190 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:12.387202 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:12.389200 (+ 1998us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:12.389684 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:12.389685 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:12.389686 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:12.389761 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:12.390040 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:12.390048 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:12.390048 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:12.390194 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:12.390270 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:12.390587 (+ 317us) server_negotiation.cc:299] Negotiation successful
0811 00:55:12.390682 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 00:55:12.391059 17774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:12.378581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:44985 (local address 127.15.70.2:55641)
0811 00:55:12.378765 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:12.378808 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:12.379529 (+ 721us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:12.379832 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:12.379837 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:12.380340 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:12.380763 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:12.380774 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.381890 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.381891 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:12.383452 (+ 1561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:12.383456 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.383918 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.383919 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:12.384070 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:12.384754 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:12.384765 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:12.387030 (+ 2265us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:12.389315 (+ 2285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:12.389323 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:12.389325 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:12.389589 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:12.389842 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:12.389842 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:12.389843 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:12.389964 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:12.390270 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:12.390278 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:12.390443 (+ 165us) client_negotiation.cc:769] Sending connection context
0811 00:55:12.390559 (+ 116us) client_negotiation.cc:240] Negotiation successful
0811 00:55:12.390757 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":96,"threads_started":1}
I20260811 00:55:12.391683 17942 heartbeater.cc:347] Connected to a master server at 127.15.70.62:44985
I20260811 00:55:12.391791 17942 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:12.392071 17942 heartbeater.cc:511] Master 127.15.70.62:44985 requested a full tablet report, sending...
I20260811 00:55:12.392568 17403 ts_manager.cc:194] Registered new tserver with Master: 78966f88c7e0455d84f06aa75badf743 (127.15.70.2:37553)
I20260811 00:55:12.393151 17403 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.2@KRBTEST.COM'} at 127.15.70.2:55641
I20260811 00:55:12.396764 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 17741
I20260811 00:55:12.396919 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance
I20260811 00:55:12.397262 15640 external_mini_cluster.cc:1428] Setting key a943aadd685f6528f5fe5d0ac8410236
I20260811 00:55:12.400086 17485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:12.393024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:53653 (local address 127.15.70.62:44985)
0811 00:55:12.393087 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:12.393089 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:12.393227 (+ 138us) server_negotiation.cc:407] Connection header received
0811 00:55:12.393273 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:12.393274 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:12.393286 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:12.393345 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:12.393778 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.394445 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.395238 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.395461 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.395522 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:12.396749 (+ 1227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:12.396751 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:12.396751 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:12.396760 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:12.398596 (+ 1836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:12.399034 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:12.399036 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:12.399036 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:12.399114 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:12.399373 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:12.399374 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:12.399375 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:12.399588 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:12.399680 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:12.399860 (+ 180us) server_negotiation.cc:299] Negotiation successful
0811 00:55:12.399963 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 00:55:12.400099 17950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:12.392962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:44985 (local address 127.15.70.2:53653)
0811 00:55:12.393129 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:12.393142 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:12.393216 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:12.393365 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:12.393366 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:12.393589 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:12.393701 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:12.393703 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.394547 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.394548 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:12.395160 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:12.395163 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.395535 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.395536 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:12.395613 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:12.396278 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:12.396283 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:12.396646 (+ 363us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:12.398708 (+ 2062us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:12.398710 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:12.398710 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:12.398923 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:12.399220 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:12.399221 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:12.399221 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:12.399297 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:12.399668 (+ 371us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:12.399669 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:12.399733 (+ 64us) client_negotiation.cc:769] Sending connection context
0811 00:55:12.399819 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 00:55:12.399962 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"mutex_wait_us":2,"thread_start_us":108,"threads_started":1}
WARNING: no policy specified for kudu/127.15.70.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab.
Entry for principal kudu/127.15.70.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab.
I20260811 00:55:12.434844 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.3:0
--local_ip_for_outbound_sockets=127.15.70.3
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:44985
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:38147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:12.563059 17955 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:12.563411 17955 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:12.563462 17955 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:12.565011 17955 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:12.565104 17955 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:12.565141 17955 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 00:55:12.565182 17955 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.3
I20260811 00:55:12.567104 17955 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:38147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.70.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.70.62:44985
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17955
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.3
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:12.567487 17955 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:12.567798 17955 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:12.574621 17967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:12.574654 17962 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:12.574920 17955 server_base.cc:1034] running on GCE node
W20260811 00:55:12.574652 17963 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:12.575327 17955 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:12.575659 17955 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:12.576869 17955 hybrid_clock.cc:648] HybridClock initialized: now 1786409712576851 us; error 52 us; skew 500 ppm
Aug 11 00:55:12 dist-test-slave-h3ft krb5kdc[17333](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409712, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:12.580823 17955 init.cc:377] Logged in from keytab as kudu/127.15.70.3@KRBTEST.COM (short username kudu)
I20260811 00:55:12.581516 17955 webserver.cc:460] Webserver started at http://127.15.70.3:42379/ using document root <none> and password file <none>
I20260811 00:55:12.581847 17955 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:12.581935 17955 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:12.582139 17955 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:12.583658 17955 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-2/data/instance:
uuid: "9a3dbec47c664435b2e96cb12b681b26"
format_stamp: "Formatted at 2026-08-11 00:55:12 on dist-test-slave-h3ft"
server_key: "af0280ff9e1e64c381d08123ac7b511a"
server_key_iv: "9c76c75f222b5806ff4ea1796934c2e0"
server_key_version: "encryptionkey@0"
I20260811 00:55:12.584118 17955 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance:
uuid: "9a3dbec47c664435b2e96cb12b681b26"
format_stamp: "Formatted at 2026-08-11 00:55:12 on dist-test-slave-h3ft"
server_key: "af0280ff9e1e64c381d08123ac7b511a"
server_key_iv: "9c76c75f222b5806ff4ea1796934c2e0"
server_key_version: "encryptionkey@0"
I20260811 00:55:12.586078 17955 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 00:55:12.587128 17977 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:12.587347 17955 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:12.587486 17955 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-2/wal
uuid: "9a3dbec47c664435b2e96cb12b681b26"
format_stamp: "Formatted at 2026-08-11 00:55:12 on dist-test-slave-h3ft"
server_key: "af0280ff9e1e64c381d08123ac7b511a"
server_key_iv: "9c76c75f222b5806ff4ea1796934c2e0"
server_key_version: "encryptionkey@0"
I20260811 00:55:12.587581 17955 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:12.602444 17955 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:12.605520 17955 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:12.605752 17955 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:12.606725 17955 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:55:12.606813 17955 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:12.606858 17955 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:55:12.606879 17955 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 00:55:12 dist-test-slave-h3ft krb5kdc[17333](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409712, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:12.617008 17955 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.3:39075
I20260811 00:55:12.617089 18158 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.3:39075 every 8 connection(s)
I20260811 00:55:12.617581 17955 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
I20260811 00:55:12.620898 17485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:12.607438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:50861 (local address 127.15.70.62:44985)
0811 00:55:12.607552 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:12.607556 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:12.607807 (+ 251us) server_negotiation.cc:407] Connection header received
0811 00:55:12.608739 (+ 932us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:12.608742 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:12.608762 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:12.608863 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:12.610034 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.611138 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.613351 (+ 2213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.613601 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.613720 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:12.616639 (+ 2919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:12.616641 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:12.616642 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:12.616653 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:12.618993 (+ 2340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:12.619622 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:12.619624 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:12.619624 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:12.619712 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:12.620034 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:12.620036 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:12.620036 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:12.620209 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:12.620294 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:12.620653 (+ 359us) server_negotiation.cc:299] Negotiation successful
0811 00:55:12.620766 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 00:55:12.621181 17992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:12.607387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:44985 (local address 127.15.70.3:50861)
0811 00:55:12.607598 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:12.607660 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:12.608604 (+ 944us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:12.609062 (+ 458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:12.609068 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:12.609533 (+ 465us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:12.609880 (+ 347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:12.609889 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.611345 (+ 1456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.611346 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:12.613219 (+ 1873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:12.613225 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.613746 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.613748 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:12.613907 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:12.614657 (+ 750us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:12.614668 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:12.616472 (+ 1804us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:12.619180 (+ 2708us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:12.619190 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:12.619193 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:12.619506 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:12.619798 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:12.619799 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:12.619799 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:12.619946 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:12.620293 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:12.620303 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:12.620489 (+ 186us) client_negotiation.cc:769] Sending connection context
0811 00:55:12.620622 (+ 133us) client_negotiation.cc:240] Negotiation successful
0811 00:55:12.620860 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":119,"threads_started":1}
I20260811 00:55:12.621659 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 17955
I20260811 00:55:12.621785 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance
I20260811 00:55:12.621924 18159 heartbeater.cc:347] Connected to a master server at 127.15.70.62:44985
I20260811 00:55:12.622035 18159 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:12.622062 15640 external_mini_cluster.cc:1428] Setting key 8528aad5b4344ee9abfaab0986517b30
I20260811 00:55:12.622314 18159 heartbeater.cc:511] Master 127.15.70.62:44985 requested a full tablet report, sending...
I20260811 00:55:12.622813 17403 ts_manager.cc:194] Registered new tserver with Master: 9a3dbec47c664435b2e96cb12b681b26 (127.15.70.3:39075)
I20260811 00:55:12.623409 15640 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 00:55:12.623481 17403 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.3@KRBTEST.COM'} at 127.15.70.3:50861
I20260811 00:55:12.632615 17485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:12.623584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:51275 (local address 127.15.70.62:44985)
0811 00:55:12.623638 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:12.623641 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:12.623862 (+ 221us) server_negotiation.cc:407] Connection header received
0811 00:55:12.624537 (+ 675us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:12.624538 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:12.624552 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:12.624618 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:12.625138 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.625716 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.626854 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.627211 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.627293 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:12.628689 (+ 1396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:12.628691 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:12.628691 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:12.628701 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:12.630996 (+ 2295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:12.631468 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:12.631469 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:12.631470 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:12.631557 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:12.631832 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:12.631834 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:12.631834 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:12.632034 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:12.632119 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:12.632404 (+ 285us) server_negotiation.cc:299] Negotiation successful
0811 00:55:12.632510 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 00:55:12.633139 18168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:12.623597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:44985 (local address 127.15.70.3:51275)
0811 00:55:12.623760 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:12.623774 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:12.624435 (+ 661us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:12.624626 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:12.624627 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:12.624952 (+ 325us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:12.625040 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:12.625043 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.625832 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.625833 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:12.626722 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:12.626725 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.627307 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.627308 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:12.627424 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:12.628162 (+ 738us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:12.628174 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:12.628604 (+ 430us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:12.631148 (+ 2544us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:12.631149 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:12.631150 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:12.631364 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:12.631662 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:12.631663 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:12.631663 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:12.631744 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:12.632123 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:12.632124 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:12.632250 (+ 126us) client_negotiation.cc:769] Sending connection context
0811 00:55:12.632333 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 00:55:12.632530 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":99,"threads_started":1}
Aug 11 00:55:12 dist-test-slave-h3ft krb5kdc[17333](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409712, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 00:55:12 dist-test-slave-h3ft krb5kdc[17333](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409712, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:12.658329 17485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:12.649405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60334 (local address 127.15.70.62:44985)
0811 00:55:12.649474 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:12.649476 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:12.649485 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:55:12.649517 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:12.649518 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:12.649529 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:12.649603 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:12.650337 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.650911 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.651768 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.651986 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.652083 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:12.654969 (+ 2886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:12.654972 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:12.654972 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:12.654982 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:12.656727 (+ 1745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:12.657264 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:12.657266 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:12.657267 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:12.657347 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:12.657610 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:12.657612 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:12.657612 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:12.657779 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:12.657916 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:12.658078 (+ 162us) server_negotiation.cc:299] Negotiation successful
0811 00:55:12.658191 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 00:55:12.660689 17403 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60334:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:55:12.662803 17403 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:55:12.671183 18188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:12.666407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:39075 (local address 127.0.0.1:43424)
0811 00:55:12.666634 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:12.666676 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:12.666763 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:12.667228 (+ 465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:12.667229 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:12.667233 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:12.667359 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:12.667361 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.668769 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.668770 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:12.669705 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:12.669708 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.670733 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.670734 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:12.670833 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:12.670851 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 00:55:12.670933 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 00:55:12.671083 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"mutex_wait_us":28,"thread_start_us":94,"threads_started":1}
I20260811 00:55:12.671211 18190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:12.666327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58976 (local address 127.15.70.2:37553)
0811 00:55:12.666991 (+ 664us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:12.666997 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:12.667009 (+ 12us) server_negotiation.cc:407] Connection header received
0811 00:55:12.667080 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:12.667083 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:12.667100 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:12.667179 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:12.667425 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.668247 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.669830 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.670642 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.670737 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:12.670806 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:12.670997 (+ 191us) server_negotiation.cc:299] Negotiation successful
0811 00:55:12.671074 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":614,"thread_start_us":100,"threads_started":1}
I20260811 00:55:12.671345 18192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:12.666573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43424 (local address 127.15.70.3:39075)
0811 00:55:12.667044 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:12.667056 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:12.667066 (+ 10us) server_negotiation.cc:407] Connection header received
0811 00:55:12.667112 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:12.667114 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:12.667131 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:12.667432 (+ 301us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:12.667510 (+ 78us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.668666 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.669811 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.670643 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.670726 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:12.670799 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:12.670985 (+ 186us) server_negotiation.cc:299] Negotiation successful
0811 00:55:12.671058 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":118,"threads_started":1}
I20260811 00:55:12.671496 18186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:12.666163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:44883 (local address 127.0.0.1:56444)
0811 00:55:12.666616 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:12.666675 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:12.666763 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:12.667223 (+ 460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:12.667227 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:12.667230 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:12.667369 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:12.667370 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.668716 (+ 1346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.668717 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:12.669823 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:12.669825 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.671223 (+ 1398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.671224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:12.671289 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:12.671293 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:55:12.671357 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 00:55:12.671407 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":426,"mutex_wait_us":11,"thread_start_us":100,"threads_started":1}
I20260811 00:55:12.671578 18189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:12.666311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56444 (local address 127.15.70.1:44883)
0811 00:55:12.666875 (+ 564us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:12.666881 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:12.666893 (+ 12us) server_negotiation.cc:407] Connection header received
0811 00:55:12.666950 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:12.666953 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:12.666972 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:12.667126 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:12.667461 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.668620 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.669895 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.670652 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.670726 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:12.670799 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:12.671411 (+ 612us) server_negotiation.cc:299] Negotiation successful
0811 00:55:12.671472 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":515,"thread_start_us":103,"threads_started":1}
I20260811 00:55:12.671183 18191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:12.666163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.2:37553 (local address 127.0.0.1:58976)
0811 00:55:12.666616 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:12.666675 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:12.666763 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:12.667270 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:12.667272 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:12.667274 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:12.667342 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:12.667344 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.668346 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.668347 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:12.669722 (+ 1375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:12.669725 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.670843 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.670844 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:12.670902 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:12.670906 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:55:12.670960 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 00:55:12.671059 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":382,"mutex_wait_us":36,"thread_start_us":75,"threads_started":1}
I20260811 00:55:12.672490 18059 tablet_service.cc:1467] Processing CreateTablet for tablet 8b40e67bb60c4587b7d428ea4c108700 (DEFAULT_TABLE table=test-table [id=9fcd1f1d9c744d958074ddf866e4cdeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:55:12.672490 17626 tablet_service.cc:1467] Processing CreateTablet for tablet 8b40e67bb60c4587b7d428ea4c108700 (DEFAULT_TABLE table=test-table [id=9fcd1f1d9c744d958074ddf866e4cdeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:55:12.672641 17844 tablet_service.cc:1467] Processing CreateTablet for tablet 8b40e67bb60c4587b7d428ea4c108700 (DEFAULT_TABLE table=test-table [id=9fcd1f1d9c744d958074ddf866e4cdeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:55:12.672988 17626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b40e67bb60c4587b7d428ea4c108700. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:12.672988 18059 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b40e67bb60c4587b7d428ea4c108700. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:12.673066 17844 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b40e67bb60c4587b7d428ea4c108700. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:12.676780 18195 tablet_bootstrap.cc:492] T 8b40e67bb60c4587b7d428ea4c108700 P 78966f88c7e0455d84f06aa75badf743: Bootstrap starting.
I20260811 00:55:12.677027 18196 tablet_bootstrap.cc:492] T 8b40e67bb60c4587b7d428ea4c108700 P 9a3dbec47c664435b2e96cb12b681b26: Bootstrap starting.
I20260811 00:55:12.677225 18198 tablet_bootstrap.cc:492] T 8b40e67bb60c4587b7d428ea4c108700 P 0d64e51f4c7b4a0eb633ce45f85f2d2b: Bootstrap starting.
I20260811 00:55:12.677749 18195 tablet_bootstrap.cc:654] T 8b40e67bb60c4587b7d428ea4c108700 P 78966f88c7e0455d84f06aa75badf743: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:12.678228 18195 log.cc:824] T 8b40e67bb60c4587b7d428ea4c108700 P 78966f88c7e0455d84f06aa75badf743: Log is configured to *not* fsync() on all Append() calls
I20260811 00:55:12.678345 18196 tablet_bootstrap.cc:654] T 8b40e67bb60c4587b7d428ea4c108700 P 9a3dbec47c664435b2e96cb12b681b26: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:12.678788 18198 tablet_bootstrap.cc:654] T 8b40e67bb60c4587b7d428ea4c108700 P 0d64e51f4c7b4a0eb633ce45f85f2d2b: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:12.678788 18196 log.cc:824] T 8b40e67bb60c4587b7d428ea4c108700 P 9a3dbec47c664435b2e96cb12b681b26: Log is configured to *not* fsync() on all Append() calls
I20260811 00:55:12.679246 18198 log.cc:824] T 8b40e67bb60c4587b7d428ea4c108700 P 0d64e51f4c7b4a0eb633ce45f85f2d2b: Log is configured to *not* fsync() on all Append() calls
I20260811 00:55:12.679381 18195 tablet_bootstrap.cc:492] T 8b40e67bb60c4587b7d428ea4c108700 P 78966f88c7e0455d84f06aa75badf743: No bootstrap required, opened a new log
I20260811 00:55:12.679455 18195 ts_tablet_manager.cc:1397] T 8b40e67bb60c4587b7d428ea4c108700 P 78966f88c7e0455d84f06aa75badf743: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 00:55:12.680615 18196 tablet_bootstrap.cc:492] T 8b40e67bb60c4587b7d428ea4c108700 P 9a3dbec47c664435b2e96cb12b681b26: No bootstrap required, opened a new log
I20260811 00:55:12.680709 18196 ts_tablet_manager.cc:1397] T 8b40e67bb60c4587b7d428ea4c108700 P 9a3dbec47c664435b2e96cb12b681b26: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20260811 00:55:12.681735 18195 raft_consensus.cc:348] T 8b40e67bb60c4587b7d428ea4c108700 P 78966f88c7e0455d84f06aa75badf743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 44883 } } peers { permanent_uuid: "78966f88c7e0455d84f06aa75badf743" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 37553 } } peers { permanent_uuid: "9a3dbec47c664435b2e96cb12b681b26" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 39075 } }
I20260811 00:55:12.681936 18195 raft_consensus.cc:374] T 8b40e67bb60c4587b7d428ea4c108700 P 78966f88c7e0455d84f06aa75badf743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:12.681977 18195 raft_consensus.cc:729] T 8b40e67bb60c4587b7d428ea4c108700 P 78966f88c7e0455d84f06aa75badf743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78966f88c7e0455d84f06aa75badf743, State: Initialized, Role: FOLLOWER
I20260811 00:55:12.682114 18195 consensus_queue.cc:260] T 8b40e67bb60c4587b7d428ea4c108700 P 78966f88c7e0455d84f06aa75badf743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 44883 } } peers { permanent_uuid: "78966f88c7e0455d84f06aa75badf743" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 37553 } } peers { permanent_uuid: "9a3dbec47c664435b2e96cb12b681b26" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 39075 } }
I20260811 00:55:12.682479 18195 ts_tablet_manager.cc:1428] T 8b40e67bb60c4587b7d428ea4c108700 P 78966f88c7e0455d84f06aa75badf743: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 00:55:12.682581 17942 heartbeater.cc:503] Master 127.15.70.62:44985 was elected leader, sending a full tablet report...
I20260811 00:55:12.683357 18196 raft_consensus.cc:348] T 8b40e67bb60c4587b7d428ea4c108700 P 9a3dbec47c664435b2e96cb12b681b26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 44883 } } peers { permanent_uuid: "78966f88c7e0455d84f06aa75badf743" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 37553 } } peers { permanent_uuid: "9a3dbec47c664435b2e96cb12b681b26" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 39075 } }
I20260811 00:55:12.683537 18196 raft_consensus.cc:374] T 8b40e67bb60c4587b7d428ea4c108700 P 9a3dbec47c664435b2e96cb12b681b26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:12.683588 18196 raft_consensus.cc:729] T 8b40e67bb60c4587b7d428ea4c108700 P 9a3dbec47c664435b2e96cb12b681b26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a3dbec47c664435b2e96cb12b681b26, State: Initialized, Role: FOLLOWER
I20260811 00:55:12.683776 18198 tablet_bootstrap.cc:492] T 8b40e67bb60c4587b7d428ea4c108700 P 0d64e51f4c7b4a0eb633ce45f85f2d2b: No bootstrap required, opened a new log
I20260811 00:55:12.683748 18196 consensus_queue.cc:260] T 8b40e67bb60c4587b7d428ea4c108700 P 9a3dbec47c664435b2e96cb12b681b26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 44883 } } peers { permanent_uuid: "78966f88c7e0455d84f06aa75badf743" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 37553 } } peers { permanent_uuid: "9a3dbec47c664435b2e96cb12b681b26" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 39075 } }
I20260811 00:55:12.683887 18198 ts_tablet_manager.cc:1397] T 8b40e67bb60c4587b7d428ea4c108700 P 0d64e51f4c7b4a0eb633ce45f85f2d2b: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260811 00:55:12.684103 18196 ts_tablet_manager.cc:1428] T 8b40e67bb60c4587b7d428ea4c108700 P 9a3dbec47c664435b2e96cb12b681b26: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260811 00:55:12.684140 18159 heartbeater.cc:503] Master 127.15.70.62:44985 was elected leader, sending a full tablet report...
I20260811 00:55:12.686161 18198 raft_consensus.cc:348] T 8b40e67bb60c4587b7d428ea4c108700 P 0d64e51f4c7b4a0eb633ce45f85f2d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 44883 } } peers { permanent_uuid: "78966f88c7e0455d84f06aa75badf743" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 37553 } } peers { permanent_uuid: "9a3dbec47c664435b2e96cb12b681b26" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 39075 } }
I20260811 00:55:12.686367 18198 raft_consensus.cc:374] T 8b40e67bb60c4587b7d428ea4c108700 P 0d64e51f4c7b4a0eb633ce45f85f2d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:12.686421 18198 raft_consensus.cc:729] T 8b40e67bb60c4587b7d428ea4c108700 P 0d64e51f4c7b4a0eb633ce45f85f2d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d64e51f4c7b4a0eb633ce45f85f2d2b, State: Initialized, Role: FOLLOWER
I20260811 00:55:12.686571 18198 consensus_queue.cc:260] T 8b40e67bb60c4587b7d428ea4c108700 P 0d64e51f4c7b4a0eb633ce45f85f2d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 44883 } } peers { permanent_uuid: "78966f88c7e0455d84f06aa75badf743" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 37553 } } peers { permanent_uuid: "9a3dbec47c664435b2e96cb12b681b26" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 39075 } }
I20260811 00:55:12.686887 18198 ts_tablet_manager.cc:1428] T 8b40e67bb60c4587b7d428ea4c108700 P 0d64e51f4c7b4a0eb633ce45f85f2d2b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 00:55:12.687054 17725 heartbeater.cc:503] Master 127.15.70.62:44985 was elected leader, sending a full tablet report...
W20260811 00:55:12.868824 18161 tablet.cc:2369] T 8b40e67bb60c4587b7d428ea4c108700 P 9a3dbec47c664435b2e96cb12b681b26: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 00:55:12.889160 17943 tablet.cc:2369] T 8b40e67bb60c4587b7d428ea4c108700 P 78966f88c7e0455d84f06aa75badf743: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 00:55:12.923759 17726 tablet.cc:2369] T 8b40e67bb60c4587b7d428ea4c108700 P 0d64e51f4c7b4a0eb633ce45f85f2d2b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 00:55:12.992751 18210 raft_consensus.cc:482] T 8b40e67bb60c4587b7d428ea4c108700 P 0d64e51f4c7b4a0eb633ce45f85f2d2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:55:12.993079 18210 raft_consensus.cc:504] T 8b40e67bb60c4587b7d428ea4c108700 P 0d64e51f4c7b4a0eb633ce45f85f2d2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 44883 } } peers { permanent_uuid: "78966f88c7e0455d84f06aa75badf743" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 37553 } } peers { permanent_uuid: "9a3dbec47c664435b2e96cb12b681b26" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 39075 } }
I20260811 00:55:12.993628 18210 leader_election.cc:288] T 8b40e67bb60c4587b7d428ea4c108700 P 0d64e51f4c7b4a0eb633ce45f85f2d2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78966f88c7e0455d84f06aa75badf743 (127.15.70.2:37553), 9a3dbec47c664435b2e96cb12b681b26 (127.15.70.3:39075)
I20260811 00:55:12.998564 18192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:12.994077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:34305 (local address 127.15.70.3:39075)
0811 00:55:12.994133 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:12.994157 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:12.994291 (+ 134us) server_negotiation.cc:407] Connection header received
0811 00:55:12.994330 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:12.994331 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:12.994346 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:12.994417 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:12.994665 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.995541 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.997417 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.998144 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.998216 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:12.998228 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:12.998396 (+ 168us) server_negotiation.cc:299] Negotiation successful
0811 00:55:12.998466 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 00:55:12.998579 18190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:12.994050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:39141 (local address 127.15.70.2:37553)
0811 00:55:12.994111 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:12.994114 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:12.994194 (+ 80us) server_negotiation.cc:407] Connection header received
0811 00:55:12.994322 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:12.994324 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:12.994343 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:12.994417 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:12.994664 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.995550 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.997415 (+ 1865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.998044 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.998133 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:12.998153 (+ 20us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:12.998396 (+ 243us) server_negotiation.cc:299] Negotiation successful
0811 00:55:12.998507 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 00:55:12.998622 18211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:12.993940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:39075 (local address 127.15.70.1:34305)
0811 00:55:12.994196 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:12.994208 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:12.994278 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:12.994439 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:12.994440 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:12.994442 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:12.994578 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:12.994580 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.995704 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.995706 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:12.997275 (+ 1569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:12.997280 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.998235 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.998235 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:12.998302 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:12.998306 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:55:12.998362 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 00:55:12.998437 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"mutex_wait_us":130,"thread_start_us":83,"threads_started":1}
I20260811 00:55:12.998622 18212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:12.993910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.2:37553 (local address 127.15.70.1:39141)
0811 00:55:12.994107 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:12.994121 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:12.994218 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:12.994440 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:12.994440 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:12.994450 (+ 10us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:12.994576 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:12.994579 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.995704 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.995706 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:12.997275 (+ 1569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:12.997280 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:12.998169 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:12.998170 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:12.998273 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:12.998280 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 00:55:12.998353 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 00:55:12.998437 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"mutex_wait_us":94,"thread_start_us":90,"threads_started":1}
I20260811 00:55:12.999449 18085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b40e67bb60c4587b7d428ea4c108700" candidate_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a3dbec47c664435b2e96cb12b681b26" is_pre_election: true
I20260811 00:55:12.999447 17873 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b40e67bb60c4587b7d428ea4c108700" candidate_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78966f88c7e0455d84f06aa75badf743" is_pre_election: true
I20260811 00:55:12.999688 18085 raft_consensus.cc:2454] T 8b40e67bb60c4587b7d428ea4c108700 P 9a3dbec47c664435b2e96cb12b681b26 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d64e51f4c7b4a0eb633ce45f85f2d2b in term 0.
I20260811 00:55:12.999701 17873 raft_consensus.cc:2454] T 8b40e67bb60c4587b7d428ea4c108700 P 78966f88c7e0455d84f06aa75badf743 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d64e51f4c7b4a0eb633ce45f85f2d2b in term 0.
I20260811 00:55:13.000013 17547 leader_election.cc:302] T 8b40e67bb60c4587b7d428ea4c108700 P 0d64e51f4c7b4a0eb633ce45f85f2d2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d64e51f4c7b4a0eb633ce45f85f2d2b, 78966f88c7e0455d84f06aa75badf743; no voters:
I20260811 00:55:13.000234 18210 raft_consensus.cc:2781] T 8b40e67bb60c4587b7d428ea4c108700 P 0d64e51f4c7b4a0eb633ce45f85f2d2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:55:13.000360 18210 raft_consensus.cc:482] T 8b40e67bb60c4587b7d428ea4c108700 P 0d64e51f4c7b4a0eb633ce45f85f2d2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:55:13.000413 18210 raft_consensus.cc:3037] T 8b40e67bb60c4587b7d428ea4c108700 P 0d64e51f4c7b4a0eb633ce45f85f2d2b [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:13.001573 18210 raft_consensus.cc:504] T 8b40e67bb60c4587b7d428ea4c108700 P 0d64e51f4c7b4a0eb633ce45f85f2d2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 44883 } } peers { permanent_uuid: "78966f88c7e0455d84f06aa75badf743" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 37553 } } peers { permanent_uuid: "9a3dbec47c664435b2e96cb12b681b26" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 39075 } }
I20260811 00:55:13.001799 18210 leader_election.cc:288] T 8b40e67bb60c4587b7d428ea4c108700 P 0d64e51f4c7b4a0eb633ce45f85f2d2b [CANDIDATE]: Term 1 election: Requested vote from peers 78966f88c7e0455d84f06aa75badf743 (127.15.70.2:37553), 9a3dbec47c664435b2e96cb12b681b26 (127.15.70.3:39075)
I20260811 00:55:13.002074 18085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b40e67bb60c4587b7d428ea4c108700" candidate_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a3dbec47c664435b2e96cb12b681b26"
I20260811 00:55:13.002072 17873 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b40e67bb60c4587b7d428ea4c108700" candidate_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78966f88c7e0455d84f06aa75badf743"
I20260811 00:55:13.002177 17873 raft_consensus.cc:3037] T 8b40e67bb60c4587b7d428ea4c108700 P 78966f88c7e0455d84f06aa75badf743 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:13.002202 18085 raft_consensus.cc:3037] T 8b40e67bb60c4587b7d428ea4c108700 P 9a3dbec47c664435b2e96cb12b681b26 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:13.003283 17873 raft_consensus.cc:2454] T 8b40e67bb60c4587b7d428ea4c108700 P 78966f88c7e0455d84f06aa75badf743 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d64e51f4c7b4a0eb633ce45f85f2d2b in term 1.
I20260811 00:55:13.003372 18085 raft_consensus.cc:2454] T 8b40e67bb60c4587b7d428ea4c108700 P 9a3dbec47c664435b2e96cb12b681b26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d64e51f4c7b4a0eb633ce45f85f2d2b in term 1.
I20260811 00:55:13.003496 17547 leader_election.cc:302] T 8b40e67bb60c4587b7d428ea4c108700 P 0d64e51f4c7b4a0eb633ce45f85f2d2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d64e51f4c7b4a0eb633ce45f85f2d2b, 78966f88c7e0455d84f06aa75badf743; no voters:
I20260811 00:55:13.003656 18210 raft_consensus.cc:2781] T 8b40e67bb60c4587b7d428ea4c108700 P 0d64e51f4c7b4a0eb633ce45f85f2d2b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:55:13.003922 18210 raft_consensus.cc:686] T 8b40e67bb60c4587b7d428ea4c108700 P 0d64e51f4c7b4a0eb633ce45f85f2d2b [term 1 LEADER]: Becoming Leader. State: Replica: 0d64e51f4c7b4a0eb633ce45f85f2d2b, State: Running, Role: LEADER
I20260811 00:55:13.004061 18210 consensus_queue.cc:237] T 8b40e67bb60c4587b7d428ea4c108700 P 0d64e51f4c7b4a0eb633ce45f85f2d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 44883 } } peers { permanent_uuid: "78966f88c7e0455d84f06aa75badf743" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 37553 } } peers { permanent_uuid: "9a3dbec47c664435b2e96cb12b681b26" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 39075 } }
I20260811 00:55:13.005407 17403 catalog_manager.cc:5495] T 8b40e67bb60c4587b7d428ea4c108700 P 0d64e51f4c7b4a0eb633ce45f85f2d2b reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d64e51f4c7b4a0eb633ce45f85f2d2b (127.15.70.1). New cstate: current_term: 1 leader_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 44883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78966f88c7e0455d84f06aa75badf743" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 37553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a3dbec47c664435b2e96cb12b681b26" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 39075 } health_report { overall_health: UNKNOWN } } }
I20260811 00:55:13.032882 18189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:13.029674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56458 (local address 127.15.70.1:44883)
0811 00:55:13.029756 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:13.029759 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:13.029772 (+ 13us) server_negotiation.cc:407] Connection header received
0811 00:55:13.029972 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:13.029973 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:13.029999 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:13.030084 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:55:13.030296 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:13.030837 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:13.031842 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:13.032066 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:13.032152 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:13.032426 (+ 274us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:55:13.032560 (+ 134us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:55:13.032667 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:13.032711 (+ 44us) server_negotiation.cc:299] Negotiation successful
0811 00:55:13.032746 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 00:55:13.035672 17873 raft_consensus.cc:1261] T 8b40e67bb60c4587b7d428ea4c108700 P 78966f88c7e0455d84f06aa75badf743 [term 1 FOLLOWER]: Refusing update from remote peer 0d64e51f4c7b4a0eb633ce45f85f2d2b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:55:13.035702 18085 raft_consensus.cc:1261] T 8b40e67bb60c4587b7d428ea4c108700 P 9a3dbec47c664435b2e96cb12b681b26 [term 1 FOLLOWER]: Refusing update from remote peer 0d64e51f4c7b4a0eb633ce45f85f2d2b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:55:13.036197 18210 consensus_queue.cc:1035] T 8b40e67bb60c4587b7d428ea4c108700 P 0d64e51f4c7b4a0eb633ce45f85f2d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "78966f88c7e0455d84f06aa75badf743" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 37553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:55:13.036445 18213 consensus_queue.cc:1035] T 8b40e67bb60c4587b7d428ea4c108700 P 0d64e51f4c7b4a0eb633ce45f85f2d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a3dbec47c664435b2e96cb12b681b26" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 39075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:55:13.045548 17403 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60334:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:55:13.045818 17403 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60334:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:55:13.047426 17403 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ea1cd6494c0b44adaba55aa880b1f31f: Sending DeleteTablet for 3 replicas of tablet 8b40e67bb60c4587b7d428ea4c108700
I20260811 00:55:13.047996 17626 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b40e67bb60c4587b7d428ea4c108700 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:55:13 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:56444
I20260811 00:55:13.048015 17844 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b40e67bb60c4587b7d428ea4c108700 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:55:13 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:58976
I20260811 00:55:13.048115 18059 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b40e67bb60c4587b7d428ea4c108700 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:55:13 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:43424
I20260811 00:55:13.048432 18234 tablet_replica.cc:330] T 8b40e67bb60c4587b7d428ea4c108700 P 9a3dbec47c664435b2e96cb12b681b26: stopping tablet replica
I20260811 00:55:13.048632 18234 raft_consensus.cc:2229] T 8b40e67bb60c4587b7d428ea4c108700 P 9a3dbec47c664435b2e96cb12b681b26 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:55:13.048853 18234 raft_consensus.cc:2258] T 8b40e67bb60c4587b7d428ea4c108700 P 9a3dbec47c664435b2e96cb12b681b26 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:55:13.049052 18231 tablet_replica.cc:330] T 8b40e67bb60c4587b7d428ea4c108700 P 78966f88c7e0455d84f06aa75badf743: stopping tablet replica
I20260811 00:55:13.049209 18231 raft_consensus.cc:2229] T 8b40e67bb60c4587b7d428ea4c108700 P 78966f88c7e0455d84f06aa75badf743 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:55:13.049074 17403 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60334:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 00:55:13.049351 18231 raft_consensus.cc:2258] T 8b40e67bb60c4587b7d428ea4c108700 P 78966f88c7e0455d84f06aa75badf743 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 00:55:13.049347 17403 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:55:13.049562 18232 tablet_replica.cc:330] T 8b40e67bb60c4587b7d428ea4c108700 P 0d64e51f4c7b4a0eb633ce45f85f2d2b: stopping tablet replica
I20260811 00:55:13.049754 18234 ts_tablet_manager.cc:1905] T 8b40e67bb60c4587b7d428ea4c108700 P 9a3dbec47c664435b2e96cb12b681b26: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:55:13.049687 18232 raft_consensus.cc:2229] T 8b40e67bb60c4587b7d428ea4c108700 P 0d64e51f4c7b4a0eb633ce45f85f2d2b [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:55:13.050629 18232 raft_consensus.cc:2258] T 8b40e67bb60c4587b7d428ea4c108700 P 0d64e51f4c7b4a0eb633ce45f85f2d2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:55:13.051448 18232 ts_tablet_manager.cc:1905] T 8b40e67bb60c4587b7d428ea4c108700 P 0d64e51f4c7b4a0eb633ce45f85f2d2b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:55:13.051450 18231 ts_tablet_manager.cc:1905] T 8b40e67bb60c4587b7d428ea4c108700 P 78966f88c7e0455d84f06aa75badf743: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:55:13.052029 18059 tablet_service.cc:1467] Processing CreateTablet for tablet e576baef90c143ddb3403e74f481970f (DEFAULT_TABLE table=test-table [id=52331ed586a640cfb83b2adb9f25d2b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:55:13.052245 18059 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e576baef90c143ddb3403e74f481970f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:13.054005 18232 ts_tablet_manager.cc:1918] T 8b40e67bb60c4587b7d428ea4c108700 P 0d64e51f4c7b4a0eb633ce45f85f2d2b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:55:13.054108 18232 log.cc:1196] T 8b40e67bb60c4587b7d428ea4c108700 P 0d64e51f4c7b4a0eb633ce45f85f2d2b: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-0/wal/wals/8b40e67bb60c4587b7d428ea4c108700
I20260811 00:55:13.054296 18196 tablet_bootstrap.cc:492] T e576baef90c143ddb3403e74f481970f P 9a3dbec47c664435b2e96cb12b681b26: Bootstrap starting.
I20260811 00:55:13.054659 18232 ts_tablet_manager.cc:1939] T 8b40e67bb60c4587b7d428ea4c108700 P 0d64e51f4c7b4a0eb633ce45f85f2d2b: Deleting consensus metadata
I20260811 00:55:13.055140 18196 tablet_bootstrap.cc:654] T e576baef90c143ddb3403e74f481970f P 9a3dbec47c664435b2e96cb12b681b26: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:13.055943 17626 tablet_service.cc:1467] Processing CreateTablet for tablet e576baef90c143ddb3403e74f481970f (DEFAULT_TABLE table=test-table [id=52331ed586a640cfb83b2adb9f25d2b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:55:13.056098 17626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e576baef90c143ddb3403e74f481970f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:13.056161 18234 ts_tablet_manager.cc:1918] T 8b40e67bb60c4587b7d428ea4c108700 P 9a3dbec47c664435b2e96cb12b681b26: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:55:13.056228 18234 log.cc:1196] T 8b40e67bb60c4587b7d428ea4c108700 P 9a3dbec47c664435b2e96cb12b681b26: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-2/wal/wals/8b40e67bb60c4587b7d428ea4c108700
I20260811 00:55:13.056452 18234 ts_tablet_manager.cc:1939] T 8b40e67bb60c4587b7d428ea4c108700 P 9a3dbec47c664435b2e96cb12b681b26: Deleting consensus metadata
I20260811 00:55:13.056700 18231 ts_tablet_manager.cc:1918] T 8b40e67bb60c4587b7d428ea4c108700 P 78966f88c7e0455d84f06aa75badf743: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:55:13.056794 18231 log.cc:1196] T 8b40e67bb60c4587b7d428ea4c108700 P 78966f88c7e0455d84f06aa75badf743: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-1/wal/wals/8b40e67bb60c4587b7d428ea4c108700
I20260811 00:55:13.057081 18231 ts_tablet_manager.cc:1939] T 8b40e67bb60c4587b7d428ea4c108700 P 78966f88c7e0455d84f06aa75badf743: Deleting consensus metadata
I20260811 00:55:13.057626 17382 catalog_manager.cc:4841] TS 78966f88c7e0455d84f06aa75badf743 (127.15.70.2:37553): tablet 8b40e67bb60c4587b7d428ea4c108700 (table test-table [id=9fcd1f1d9c744d958074ddf866e4cdeb]) successfully deleted
I20260811 00:55:13.057984 18198 tablet_bootstrap.cc:492] T e576baef90c143ddb3403e74f481970f P 0d64e51f4c7b4a0eb633ce45f85f2d2b: Bootstrap starting.
I20260811 00:55:13.058525 18198 tablet_bootstrap.cc:654] T e576baef90c143ddb3403e74f481970f P 0d64e51f4c7b4a0eb633ce45f85f2d2b: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:13.058508 17844 tablet_service.cc:1467] Processing CreateTablet for tablet e576baef90c143ddb3403e74f481970f (DEFAULT_TABLE table=test-table [id=52331ed586a640cfb83b2adb9f25d2b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:55:13.058676 17844 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e576baef90c143ddb3403e74f481970f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:13.059211 17384 catalog_manager.cc:4841] TS 9a3dbec47c664435b2e96cb12b681b26 (127.15.70.3:39075): tablet 8b40e67bb60c4587b7d428ea4c108700 (table test-table [id=9fcd1f1d9c744d958074ddf866e4cdeb]) successfully deleted
I20260811 00:55:13.059346 17384 catalog_manager.cc:4841] TS 0d64e51f4c7b4a0eb633ce45f85f2d2b (127.15.70.1:44883): tablet 8b40e67bb60c4587b7d428ea4c108700 (table test-table [id=9fcd1f1d9c744d958074ddf866e4cdeb]) successfully deleted
I20260811 00:55:13.060209 18198 tablet_bootstrap.cc:492] T e576baef90c143ddb3403e74f481970f P 0d64e51f4c7b4a0eb633ce45f85f2d2b: No bootstrap required, opened a new log
I20260811 00:55:13.060297 18198 ts_tablet_manager.cc:1397] T e576baef90c143ddb3403e74f481970f P 0d64e51f4c7b4a0eb633ce45f85f2d2b: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 00:55:13.060632 18198 raft_consensus.cc:348] T e576baef90c143ddb3403e74f481970f P 0d64e51f4c7b4a0eb633ce45f85f2d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 44883 } } peers { permanent_uuid: "78966f88c7e0455d84f06aa75badf743" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 37553 } } peers { permanent_uuid: "9a3dbec47c664435b2e96cb12b681b26" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 39075 } }
I20260811 00:55:13.060761 18198 raft_consensus.cc:374] T e576baef90c143ddb3403e74f481970f P 0d64e51f4c7b4a0eb633ce45f85f2d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:13.060791 18198 raft_consensus.cc:729] T e576baef90c143ddb3403e74f481970f P 0d64e51f4c7b4a0eb633ce45f85f2d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d64e51f4c7b4a0eb633ce45f85f2d2b, State: Initialized, Role: FOLLOWER
I20260811 00:55:13.060770 18195 tablet_bootstrap.cc:492] T e576baef90c143ddb3403e74f481970f P 78966f88c7e0455d84f06aa75badf743: Bootstrap starting.
I20260811 00:55:13.060849 18198 consensus_queue.cc:260] T e576baef90c143ddb3403e74f481970f P 0d64e51f4c7b4a0eb633ce45f85f2d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 44883 } } peers { permanent_uuid: "78966f88c7e0455d84f06aa75badf743" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 37553 } } peers { permanent_uuid: "9a3dbec47c664435b2e96cb12b681b26" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 39075 } }
I20260811 00:55:13.060972 18198 ts_tablet_manager.cc:1428] T e576baef90c143ddb3403e74f481970f P 0d64e51f4c7b4a0eb633ce45f85f2d2b: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260811 00:55:13.061323 18195 tablet_bootstrap.cc:654] T e576baef90c143ddb3403e74f481970f P 78966f88c7e0455d84f06aa75badf743: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:13.061362 18196 tablet_bootstrap.cc:492] T e576baef90c143ddb3403e74f481970f P 9a3dbec47c664435b2e96cb12b681b26: No bootstrap required, opened a new log
I20260811 00:55:13.061477 18196 ts_tablet_manager.cc:1397] T e576baef90c143ddb3403e74f481970f P 9a3dbec47c664435b2e96cb12b681b26: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20260811 00:55:13.061689 18196 raft_consensus.cc:348] T e576baef90c143ddb3403e74f481970f P 9a3dbec47c664435b2e96cb12b681b26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 44883 } } peers { permanent_uuid: "78966f88c7e0455d84f06aa75badf743" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 37553 } } peers { permanent_uuid: "9a3dbec47c664435b2e96cb12b681b26" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 39075 } }
I20260811 00:55:13.061786 18196 raft_consensus.cc:374] T e576baef90c143ddb3403e74f481970f P 9a3dbec47c664435b2e96cb12b681b26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:13.061810 18196 raft_consensus.cc:729] T e576baef90c143ddb3403e74f481970f P 9a3dbec47c664435b2e96cb12b681b26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a3dbec47c664435b2e96cb12b681b26, State: Initialized, Role: FOLLOWER
I20260811 00:55:13.061861 18196 consensus_queue.cc:260] T e576baef90c143ddb3403e74f481970f P 9a3dbec47c664435b2e96cb12b681b26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 44883 } } peers { permanent_uuid: "78966f88c7e0455d84f06aa75badf743" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 37553 } } peers { permanent_uuid: "9a3dbec47c664435b2e96cb12b681b26" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 39075 } }
I20260811 00:55:13.061976 18196 ts_tablet_manager.cc:1428] T e576baef90c143ddb3403e74f481970f P 9a3dbec47c664435b2e96cb12b681b26: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 00:55:13.062625 18195 tablet_bootstrap.cc:492] T e576baef90c143ddb3403e74f481970f P 78966f88c7e0455d84f06aa75badf743: No bootstrap required, opened a new log
I20260811 00:55:13.062706 18195 ts_tablet_manager.cc:1397] T e576baef90c143ddb3403e74f481970f P 78966f88c7e0455d84f06aa75badf743: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 00:55:13.062920 18195 raft_consensus.cc:348] T e576baef90c143ddb3403e74f481970f P 78966f88c7e0455d84f06aa75badf743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 44883 } } peers { permanent_uuid: "78966f88c7e0455d84f06aa75badf743" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 37553 } } peers { permanent_uuid: "9a3dbec47c664435b2e96cb12b681b26" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 39075 } }
I20260811 00:55:13.063060 18195 raft_consensus.cc:374] T e576baef90c143ddb3403e74f481970f P 78966f88c7e0455d84f06aa75badf743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:13.063099 18195 raft_consensus.cc:729] T e576baef90c143ddb3403e74f481970f P 78966f88c7e0455d84f06aa75badf743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78966f88c7e0455d84f06aa75badf743, State: Initialized, Role: FOLLOWER
I20260811 00:55:13.063165 18195 consensus_queue.cc:260] T e576baef90c143ddb3403e74f481970f P 78966f88c7e0455d84f06aa75badf743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 44883 } } peers { permanent_uuid: "78966f88c7e0455d84f06aa75badf743" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 37553 } } peers { permanent_uuid: "9a3dbec47c664435b2e96cb12b681b26" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 39075 } }
I20260811 00:55:13.063323 18195 ts_tablet_manager.cc:1428] T e576baef90c143ddb3403e74f481970f P 78966f88c7e0455d84f06aa75badf743: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:13.252103 18224 raft_consensus.cc:482] T e576baef90c143ddb3403e74f481970f P 0d64e51f4c7b4a0eb633ce45f85f2d2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:55:13.252265 18224 raft_consensus.cc:504] T e576baef90c143ddb3403e74f481970f P 0d64e51f4c7b4a0eb633ce45f85f2d2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 44883 } } peers { permanent_uuid: "78966f88c7e0455d84f06aa75badf743" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 37553 } } peers { permanent_uuid: "9a3dbec47c664435b2e96cb12b681b26" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 39075 } }
I20260811 00:55:13.252617 18224 leader_election.cc:288] T e576baef90c143ddb3403e74f481970f P 0d64e51f4c7b4a0eb633ce45f85f2d2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78966f88c7e0455d84f06aa75badf743 (127.15.70.2:37553), 9a3dbec47c664435b2e96cb12b681b26 (127.15.70.3:39075)
I20260811 00:55:13.253002 18085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e576baef90c143ddb3403e74f481970f" candidate_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a3dbec47c664435b2e96cb12b681b26" is_pre_election: true
I20260811 00:55:13.253058 17873 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e576baef90c143ddb3403e74f481970f" candidate_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78966f88c7e0455d84f06aa75badf743" is_pre_election: true
I20260811 00:55:13.253162 18085 raft_consensus.cc:2454] T e576baef90c143ddb3403e74f481970f P 9a3dbec47c664435b2e96cb12b681b26 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d64e51f4c7b4a0eb633ce45f85f2d2b in term 0.
I20260811 00:55:13.253172 17873 raft_consensus.cc:2454] T e576baef90c143ddb3403e74f481970f P 78966f88c7e0455d84f06aa75badf743 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d64e51f4c7b4a0eb633ce45f85f2d2b in term 0.
I20260811 00:55:13.253424 17548 leader_election.cc:302] T e576baef90c143ddb3403e74f481970f P 0d64e51f4c7b4a0eb633ce45f85f2d2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d64e51f4c7b4a0eb633ce45f85f2d2b, 9a3dbec47c664435b2e96cb12b681b26; no voters:
I20260811 00:55:13.253578 18224 raft_consensus.cc:2781] T e576baef90c143ddb3403e74f481970f P 0d64e51f4c7b4a0eb633ce45f85f2d2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:55:13.253625 18224 raft_consensus.cc:482] T e576baef90c143ddb3403e74f481970f P 0d64e51f4c7b4a0eb633ce45f85f2d2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:55:13.253651 18224 raft_consensus.cc:3037] T e576baef90c143ddb3403e74f481970f P 0d64e51f4c7b4a0eb633ce45f85f2d2b [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:13.254734 18224 raft_consensus.cc:504] T e576baef90c143ddb3403e74f481970f P 0d64e51f4c7b4a0eb633ce45f85f2d2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 44883 } } peers { permanent_uuid: "78966f88c7e0455d84f06aa75badf743" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 37553 } } peers { permanent_uuid: "9a3dbec47c664435b2e96cb12b681b26" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 39075 } }
I20260811 00:55:13.254935 18224 leader_election.cc:288] T e576baef90c143ddb3403e74f481970f P 0d64e51f4c7b4a0eb633ce45f85f2d2b [CANDIDATE]: Term 1 election: Requested vote from peers 78966f88c7e0455d84f06aa75badf743 (127.15.70.2:37553), 9a3dbec47c664435b2e96cb12b681b26 (127.15.70.3:39075)
I20260811 00:55:13.255249 18085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e576baef90c143ddb3403e74f481970f" candidate_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a3dbec47c664435b2e96cb12b681b26"
I20260811 00:55:13.255273 17873 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e576baef90c143ddb3403e74f481970f" candidate_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78966f88c7e0455d84f06aa75badf743"
I20260811 00:55:13.255371 18085 raft_consensus.cc:3037] T e576baef90c143ddb3403e74f481970f P 9a3dbec47c664435b2e96cb12b681b26 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:13.255371 17873 raft_consensus.cc:3037] T e576baef90c143ddb3403e74f481970f P 78966f88c7e0455d84f06aa75badf743 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:13.256619 18085 raft_consensus.cc:2454] T e576baef90c143ddb3403e74f481970f P 9a3dbec47c664435b2e96cb12b681b26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d64e51f4c7b4a0eb633ce45f85f2d2b in term 1.
I20260811 00:55:13.256896 17548 leader_election.cc:302] T e576baef90c143ddb3403e74f481970f P 0d64e51f4c7b4a0eb633ce45f85f2d2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d64e51f4c7b4a0eb633ce45f85f2d2b, 9a3dbec47c664435b2e96cb12b681b26; no voters:
I20260811 00:55:13.257045 18224 raft_consensus.cc:2781] T e576baef90c143ddb3403e74f481970f P 0d64e51f4c7b4a0eb633ce45f85f2d2b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:55:13.257084 17873 raft_consensus.cc:2454] T e576baef90c143ddb3403e74f481970f P 78966f88c7e0455d84f06aa75badf743 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d64e51f4c7b4a0eb633ce45f85f2d2b in term 1.
I20260811 00:55:13.257179 18224 raft_consensus.cc:686] T e576baef90c143ddb3403e74f481970f P 0d64e51f4c7b4a0eb633ce45f85f2d2b [term 1 LEADER]: Becoming Leader. State: Replica: 0d64e51f4c7b4a0eb633ce45f85f2d2b, State: Running, Role: LEADER
I20260811 00:55:13.257259 18224 consensus_queue.cc:237] T e576baef90c143ddb3403e74f481970f P 0d64e51f4c7b4a0eb633ce45f85f2d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 44883 } } peers { permanent_uuid: "78966f88c7e0455d84f06aa75badf743" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 37553 } } peers { permanent_uuid: "9a3dbec47c664435b2e96cb12b681b26" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 39075 } }
I20260811 00:55:13.258136 17404 catalog_manager.cc:5495] T e576baef90c143ddb3403e74f481970f P 0d64e51f4c7b4a0eb633ce45f85f2d2b reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d64e51f4c7b4a0eb633ce45f85f2d2b (127.15.70.1). New cstate: current_term: 1 leader_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 44883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78966f88c7e0455d84f06aa75badf743" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 37553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a3dbec47c664435b2e96cb12b681b26" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 39075 } health_report { overall_health: UNKNOWN } } }
Aug 11 00:55:13 dist-test-slave-h3ft krb5kdc[17333](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409711, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:13.317054 18255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:13.308319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60346 (local address 127.15.70.62:44985)
0811 00:55:13.308495 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:13.308497 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:13.308563 (+ 66us) server_negotiation.cc:407] Connection header received
0811 00:55:13.308643 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:13.308644 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:13.308657 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:13.308726 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:13.309419 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:13.309989 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:13.310780 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:13.310980 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:13.311064 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:13.313859 (+ 2795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:13.313861 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:13.313861 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:13.313869 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:13.315730 (+ 1861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:13.316181 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:13.316182 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:13.316182 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:13.316249 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:13.316455 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:13.316456 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:13.316456 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:13.316609 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:13.316666 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:13.316862 (+ 196us) server_negotiation.cc:299] Negotiation successful
0811 00:55:13.316954 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":132,"threads_started":1}
I20260811 00:55:13.317225 18253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:13.308202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:44985 (local address 127.0.0.1:60346)
0811 00:55:13.308473 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:13.308490 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:13.308590 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:13.308779 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:13.308781 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:13.309231 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:13.309310 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:13.309313 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:13.310088 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:13.310089 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:13.310687 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:13.310689 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:13.311151 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:13.311152 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:13.311203 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:13.311985 (+ 782us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:13.311990 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:13.313760 (+ 1770us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:13.315821 (+ 2061us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:13.315833 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:13.315836 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:13.316102 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:13.316316 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:13.316317 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:13.316317 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:13.316388 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:13.316692 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:13.316700 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:13.316756 (+ 56us) client_negotiation.cc:769] Sending connection context
0811 00:55:13.316838 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 00:55:13.317044 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":216,"mutex_wait_us":65,"thread_start_us":130,"threads_started":1}
I20260811 00:55:13.319978 17404 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:60346:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 00:55:13.320407 17404 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:55:13.322887 17844 tablet_service.cc:1467] Processing CreateTablet for tablet 8b9b9273c0294ec48e7e7b2bda3109fd (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f682f2a6b38140ebb98749a1ad3d753a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 00:55:13.323264 17844 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b9b9273c0294ec48e7e7b2bda3109fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:13.325219 18195 tablet_bootstrap.cc:492] T 8b9b9273c0294ec48e7e7b2bda3109fd P 78966f88c7e0455d84f06aa75badf743: Bootstrap starting.
I20260811 00:55:13.322872 18059 tablet_service.cc:1467] Processing CreateTablet for tablet 8b9b9273c0294ec48e7e7b2bda3109fd (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f682f2a6b38140ebb98749a1ad3d753a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 00:55:13.325696 18059 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b9b9273c0294ec48e7e7b2bda3109fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:13.325872 18195 tablet_bootstrap.cc:654] T 8b9b9273c0294ec48e7e7b2bda3109fd P 78966f88c7e0455d84f06aa75badf743: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:13.327247 17626 tablet_service.cc:1467] Processing CreateTablet for tablet 8b9b9273c0294ec48e7e7b2bda3109fd (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f682f2a6b38140ebb98749a1ad3d753a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 00:55:13.327487 17626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b9b9273c0294ec48e7e7b2bda3109fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:13.327539 18196 tablet_bootstrap.cc:492] T 8b9b9273c0294ec48e7e7b2bda3109fd P 9a3dbec47c664435b2e96cb12b681b26: Bootstrap starting.
I20260811 00:55:13.328063 18196 tablet_bootstrap.cc:654] T 8b9b9273c0294ec48e7e7b2bda3109fd P 9a3dbec47c664435b2e96cb12b681b26: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:13.329013 18196 tablet_bootstrap.cc:492] T 8b9b9273c0294ec48e7e7b2bda3109fd P 9a3dbec47c664435b2e96cb12b681b26: No bootstrap required, opened a new log
I20260811 00:55:13.329067 18196 ts_tablet_manager.cc:1397] T 8b9b9273c0294ec48e7e7b2bda3109fd P 9a3dbec47c664435b2e96cb12b681b26: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 00:55:13.329366 18196 raft_consensus.cc:348] T 8b9b9273c0294ec48e7e7b2bda3109fd P 9a3dbec47c664435b2e96cb12b681b26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 44883 } } peers { permanent_uuid: "78966f88c7e0455d84f06aa75badf743" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 37553 } } peers { permanent_uuid: "9a3dbec47c664435b2e96cb12b681b26" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 39075 } }
I20260811 00:55:13.329450 18196 raft_consensus.cc:374] T 8b9b9273c0294ec48e7e7b2bda3109fd P 9a3dbec47c664435b2e96cb12b681b26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:13.329465 18196 raft_consensus.cc:729] T 8b9b9273c0294ec48e7e7b2bda3109fd P 9a3dbec47c664435b2e96cb12b681b26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a3dbec47c664435b2e96cb12b681b26, State: Initialized, Role: FOLLOWER
I20260811 00:55:13.329532 18196 consensus_queue.cc:260] T 8b9b9273c0294ec48e7e7b2bda3109fd P 9a3dbec47c664435b2e96cb12b681b26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 44883 } } peers { permanent_uuid: "78966f88c7e0455d84f06aa75badf743" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 37553 } } peers { permanent_uuid: "9a3dbec47c664435b2e96cb12b681b26" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 39075 } }
I20260811 00:55:13.329644 18196 ts_tablet_manager.cc:1428] T 8b9b9273c0294ec48e7e7b2bda3109fd P 9a3dbec47c664435b2e96cb12b681b26: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260811 00:55:13.329672 18198 tablet_bootstrap.cc:492] T 8b9b9273c0294ec48e7e7b2bda3109fd P 0d64e51f4c7b4a0eb633ce45f85f2d2b: Bootstrap starting.
I20260811 00:55:13.329864 18209 tablet_replica.cc:439] T 8b9b9273c0294ec48e7e7b2bda3109fd P 9a3dbec47c664435b2e96cb12b681b26: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 44883 } } peers { permanent_uuid: "78966f88c7e0455d84f06aa75badf743" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 37553 } } peers { permanent_uuid: "9a3dbec47c664435b2e96cb12b681b26" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 39075 } } }
I20260811 00:55:13.330003 18209 tablet_replica.cc:442] T 8b9b9273c0294ec48e7e7b2bda3109fd P 9a3dbec47c664435b2e96cb12b681b26: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 00:55:13.330089 18198 tablet_bootstrap.cc:654] T 8b9b9273c0294ec48e7e7b2bda3109fd P 0d64e51f4c7b4a0eb633ce45f85f2d2b: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:13.330117 18195 tablet_bootstrap.cc:492] T 8b9b9273c0294ec48e7e7b2bda3109fd P 78966f88c7e0455d84f06aa75badf743: No bootstrap required, opened a new log
I20260811 00:55:13.330190 18195 ts_tablet_manager.cc:1397] T 8b9b9273c0294ec48e7e7b2bda3109fd P 78966f88c7e0455d84f06aa75badf743: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260811 00:55:13.330456 18195 raft_consensus.cc:348] T 8b9b9273c0294ec48e7e7b2bda3109fd P 78966f88c7e0455d84f06aa75badf743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 44883 } } peers { permanent_uuid: "78966f88c7e0455d84f06aa75badf743" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 37553 } } peers { permanent_uuid: "9a3dbec47c664435b2e96cb12b681b26" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 39075 } }
I20260811 00:55:13.330554 18195 raft_consensus.cc:374] T 8b9b9273c0294ec48e7e7b2bda3109fd P 78966f88c7e0455d84f06aa75badf743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:13.330577 18195 raft_consensus.cc:729] T 8b9b9273c0294ec48e7e7b2bda3109fd P 78966f88c7e0455d84f06aa75badf743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78966f88c7e0455d84f06aa75badf743, State: Initialized, Role: FOLLOWER
I20260811 00:55:13.330636 18195 consensus_queue.cc:260] T 8b9b9273c0294ec48e7e7b2bda3109fd P 78966f88c7e0455d84f06aa75badf743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 44883 } } peers { permanent_uuid: "78966f88c7e0455d84f06aa75badf743" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 37553 } } peers { permanent_uuid: "9a3dbec47c664435b2e96cb12b681b26" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 39075 } }
I20260811 00:55:13.330765 18195 ts_tablet_manager.cc:1428] T 8b9b9273c0294ec48e7e7b2bda3109fd P 78966f88c7e0455d84f06aa75badf743: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 00:55:13.330911 18198 tablet_bootstrap.cc:492] T 8b9b9273c0294ec48e7e7b2bda3109fd P 0d64e51f4c7b4a0eb633ce45f85f2d2b: No bootstrap required, opened a new log
I20260811 00:55:13.330876 18204 tablet_replica.cc:439] T 8b9b9273c0294ec48e7e7b2bda3109fd P 78966f88c7e0455d84f06aa75badf743: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 44883 } } peers { permanent_uuid: "78966f88c7e0455d84f06aa75badf743" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 37553 } } peers { permanent_uuid: "9a3dbec47c664435b2e96cb12b681b26" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 39075 } } }
I20260811 00:55:13.330973 18198 ts_tablet_manager.cc:1397] T 8b9b9273c0294ec48e7e7b2bda3109fd P 0d64e51f4c7b4a0eb633ce45f85f2d2b: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 00:55:13.331029 18204 tablet_replica.cc:442] T 8b9b9273c0294ec48e7e7b2bda3109fd P 78966f88c7e0455d84f06aa75badf743: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 00:55:13.331172 18198 raft_consensus.cc:348] T 8b9b9273c0294ec48e7e7b2bda3109fd P 0d64e51f4c7b4a0eb633ce45f85f2d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 44883 } } peers { permanent_uuid: "78966f88c7e0455d84f06aa75badf743" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 37553 } } peers { permanent_uuid: "9a3dbec47c664435b2e96cb12b681b26" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 39075 } }
I20260811 00:55:13.331262 18198 raft_consensus.cc:374] T 8b9b9273c0294ec48e7e7b2bda3109fd P 0d64e51f4c7b4a0eb633ce45f85f2d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:13.331287 18198 raft_consensus.cc:729] T 8b9b9273c0294ec48e7e7b2bda3109fd P 0d64e51f4c7b4a0eb633ce45f85f2d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d64e51f4c7b4a0eb633ce45f85f2d2b, State: Initialized, Role: FOLLOWER
I20260811 00:55:13.331334 18198 consensus_queue.cc:260] T 8b9b9273c0294ec48e7e7b2bda3109fd P 0d64e51f4c7b4a0eb633ce45f85f2d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 44883 } } peers { permanent_uuid: "78966f88c7e0455d84f06aa75badf743" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 37553 } } peers { permanent_uuid: "9a3dbec47c664435b2e96cb12b681b26" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 39075 } }
I20260811 00:55:13.331455 18198 ts_tablet_manager.cc:1428] T 8b9b9273c0294ec48e7e7b2bda3109fd P 0d64e51f4c7b4a0eb633ce45f85f2d2b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:13.331470 18224 tablet_replica.cc:439] T 8b9b9273c0294ec48e7e7b2bda3109fd P 0d64e51f4c7b4a0eb633ce45f85f2d2b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 44883 } } peers { permanent_uuid: "78966f88c7e0455d84f06aa75badf743" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 37553 } } peers { permanent_uuid: "9a3dbec47c664435b2e96cb12b681b26" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 39075 } } }
I20260811 00:55:13.331557 18224 tablet_replica.cc:442] T 8b9b9273c0294ec48e7e7b2bda3109fd P 0d64e51f4c7b4a0eb633ce45f85f2d2b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 00:55:13.471390 18209 raft_consensus.cc:482] T 8b9b9273c0294ec48e7e7b2bda3109fd P 9a3dbec47c664435b2e96cb12b681b26 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:55:13.471598 18209 raft_consensus.cc:504] T 8b9b9273c0294ec48e7e7b2bda3109fd P 9a3dbec47c664435b2e96cb12b681b26 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 44883 } } peers { permanent_uuid: "78966f88c7e0455d84f06aa75badf743" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 37553 } } peers { permanent_uuid: "9a3dbec47c664435b2e96cb12b681b26" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 39075 } }
I20260811 00:55:13.472198 18209 leader_election.cc:288] T 8b9b9273c0294ec48e7e7b2bda3109fd P 9a3dbec47c664435b2e96cb12b681b26 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d64e51f4c7b4a0eb633ce45f85f2d2b (127.15.70.1:44883), 78966f88c7e0455d84f06aa75badf743 (127.15.70.2:37553)
I20260811 00:55:13.476866 18189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:13.472643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:43331 (local address 127.15.70.1:44883)
0811 00:55:13.472713 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:13.472715 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:13.472728 (+ 13us) server_negotiation.cc:407] Connection header received
0811 00:55:13.472781 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:13.472782 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:13.472817 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:13.472873 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:13.473103 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:13.473946 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:13.475784 (+ 1838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:13.476396 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:13.476501 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:13.476512 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:13.476721 (+ 209us) server_negotiation.cc:299] Negotiation successful
0811 00:55:13.476769 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 00:55:13.476866 18190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:13.472597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:44947 (local address 127.15.70.2:37553)
0811 00:55:13.472669 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:13.472672 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:13.472843 (+ 171us) server_negotiation.cc:407] Connection header received
0811 00:55:13.472952 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:13.472954 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:13.472966 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:13.473000 (+ 34us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:13.473214 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:13.473973 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:13.475784 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:13.476396 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:13.476494 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:13.476512 (+ 18us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:13.476721 (+ 209us) server_negotiation.cc:299] Negotiation successful
0811 00:55:13.476772 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 00:55:13.476910 18260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:13.472411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:44883 (local address 127.15.70.3:43331)
0811 00:55:13.472618 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:13.472633 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:13.472704 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:13.472892 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:13.472894 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:13.472896 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:13.473004 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:13.473006 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:13.474072 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:13.474074 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:13.475658 (+ 1584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:13.475662 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:13.476532 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:13.476533 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:13.476628 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:13.476635 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 00:55:13.476697 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 00:55:13.476760 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"mutex_wait_us":79,"thread_start_us":114,"threads_started":1}
I20260811 00:55:13.476920 18262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:13.472411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.2:37553 (local address 127.15.70.3:44947)
0811 00:55:13.472740 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:13.472752 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:13.472851 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:13.473060 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:13.473061 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:13.473062 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:13.473139 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:13.473140 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:13.474073 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:13.474074 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:13.475658 (+ 1584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:13.475662 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:13.476541 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:13.476542 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:13.476628 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:13.476634 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 00:55:13.476697 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 00:55:13.476760 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"mutex_wait_us":85,"thread_start_us":111,"threads_started":1}
I20260811 00:55:13.477331 17873 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b9b9273c0294ec48e7e7b2bda3109fd" candidate_uuid: "9a3dbec47c664435b2e96cb12b681b26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78966f88c7e0455d84f06aa75badf743" is_pre_election: true
I20260811 00:55:13.477486 17873 raft_consensus.cc:2454] T 8b9b9273c0294ec48e7e7b2bda3109fd P 78966f88c7e0455d84f06aa75badf743 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a3dbec47c664435b2e96cb12b681b26 in term 0.
I20260811 00:55:13.477742 17978 leader_election.cc:302] T 8b9b9273c0294ec48e7e7b2bda3109fd P 9a3dbec47c664435b2e96cb12b681b26 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78966f88c7e0455d84f06aa75badf743, 9a3dbec47c664435b2e96cb12b681b26; no voters:
I20260811 00:55:13.477730 17657 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b9b9273c0294ec48e7e7b2bda3109fd" candidate_uuid: "9a3dbec47c664435b2e96cb12b681b26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" is_pre_election: true
I20260811 00:55:13.477916 17657 raft_consensus.cc:2454] T 8b9b9273c0294ec48e7e7b2bda3109fd P 0d64e51f4c7b4a0eb633ce45f85f2d2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a3dbec47c664435b2e96cb12b681b26 in term 0.
I20260811 00:55:13.477947 18209 raft_consensus.cc:2781] T 8b9b9273c0294ec48e7e7b2bda3109fd P 9a3dbec47c664435b2e96cb12b681b26 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:55:13.478012 18209 raft_consensus.cc:482] T 8b9b9273c0294ec48e7e7b2bda3109fd P 9a3dbec47c664435b2e96cb12b681b26 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:55:13.478044 18209 raft_consensus.cc:3037] T 8b9b9273c0294ec48e7e7b2bda3109fd P 9a3dbec47c664435b2e96cb12b681b26 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:13.479139 18209 raft_consensus.cc:504] T 8b9b9273c0294ec48e7e7b2bda3109fd P 9a3dbec47c664435b2e96cb12b681b26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 44883 } } peers { permanent_uuid: "78966f88c7e0455d84f06aa75badf743" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 37553 } } peers { permanent_uuid: "9a3dbec47c664435b2e96cb12b681b26" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 39075 } }
I20260811 00:55:13.479328 18209 leader_election.cc:288] T 8b9b9273c0294ec48e7e7b2bda3109fd P 9a3dbec47c664435b2e96cb12b681b26 [CANDIDATE]: Term 1 election: Requested vote from peers 0d64e51f4c7b4a0eb633ce45f85f2d2b (127.15.70.1:44883), 78966f88c7e0455d84f06aa75badf743 (127.15.70.2:37553)
I20260811 00:55:13.479530 17657 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b9b9273c0294ec48e7e7b2bda3109fd" candidate_uuid: "9a3dbec47c664435b2e96cb12b681b26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b"
I20260811 00:55:13.479598 17873 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b9b9273c0294ec48e7e7b2bda3109fd" candidate_uuid: "9a3dbec47c664435b2e96cb12b681b26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78966f88c7e0455d84f06aa75badf743"
I20260811 00:55:13.479660 17657 raft_consensus.cc:3037] T 8b9b9273c0294ec48e7e7b2bda3109fd P 0d64e51f4c7b4a0eb633ce45f85f2d2b [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:13.479697 17873 raft_consensus.cc:3037] T 8b9b9273c0294ec48e7e7b2bda3109fd P 78966f88c7e0455d84f06aa75badf743 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:13.480450 17873 raft_consensus.cc:2454] T 8b9b9273c0294ec48e7e7b2bda3109fd P 78966f88c7e0455d84f06aa75badf743 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a3dbec47c664435b2e96cb12b681b26 in term 1.
I20260811 00:55:13.480549 17657 raft_consensus.cc:2454] T 8b9b9273c0294ec48e7e7b2bda3109fd P 0d64e51f4c7b4a0eb633ce45f85f2d2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a3dbec47c664435b2e96cb12b681b26 in term 1.
I20260811 00:55:13.480664 17978 leader_election.cc:302] T 8b9b9273c0294ec48e7e7b2bda3109fd P 9a3dbec47c664435b2e96cb12b681b26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78966f88c7e0455d84f06aa75badf743, 9a3dbec47c664435b2e96cb12b681b26; no voters:
I20260811 00:55:13.480804 18209 raft_consensus.cc:2781] T 8b9b9273c0294ec48e7e7b2bda3109fd P 9a3dbec47c664435b2e96cb12b681b26 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:55:13.480979 18209 raft_consensus.cc:686] T 8b9b9273c0294ec48e7e7b2bda3109fd P 9a3dbec47c664435b2e96cb12b681b26 [term 1 LEADER]: Becoming Leader. State: Replica: 9a3dbec47c664435b2e96cb12b681b26, State: Running, Role: LEADER
I20260811 00:55:13.481081 18209 consensus_queue.cc:237] T 8b9b9273c0294ec48e7e7b2bda3109fd P 9a3dbec47c664435b2e96cb12b681b26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 44883 } } peers { permanent_uuid: "78966f88c7e0455d84f06aa75badf743" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 37553 } } peers { permanent_uuid: "9a3dbec47c664435b2e96cb12b681b26" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 39075 } }
I20260811 00:55:13.481613 18265 tablet_replica.cc:439] T 8b9b9273c0294ec48e7e7b2bda3109fd P 9a3dbec47c664435b2e96cb12b681b26: TxnStatusTablet state changed. Reason: New leader 9a3dbec47c664435b2e96cb12b681b26. Latest consensus state: current_term: 1 leader_uuid: "9a3dbec47c664435b2e96cb12b681b26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 44883 } } peers { permanent_uuid: "78966f88c7e0455d84f06aa75badf743" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 37553 } } peers { permanent_uuid: "9a3dbec47c664435b2e96cb12b681b26" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 39075 } } }
I20260811 00:55:13.481725 18265 tablet_replica.cc:442] T 8b9b9273c0294ec48e7e7b2bda3109fd P 9a3dbec47c664435b2e96cb12b681b26: This TxnStatusTablet replica's current role is: LEADER
I20260811 00:55:13.481957 18267 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 00:55:13.482142 18267 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 00:55:13.482342 17404 catalog_manager.cc:5495] T 8b9b9273c0294ec48e7e7b2bda3109fd P 9a3dbec47c664435b2e96cb12b681b26 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a3dbec47c664435b2e96cb12b681b26 (127.15.70.3). New cstate: current_term: 1 leader_uuid: "9a3dbec47c664435b2e96cb12b681b26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 44883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78966f88c7e0455d84f06aa75badf743" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 37553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a3dbec47c664435b2e96cb12b681b26" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 39075 } health_report { overall_health: HEALTHY } } }
I20260811 00:55:13.514953 18275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:13.511873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43440 (local address 127.15.70.3:39075)
0811 00:55:13.512031 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:13.512033 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:13.512040 (+ 7us) server_negotiation.cc:407] Connection header received
0811 00:55:13.512084 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:13.512084 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:13.512107 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:13.512211 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:55:13.512393 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:13.513060 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:13.513926 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:13.514167 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:13.514254 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:13.514508 (+ 254us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:55:13.514647 (+ 139us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:55:13.514736 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:13.514788 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 00:55:13.514820 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":96,"threads_started":1}
I20260811 00:55:13.514961 18253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:13.511621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:39075 (local address 127.0.0.1:43440)
0811 00:55:13.511725 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:13.511738 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:13.511781 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:13.512218 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:13.512219 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:13.512221 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 00:55:13.512308 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:13.512312 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:13.513161 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:13.513163 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:13.513817 (+ 654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:13.513819 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:13.514253 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:13.514254 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:13.514360 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:13.514382 (+ 22us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 00:55:13.514726 (+ 344us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 00:55:13.514738 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 00:55:13.514786 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 00:55:13.514867 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64}
I20260811 00:55:13.516834 17657 raft_consensus.cc:1261] T 8b9b9273c0294ec48e7e7b2bda3109fd P 0d64e51f4c7b4a0eb633ce45f85f2d2b [term 1 FOLLOWER]: Refusing update from remote peer 9a3dbec47c664435b2e96cb12b681b26: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:55:13.517146 17873 raft_consensus.cc:1261] T 8b9b9273c0294ec48e7e7b2bda3109fd P 78966f88c7e0455d84f06aa75badf743 [term 1 FOLLOWER]: Refusing update from remote peer 9a3dbec47c664435b2e96cb12b681b26: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:55:13.517506 18209 consensus_queue.cc:1035] T 8b9b9273c0294ec48e7e7b2bda3109fd P 9a3dbec47c664435b2e96cb12b681b26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 44883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:55:13.517813 18209 consensus_queue.cc:1035] T 8b9b9273c0294ec48e7e7b2bda3109fd P 9a3dbec47c664435b2e96cb12b681b26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78966f88c7e0455d84f06aa75badf743" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 37553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:55:13.518522 18204 tablet_replica.cc:439] T 8b9b9273c0294ec48e7e7b2bda3109fd P 78966f88c7e0455d84f06aa75badf743: TxnStatusTablet state changed. Reason: New leader 9a3dbec47c664435b2e96cb12b681b26. Latest consensus state: current_term: 1 leader_uuid: "9a3dbec47c664435b2e96cb12b681b26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 44883 } } peers { permanent_uuid: "78966f88c7e0455d84f06aa75badf743" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 37553 } } peers { permanent_uuid: "9a3dbec47c664435b2e96cb12b681b26" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 39075 } } }
I20260811 00:55:13.518639 18204 tablet_replica.cc:442] T 8b9b9273c0294ec48e7e7b2bda3109fd P 78966f88c7e0455d84f06aa75badf743: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 00:55:13.518712 18224 tablet_replica.cc:439] T 8b9b9273c0294ec48e7e7b2bda3109fd P 0d64e51f4c7b4a0eb633ce45f85f2d2b: TxnStatusTablet state changed. Reason: New leader 9a3dbec47c664435b2e96cb12b681b26. Latest consensus state: current_term: 1 leader_uuid: "9a3dbec47c664435b2e96cb12b681b26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 44883 } } peers { permanent_uuid: "78966f88c7e0455d84f06aa75badf743" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 37553 } } peers { permanent_uuid: "9a3dbec47c664435b2e96cb12b681b26" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 39075 } } }
I20260811 00:55:13.518813 18224 tablet_replica.cc:442] T 8b9b9273c0294ec48e7e7b2bda3109fd P 0d64e51f4c7b4a0eb633ce45f85f2d2b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 00:55:13.519620 18218 mvcc.cc:205] Tried to move back new op lower bound from 7317134186561376256 to 7317134186419273728. Current Snapshot: MvccSnapshot[applied={T|T < 7317134186561376256}]
I20260811 00:55:13.520028 18209 tablet_replica.cc:439] T 8b9b9273c0294ec48e7e7b2bda3109fd P 9a3dbec47c664435b2e96cb12b681b26: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9a3dbec47c664435b2e96cb12b681b26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 44883 } } peers { permanent_uuid: "78966f88c7e0455d84f06aa75badf743" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 37553 } } peers { permanent_uuid: "9a3dbec47c664435b2e96cb12b681b26" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 39075 } } }
I20260811 00:55:13.520139 18216 mvcc.cc:205] Tried to move back new op lower bound from 7317134186561376256 to 7317134186419273728. Current Snapshot: MvccSnapshot[applied={T|T < 7317134186561376256}]
I20260811 00:55:13.520120 18265 tablet_replica.cc:439] T 8b9b9273c0294ec48e7e7b2bda3109fd P 9a3dbec47c664435b2e96cb12b681b26: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9a3dbec47c664435b2e96cb12b681b26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 44883 } } peers { permanent_uuid: "78966f88c7e0455d84f06aa75badf743" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 37553 } } peers { permanent_uuid: "9a3dbec47c664435b2e96cb12b681b26" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 39075 } } }
I20260811 00:55:13.520210 18265 tablet_replica.cc:442] T 8b9b9273c0294ec48e7e7b2bda3109fd P 9a3dbec47c664435b2e96cb12b681b26: This TxnStatusTablet replica's current role is: LEADER
I20260811 00:55:13.520242 18224 tablet_replica.cc:439] T 8b9b9273c0294ec48e7e7b2bda3109fd P 0d64e51f4c7b4a0eb633ce45f85f2d2b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9a3dbec47c664435b2e96cb12b681b26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 44883 } } peers { permanent_uuid: "78966f88c7e0455d84f06aa75badf743" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 37553 } } peers { permanent_uuid: "9a3dbec47c664435b2e96cb12b681b26" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 39075 } } }
I20260811 00:55:13.520344 18224 tablet_replica.cc:442] T 8b9b9273c0294ec48e7e7b2bda3109fd P 0d64e51f4c7b4a0eb633ce45f85f2d2b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 00:55:13.520131 18209 tablet_replica.cc:442] T 8b9b9273c0294ec48e7e7b2bda3109fd P 9a3dbec47c664435b2e96cb12b681b26: This TxnStatusTablet replica's current role is: LEADER
I20260811 00:55:13.521257 18204 tablet_replica.cc:439] T 8b9b9273c0294ec48e7e7b2bda3109fd P 78966f88c7e0455d84f06aa75badf743: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9a3dbec47c664435b2e96cb12b681b26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d64e51f4c7b4a0eb633ce45f85f2d2b" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 44883 } } peers { permanent_uuid: "78966f88c7e0455d84f06aa75badf743" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 37553 } } peers { permanent_uuid: "9a3dbec47c664435b2e96cb12b681b26" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 39075 } } }
I20260811 00:55:13.521355 18204 tablet_replica.cc:442] T 8b9b9273c0294ec48e7e7b2bda3109fd P 78966f88c7e0455d84f06aa75badf743: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 00:55:13.521406 18217 mvcc.cc:205] Tried to move back new op lower bound from 7317134186561376256 to 7317134186419273728. Current Snapshot: MvccSnapshot[applied={T|T < 7317134186561376256 or (T in {7317134186561376256})}]
I20260811 00:55:13.528649 18288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:13.525406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:39075 (local address 127.15.70.1:41847)
0811 00:55:13.525694 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:13.525706 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:13.525805 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:13.526023 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:13.526024 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:13.526026 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 00:55:13.526098 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:13.526100 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:13.526872 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:13.526874 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:13.527649 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:13.527654 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:13.528177 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:13.528178 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:13.528244 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:13.528264 (+ 20us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 00:55:13.528467 (+ 203us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 00:55:13.528469 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 00:55:13.528506 (+ 37us) client_negotiation.cc:240] Negotiation successful
0811 00:55:13.528569 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":132,"threads_started":1}
I20260811 00:55:13.528649 18275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:13.525522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:41847 (local address 127.15.70.3:39075)
0811 00:55:13.525601 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:13.525604 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:13.525783 (+ 179us) server_negotiation.cc:407] Connection header received
0811 00:55:13.525888 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:13.525890 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:13.525903 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:13.525961 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:55:13.526178 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:13.526774 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:13.527752 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:13.528085 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:13.528170 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:13.528354 (+ 184us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:55:13.528399 (+ 45us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:55:13.528466 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:13.528510 (+ 44us) server_negotiation.cc:299] Negotiation successful
0811 00:55:13.528540 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 00:55:13.531847 18085 raft_consensus.cc:1261] T e576baef90c143ddb3403e74f481970f P 9a3dbec47c664435b2e96cb12b681b26 [term 1 FOLLOWER]: Refusing update from remote peer 0d64e51f4c7b4a0eb633ce45f85f2d2b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:55:13.531900 17873 raft_consensus.cc:1261] T e576baef90c143ddb3403e74f481970f P 78966f88c7e0455d84f06aa75badf743 [term 1 FOLLOWER]: Refusing update from remote peer 0d64e51f4c7b4a0eb633ce45f85f2d2b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:55:13.532166 18210 consensus_queue.cc:1035] T e576baef90c143ddb3403e74f481970f P 0d64e51f4c7b4a0eb633ce45f85f2d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a3dbec47c664435b2e96cb12b681b26" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 39075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:55:13.532351 18224 consensus_queue.cc:1035] T e576baef90c143ddb3403e74f481970f P 0d64e51f4c7b4a0eb633ce45f85f2d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "78966f88c7e0455d84f06aa75badf743" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 37553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:55:13.543380 18189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:13.540242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:48409 (local address 127.15.70.1:44883)
0811 00:55:13.540303 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:13.540307 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:13.540531 (+ 224us) server_negotiation.cc:407] Connection header received
0811 00:55:13.540614 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:13.540615 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:13.540632 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:13.540678 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:55:13.540863 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:13.541390 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:13.542624 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:13.542829 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:13.542887 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:13.543121 (+ 234us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:55:13.543157 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:55:13.543200 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:13.543274 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 00:55:13.543299 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 00:55:13.543447 18294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:13.540170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:44883 (local address 127.15.70.3:48409)
0811 00:55:13.540438 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:13.540451 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:13.540551 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:13.540678 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:13.540679 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:13.540681 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 00:55:13.540777 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:13.540782 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:13.541505 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:13.541506 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:13.542522 (+ 1016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:13.542527 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:13.542904 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:13.542905 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:13.542983 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:13.543036 (+ 53us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 00:55:13.543218 (+ 182us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 00:55:13.543220 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 00:55:13.543272 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 00:55:13.543328 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":184,"threads_started":1}
I20260811 00:55:13.553578 17403 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60334:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:55:13.553776 17403 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60334:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:55:13.554718 17403 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ea1cd6494c0b44adaba55aa880b1f31f: Sending DeleteTablet for 3 replicas of tablet e576baef90c143ddb3403e74f481970f
I20260811 00:55:13.555135 17844 tablet_service.cc:1514] Processing DeleteTablet for tablet e576baef90c143ddb3403e74f481970f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:55:13 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:58976
I20260811 00:55:13.555227 17626 tablet_service.cc:1514] Processing DeleteTablet for tablet e576baef90c143ddb3403e74f481970f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:55:13 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:56444
I20260811 00:55:13.555284 18231 tablet_replica.cc:330] T e576baef90c143ddb3403e74f481970f P 78966f88c7e0455d84f06aa75badf743: stopping tablet replica
I20260811 00:55:13.555343 18231 raft_consensus.cc:2229] T e576baef90c143ddb3403e74f481970f P 78966f88c7e0455d84f06aa75badf743 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:55:13.555392 18231 raft_consensus.cc:2258] T e576baef90c143ddb3403e74f481970f P 78966f88c7e0455d84f06aa75badf743 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:55:13.556012 18232 tablet_replica.cc:330] T e576baef90c143ddb3403e74f481970f P 0d64e51f4c7b4a0eb633ce45f85f2d2b: stopping tablet replica
I20260811 00:55:13.556124 18232 raft_consensus.cc:2229] T e576baef90c143ddb3403e74f481970f P 0d64e51f4c7b4a0eb633ce45f85f2d2b [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:55:13.556211 18232 raft_consensus.cc:2258] T e576baef90c143ddb3403e74f481970f P 0d64e51f4c7b4a0eb633ce45f85f2d2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:55:13.556479 18059 tablet_service.cc:1514] Processing DeleteTablet for tablet e576baef90c143ddb3403e74f481970f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:55:13 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:43424
I20260811 00:55:13.556636 18234 tablet_replica.cc:330] T e576baef90c143ddb3403e74f481970f P 9a3dbec47c664435b2e96cb12b681b26: stopping tablet replica
I20260811 00:55:13.556656 18232 ts_tablet_manager.cc:1905] T e576baef90c143ddb3403e74f481970f P 0d64e51f4c7b4a0eb633ce45f85f2d2b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:55:13.556702 18234 raft_consensus.cc:2229] T e576baef90c143ddb3403e74f481970f P 9a3dbec47c664435b2e96cb12b681b26 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:55:13.556757 18234 raft_consensus.cc:2258] T e576baef90c143ddb3403e74f481970f P 9a3dbec47c664435b2e96cb12b681b26 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:55:13.557132 18234 ts_tablet_manager.cc:1905] T e576baef90c143ddb3403e74f481970f P 9a3dbec47c664435b2e96cb12b681b26: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:55:13.557138 18231 ts_tablet_manager.cc:1905] T e576baef90c143ddb3403e74f481970f P 78966f88c7e0455d84f06aa75badf743: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:55:13.558804 18232 ts_tablet_manager.cc:1918] T e576baef90c143ddb3403e74f481970f P 0d64e51f4c7b4a0eb633ce45f85f2d2b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 00:55:13.558868 18232 log.cc:1196] T e576baef90c143ddb3403e74f481970f P 0d64e51f4c7b4a0eb633ce45f85f2d2b: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-0/wal/wals/e576baef90c143ddb3403e74f481970f
I20260811 00:55:13.559095 18234 ts_tablet_manager.cc:1918] T e576baef90c143ddb3403e74f481970f P 9a3dbec47c664435b2e96cb12b681b26: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 00:55:13.559111 18231 ts_tablet_manager.cc:1918] T e576baef90c143ddb3403e74f481970f P 78966f88c7e0455d84f06aa75badf743: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 00:55:13.559159 18232 ts_tablet_manager.cc:1939] T e576baef90c143ddb3403e74f481970f P 0d64e51f4c7b4a0eb633ce45f85f2d2b: Deleting consensus metadata
I20260811 00:55:13.559166 18231 log.cc:1196] T e576baef90c143ddb3403e74f481970f P 78966f88c7e0455d84f06aa75badf743: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-1/wal/wals/e576baef90c143ddb3403e74f481970f
I20260811 00:55:13.559163 18234 log.cc:1196] T e576baef90c143ddb3403e74f481970f P 9a3dbec47c664435b2e96cb12b681b26: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409704606556-15640-0/minicluster-data/ts-2/wal/wals/e576baef90c143ddb3403e74f481970f
I20260811 00:55:13.559448 18231 ts_tablet_manager.cc:1939] T e576baef90c143ddb3403e74f481970f P 78966f88c7e0455d84f06aa75badf743: Deleting consensus metadata
I20260811 00:55:13.559463 18234 ts_tablet_manager.cc:1939] T e576baef90c143ddb3403e74f481970f P 9a3dbec47c664435b2e96cb12b681b26: Deleting consensus metadata
I20260811 00:55:13.559685 17384 catalog_manager.cc:4841] TS 0d64e51f4c7b4a0eb633ce45f85f2d2b (127.15.70.1:44883): tablet e576baef90c143ddb3403e74f481970f (table test-table [id=52331ed586a640cfb83b2adb9f25d2b4]) successfully deleted
I20260811 00:55:13.559998 17384 catalog_manager.cc:4841] TS 9a3dbec47c664435b2e96cb12b681b26 (127.15.70.3:39075): tablet e576baef90c143ddb3403e74f481970f (table test-table [id=52331ed586a640cfb83b2adb9f25d2b4]) successfully deleted
I20260811 00:55:13.560081 17382 catalog_manager.cc:4841] TS 78966f88c7e0455d84f06aa75badf743 (127.15.70.2:37553): tablet e576baef90c143ddb3403e74f481970f (table test-table [id=52331ed586a640cfb83b2adb9f25d2b4]) successfully deleted
Aug 11 00:55:13 dist-test-slave-h3ft krb5kdc[17333](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409712, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.15.70.1@KRBTEST.COM
I20260811 00:55:13.571089 18189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:13.556249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56472 (local address 127.15.70.1:44883)
0811 00:55:13.556856 (+ 607us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:13.556860 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:13.560262 (+ 3402us) server_negotiation.cc:407] Connection header received
0811 00:55:13.560324 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:13.560325 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:13.560345 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:13.560413 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:13.561050 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:13.561783 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:13.562619 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:13.562922 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:13.563057 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:13.566652 (+ 3595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:13.566674 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:13.566675 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:13.566688 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:13.569416 (+ 2728us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:13.569885 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:13.569890 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:13.569891 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:13.569985 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:13.570264 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:13.570265 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:13.570266 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:13.570503 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:13.570702 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:13.570804 (+ 102us) server_negotiation.cc:299] Negotiation successful
0811 00:55:13.570913 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":567}
W20260811 00:55:13.571836 17717 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56472
I20260811 00:55:13.580453 18255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:13.573227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60356 (local address 127.15.70.62:44985)
0811 00:55:13.573312 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:13.573315 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:13.573326 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:55:13.573418 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:13.573419 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:13.573436 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:13.573511 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:13.574087 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:13.574685 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:13.575540 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:13.575768 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:13.575852 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:13.577332 (+ 1480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:13.577333 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:13.577334 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:13.577344 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:13.579054 (+ 1710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:13.579470 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:13.579471 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:13.579472 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:13.579548 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:13.579763 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:13.579764 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:13.579764 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:13.579917 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:13.580048 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:13.580195 (+ 147us) server_negotiation.cc:299] Negotiation successful
0811 00:55:13.580305 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
W20260811 00:55:13.580818 17403 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60356
I20260811 00:55:13.581596 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 17521
I20260811 00:55:13.614506 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 17741
I20260811 00:55:13.637547 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 17955
I20260811 00:55:13.669868 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 17357
2026-08-11T00:55:13Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (3547 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:55:13 dist-test-slave-h3ft krb5kdc[18308](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:55:13 dist-test-slave-h3ft krb5kdc[18308](info): set up 2 sockets
Aug 11 00:55:13 dist-test-slave-h3ft krb5kdc[18308](info): commencing operation
krb5kdc: starting...
W20260811 00:55:15.047930 15640 mini_kdc.cc:121] Time spent starting KDC: real 1.345s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Aug 11 00:55:15 dist-test-slave-h3ft krb5kdc[18308](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409715, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:55:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:55:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.70.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
I20260811 00:55:15.206609 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:36949
--webserver_interface=127.15.70.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:35121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:36949
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:15.305263 18326 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:15.305578 18326 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:15.305617 18326 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:15.306793 18326 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:55:15.306867 18326 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 00:55:15.306900 18326 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:15.306924 18326 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:15.306953 18326 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:55:15.306978 18326 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:55:15.308660 18326 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:35121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:36949
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:36949
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18326
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:15.309015 18326 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:15.309290 18326 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:15.315335 18343 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:15.315378 18341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:15.315335 18340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:15.315667 18326 server_base.cc:1034] running on GCE node
I20260811 00:55:15.316213 18326 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:15.316627 18326 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:15.317827 18326 hybrid_clock.cc:648] HybridClock initialized: now 1786409715317800 us; error 48 us; skew 500 ppm
Aug 11 00:55:15 dist-test-slave-h3ft krb5kdc[18308](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409715, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:15.321297 18326 init.cc:377] Logged in from keytab as kudu/127.15.70.62@KRBTEST.COM (short username kudu)
I20260811 00:55:15.321921 18326 webserver.cc:460] Webserver started at http://127.15.70.62:40047/ using document root <none> and password file <none>
I20260811 00:55:15.322233 18326 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:15.322315 18326 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:15.322503 18326 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:15.323967 18326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "b7ef8465cf0f481ca4e51342b1f5f224"
format_stamp: "Formatted at 2026-08-11 00:55:15 on dist-test-slave-h3ft"
server_key: "cddb7eb785621509c8b1565925ba4b89"
server_key_iv: "a64d145186d9821c5c2765f2154cfbe1"
server_key_version: "encryptionkey@0"
I20260811 00:55:15.324450 18326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "b7ef8465cf0f481ca4e51342b1f5f224"
format_stamp: "Formatted at 2026-08-11 00:55:15 on dist-test-slave-h3ft"
server_key: "cddb7eb785621509c8b1565925ba4b89"
server_key_iv: "a64d145186d9821c5c2765f2154cfbe1"
server_key_version: "encryptionkey@0"
I20260811 00:55:15.326148 18326 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 00:55:15.327206 18357 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:15.327414 18326 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:15.327569 18326 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "b7ef8465cf0f481ca4e51342b1f5f224"
format_stamp: "Formatted at 2026-08-11 00:55:15 on dist-test-slave-h3ft"
server_key: "cddb7eb785621509c8b1565925ba4b89"
server_key_iv: "a64d145186d9821c5c2765f2154cfbe1"
server_key_version: "encryptionkey@0"
I20260811 00:55:15.327665 18326 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:15.354094 18326 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:15.357265 18326 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:15.357479 18326 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:15.363744 18326 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:36949
I20260811 00:55:15.363795 18458 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:36949 every 8 connection(s)
I20260811 00:55:15.364245 18326 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:55:15.365070 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 18326
I20260811 00:55:15.365119 18460 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:15.365195 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 00:55:15.365406 15640 external_mini_cluster.cc:1428] Setting key e7f1549daf483f23e29b7c730f9061a3
I20260811 00:55:15.369336 18460 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b7ef8465cf0f481ca4e51342b1f5f224: Bootstrap starting.
I20260811 00:55:15.370205 18460 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b7ef8465cf0f481ca4e51342b1f5f224: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:15.370621 18460 log.cc:824] T 00000000000000000000000000000000 P b7ef8465cf0f481ca4e51342b1f5f224: Log is configured to *not* fsync() on all Append() calls
I20260811 00:55:15.371657 18460 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b7ef8465cf0f481ca4e51342b1f5f224: No bootstrap required, opened a new log
Aug 11 00:55:15 dist-test-slave-h3ft krb5kdc[18308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409715, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:15.374143 18460 raft_consensus.cc:348] T 00000000000000000000000000000000 P b7ef8465cf0f481ca4e51342b1f5f224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7ef8465cf0f481ca4e51342b1f5f224" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 36949 } }
I20260811 00:55:15.374387 18460 raft_consensus.cc:374] T 00000000000000000000000000000000 P b7ef8465cf0f481ca4e51342b1f5f224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:15.374449 18460 raft_consensus.cc:729] T 00000000000000000000000000000000 P b7ef8465cf0f481ca4e51342b1f5f224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ef8465cf0f481ca4e51342b1f5f224, State: Initialized, Role: FOLLOWER
I20260811 00:55:15.374653 18460 consensus_queue.cc:260] T 00000000000000000000000000000000 P b7ef8465cf0f481ca4e51342b1f5f224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7ef8465cf0f481ca4e51342b1f5f224" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 36949 } }
I20260811 00:55:15.374771 18460 raft_consensus.cc:388] T 00000000000000000000000000000000 P b7ef8465cf0f481ca4e51342b1f5f224 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:55:15.374815 18460 raft_consensus.cc:482] T 00000000000000000000000000000000 P b7ef8465cf0f481ca4e51342b1f5f224 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:55:15.374866 18460 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b7ef8465cf0f481ca4e51342b1f5f224 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:15.375903 18460 raft_consensus.cc:504] T 00000000000000000000000000000000 P b7ef8465cf0f481ca4e51342b1f5f224 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7ef8465cf0f481ca4e51342b1f5f224" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 36949 } }
I20260811 00:55:15.376063 18460 leader_election.cc:302] T 00000000000000000000000000000000 P b7ef8465cf0f481ca4e51342b1f5f224 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b7ef8465cf0f481ca4e51342b1f5f224; no voters:
I20260811 00:55:15.376327 18460 leader_election.cc:288] T 00000000000000000000000000000000 P b7ef8465cf0f481ca4e51342b1f5f224 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:55:15.376484 18465 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b7ef8465cf0f481ca4e51342b1f5f224 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:55:15.376673 18465 raft_consensus.cc:686] T 00000000000000000000000000000000 P b7ef8465cf0f481ca4e51342b1f5f224 [term 1 LEADER]: Becoming Leader. State: Replica: b7ef8465cf0f481ca4e51342b1f5f224, State: Running, Role: LEADER
I20260811 00:55:15.376789 18465 consensus_queue.cc:237] T 00000000000000000000000000000000 P b7ef8465cf0f481ca4e51342b1f5f224 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7ef8465cf0f481ca4e51342b1f5f224" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 36949 } }
I20260811 00:55:15.376878 18460 sys_catalog.cc:564] T 00000000000000000000000000000000 P b7ef8465cf0f481ca4e51342b1f5f224 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:55:15.377234 18465 sys_catalog.cc:455] T 00000000000000000000000000000000 P b7ef8465cf0f481ca4e51342b1f5f224 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b7ef8465cf0f481ca4e51342b1f5f224. Latest consensus state: current_term: 1 leader_uuid: "b7ef8465cf0f481ca4e51342b1f5f224" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7ef8465cf0f481ca4e51342b1f5f224" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 36949 } } }
I20260811 00:55:15.377339 18465 sys_catalog.cc:458] T 00000000000000000000000000000000 P b7ef8465cf0f481ca4e51342b1f5f224 [sys.catalog]: This master's current role is: LEADER
I20260811 00:55:15.377622 18475 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:55:15.377247 18468 sys_catalog.cc:455] T 00000000000000000000000000000000 P b7ef8465cf0f481ca4e51342b1f5f224 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b7ef8465cf0f481ca4e51342b1f5f224" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7ef8465cf0f481ca4e51342b1f5f224" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 36949 } } }
I20260811 00:55:15.377907 18468 sys_catalog.cc:458] T 00000000000000000000000000000000 P b7ef8465cf0f481ca4e51342b1f5f224 [sys.catalog]: This master's current role is: LEADER
I20260811 00:55:15.378327 18475 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:55:15.379607 18463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:15.366136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36482 (local address 127.15.70.62:36949)
0811 00:55:15.366378 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:15.366390 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:15.366433 (+ 43us) server_negotiation.cc:407] Connection header received
0811 00:55:15.367073 (+ 640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:15.367091 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:15.367173 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:15.367362 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:15.368089 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:15.369570 (+ 1481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:15.370525 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:15.371211 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:15.371379 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:15.374332 (+ 2953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:15.374338 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:15.374338 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:15.374354 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:15.377270 (+ 2916us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:15.377833 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:15.377838 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:15.377838 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:15.377976 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:15.378270 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:15.378271 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:15.378272 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:15.378655 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:15.378819 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:15.379149 (+ 330us) server_negotiation.cc:299] Negotiation successful
0811 00:55:15.379341 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":104,"threads_started":1}
I20260811 00:55:15.380673 18475 catalog_manager.cc:1347] Generated new cluster ID: 1c7cf4f6da58498b9dabe5c0d0728111
I20260811 00:55:15.380730 18475 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:55:15.386359 18475 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:55:15.386961 18475 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:55:15.390573 18475 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b7ef8465cf0f481ca4e51342b1f5f224: Generated new TSK 0
I20260811 00:55:15.390790 18475 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.70.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab.
Entry for principal kudu/127.15.70.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab.
I20260811 00:55:15.431167 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.1:0
--local_ip_for_outbound_sockets=127.15.70.1
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:36949
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:35121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:15.531569 18497 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:15.531840 18497 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:15.531872 18497 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:15.533130 18497 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:15.533187 18497 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:15.533210 18497 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 00:55:15.533222 18497 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 00:55:15.533241 18497 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.1
I20260811 00:55:15.534885 18497 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:35121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.70.1
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.70.62:36949
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18497
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.1
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:15.535234 18497 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:15.535517 18497 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:15.541697 18508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:15.541751 18505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:15.541774 18497 server_base.cc:1034] running on GCE node
W20260811 00:55:15.541688 18506 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:15.542157 18497 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:15.542461 18497 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:15.543676 18497 hybrid_clock.cc:648] HybridClock initialized: now 1786409715543666 us; error 57 us; skew 500 ppm
Aug 11 00:55:15 dist-test-slave-h3ft krb5kdc[18308](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409715, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:15.547315 18497 init.cc:377] Logged in from keytab as kudu/127.15.70.1@KRBTEST.COM (short username kudu)
I20260811 00:55:15.547917 18497 webserver.cc:460] Webserver started at http://127.15.70.1:39825/ using document root <none> and password file <none>
I20260811 00:55:15.548243 18497 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:15.548327 18497 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:15.548516 18497 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:15.549850 18497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-0/data/instance:
uuid: "1fa16116776b4850a8a29353b29663b0"
format_stamp: "Formatted at 2026-08-11 00:55:15 on dist-test-slave-h3ft"
server_key: "55b522eb5d7f506b67b530c8d6e4c63a"
server_key_iv: "3a333d520362e460ac5168eedf9ce33e"
server_key_version: "encryptionkey@0"
I20260811 00:55:15.550323 18497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance:
uuid: "1fa16116776b4850a8a29353b29663b0"
format_stamp: "Formatted at 2026-08-11 00:55:15 on dist-test-slave-h3ft"
server_key: "55b522eb5d7f506b67b530c8d6e4c63a"
server_key_iv: "3a333d520362e460ac5168eedf9ce33e"
server_key_version: "encryptionkey@0"
I20260811 00:55:15.552142 18497 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260811 00:55:15.553231 18517 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:15.553555 18497 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:15.553715 18497 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-0/wal
uuid: "1fa16116776b4850a8a29353b29663b0"
format_stamp: "Formatted at 2026-08-11 00:55:15 on dist-test-slave-h3ft"
server_key: "55b522eb5d7f506b67b530c8d6e4c63a"
server_key_iv: "3a333d520362e460ac5168eedf9ce33e"
server_key_version: "encryptionkey@0"
I20260811 00:55:15.553833 18497 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:15.564921 18497 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:15.567756 18497 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:15.567961 18497 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:15.568668 18497 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:55:15.568742 18497 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:15.568811 18497 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:55:15.568846 18497 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:15.577737 18497 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.1:33773
Aug 11 00:55:15 dist-test-slave-h3ft krb5kdc[18308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409715, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:15.577937 18695 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.1:33773 every 8 connection(s)
I20260811 00:55:15.578274 18497 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
I20260811 00:55:15.579252 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 18497
I20260811 00:55:15.579378 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance
I20260811 00:55:15.579649 15640 external_mini_cluster.cc:1428] Setting key 7f9f08c177557a414d9f1ae2fcceec10
I20260811 00:55:15.582533 18463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:15.569399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:40137 (local address 127.15.70.62:36949)
0811 00:55:15.569477 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:15.569484 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:15.569785 (+ 301us) server_negotiation.cc:407] Connection header received
0811 00:55:15.570406 (+ 621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:15.570408 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:15.570427 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:15.570529 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:15.571669 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:15.572619 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:15.574454 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:15.574892 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:15.575024 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:15.578574 (+ 3550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:15.578576 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:15.578577 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:15.578590 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:15.580716 (+ 2126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:15.581230 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:15.581232 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:15.581233 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:15.581325 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:15.581628 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:15.581629 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:15.581630 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:15.581836 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:15.581928 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:15.582228 (+ 300us) server_negotiation.cc:299] Negotiation successful
0811 00:55:15.582367 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 00:55:15.582579 18533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:15.569409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:36949 (local address 127.15.70.1:40137)
0811 00:55:15.569623 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:15.569668 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:15.570260 (+ 592us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:15.570611 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:15.570616 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:15.571124 (+ 508us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:15.571532 (+ 408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:15.571540 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:15.572746 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:15.572748 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:15.574324 (+ 1576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:15.574329 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:15.575054 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:15.575055 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:15.575229 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:15.576048 (+ 819us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:15.576064 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:15.578423 (+ 2359us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:15.580823 (+ 2400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:15.580831 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:15.580834 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:15.581135 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:15.581415 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:15.581416 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:15.581416 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:15.581553 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:15.581913 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:15.581919 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:15.582077 (+ 158us) client_negotiation.cc:769] Sending connection context
0811 00:55:15.582173 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 00:55:15.582345 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":121,"threads_started":1}
I20260811 00:55:15.583842 18696 heartbeater.cc:347] Connected to a master server at 127.15.70.62:36949
I20260811 00:55:15.583972 18696 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:15.584239 18696 heartbeater.cc:511] Master 127.15.70.62:36949 requested a full tablet report, sending...
I20260811 00:55:15.585011 18386 ts_manager.cc:194] Registered new tserver with Master: 1fa16116776b4850a8a29353b29663b0 (127.15.70.1:33773)
I20260811 00:55:15.586104 18386 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.1@KRBTEST.COM'} at 127.15.70.1:40137
WARNING: no policy specified for kudu/127.15.70.2@KRBTEST.COM; defaulting to no policy
I20260811 00:55:15.593111 18708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:15.585266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:36949 (local address 127.15.70.1:54247)
0811 00:55:15.585501 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:15.585516 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:15.585612 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:15.585826 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:15.585827 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:15.586085 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:15.586186 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:15.586189 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:15.587206 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:15.587207 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:15.587789 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:15.587791 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:15.588273 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:15.588274 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:15.588377 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:15.589070 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:15.589076 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:15.589572 (+ 496us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:15.591771 (+ 2199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:15.591774 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:15.591775 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:15.591993 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:15.592246 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:15.592247 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:15.592248 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:15.592321 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:15.592642 (+ 321us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:15.592644 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:15.592727 (+ 83us) client_negotiation.cc:769] Sending connection context
0811 00:55:15.592820 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 00:55:15.592975 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":92,"threads_started":1}
I20260811 00:55:15.593135 18463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:15.585365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:54247 (local address 127.15.70.62:36949)
0811 00:55:15.585421 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:15.585423 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:15.585581 (+ 158us) server_negotiation.cc:407] Connection header received
0811 00:55:15.585693 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:15.585694 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:15.585706 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:15.585742 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:15.586303 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:15.587011 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:15.587908 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:15.588161 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:15.588271 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:15.589705 (+ 1434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:15.589707 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:15.589707 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:15.589717 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:15.591649 (+ 1932us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:15.592085 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:15.592087 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:15.592087 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:15.592163 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:15.592394 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:15.592395 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:15.592395 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:15.592549 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:15.592656 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:15.592865 (+ 209us) server_negotiation.cc:299] Negotiation successful
0811 00:55:15.592978 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab.
Entry for principal kudu/127.15.70.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab.
I20260811 00:55:15.616104 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.2:0
--local_ip_for_outbound_sockets=127.15.70.2
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:36949
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:35121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:15.720554 18711 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:15.720888 18711 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:15.720938 18711 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:15.722366 18711 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:15.722462 18711 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:15.722501 18711 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 00:55:15.722522 18711 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 00:55:15.722551 18711 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.2
I20260811 00:55:15.724598 18711 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:35121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.70.2
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.70.62:36949
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18711
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.2
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:15.724987 18711 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:15.725325 18711 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:15.731886 18719 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:15.732077 18720 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:15.731911 18724 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:15.732452 18711 server_base.cc:1034] running on GCE node
I20260811 00:55:15.732718 18711 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:15.733012 18711 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:15.734261 18711 hybrid_clock.cc:648] HybridClock initialized: now 1786409715734237 us; error 50 us; skew 500 ppm
Aug 11 00:55:15 dist-test-slave-h3ft krb5kdc[18308](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409715, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:15.738135 18711 init.cc:377] Logged in from keytab as kudu/127.15.70.2@KRBTEST.COM (short username kudu)
I20260811 00:55:15.738936 18711 webserver.cc:460] Webserver started at http://127.15.70.2:45203/ using document root <none> and password file <none>
I20260811 00:55:15.739326 18711 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:15.739387 18711 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:15.739511 18711 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:15.740873 18711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-1/data/instance:
uuid: "0f5b853ec1244de59eed491f61954ea7"
format_stamp: "Formatted at 2026-08-11 00:55:15 on dist-test-slave-h3ft"
server_key: "999d484bcd9a454f1ba9f024e512ce40"
server_key_iv: "c0c14873820b979a5892344117426d80"
server_key_version: "encryptionkey@0"
I20260811 00:55:15.741312 18711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance:
uuid: "0f5b853ec1244de59eed491f61954ea7"
format_stamp: "Formatted at 2026-08-11 00:55:15 on dist-test-slave-h3ft"
server_key: "999d484bcd9a454f1ba9f024e512ce40"
server_key_iv: "c0c14873820b979a5892344117426d80"
server_key_version: "encryptionkey@0"
I20260811 00:55:15.742961 18711 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 00:55:15.744113 18736 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:15.744412 18711 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:15.744550 18711 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-1/wal
uuid: "0f5b853ec1244de59eed491f61954ea7"
format_stamp: "Formatted at 2026-08-11 00:55:15 on dist-test-slave-h3ft"
server_key: "999d484bcd9a454f1ba9f024e512ce40"
server_key_iv: "c0c14873820b979a5892344117426d80"
server_key_version: "encryptionkey@0"
I20260811 00:55:15.744652 18711 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:15.781072 18711 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:15.784165 18711 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:15.784381 18711 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:15.785167 18711 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:55:15.785218 18711 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:15.785245 18711 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:55:15.785259 18711 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 00:55:15 dist-test-slave-h3ft krb5kdc[18308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409715, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:15.795311 18711 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.2:39297
I20260811 00:55:15.795425 18907 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.2:39297 every 8 connection(s)
I20260811 00:55:15.795840 18711 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
I20260811 00:55:15.798156 18463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:15.785829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:59629 (local address 127.15.70.62:36949)
0811 00:55:15.785924 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:15.785927 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:15.786203 (+ 276us) server_negotiation.cc:407] Connection header received
0811 00:55:15.786898 (+ 695us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:15.786900 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:15.786919 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:15.786976 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:15.787927 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:15.788767 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:15.790865 (+ 2098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:15.791215 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:15.791309 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:15.794370 (+ 3061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:15.794372 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:15.794373 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:15.794384 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:15.796476 (+ 2092us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:15.796967 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:15.796969 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:15.796970 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:15.797045 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:15.797350 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:15.797367 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:15.797367 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:15.797518 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:15.797611 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:15.797932 (+ 321us) server_negotiation.cc:299] Negotiation successful
0811 00:55:15.798038 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 00:55:15.798370 18746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:15.785792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:36949 (local address 127.15.70.2:59629)
0811 00:55:15.786022 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:15.786079 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:15.786742 (+ 663us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:15.787115 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:15.787121 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:15.787521 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:15.787801 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:15.787808 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:15.788919 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:15.788920 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:15.790709 (+ 1789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:15.790715 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:15.791366 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:15.791367 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:15.791571 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:15.792362 (+ 791us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:15.792381 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:15.794249 (+ 1868us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:15.796599 (+ 2350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:15.796606 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:15.796609 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:15.796877 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:15.797131 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:15.797132 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:15.797132 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:15.797291 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:15.797598 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:15.797606 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:15.797779 (+ 173us) client_negotiation.cc:769] Sending connection context
0811 00:55:15.797895 (+ 116us) client_negotiation.cc:240] Negotiation successful
0811 00:55:15.798097 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":132,"threads_started":1}
I20260811 00:55:15.798982 18908 heartbeater.cc:347] Connected to a master server at 127.15.70.62:36949
I20260811 00:55:15.799113 18908 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:15.799335 18908 heartbeater.cc:511] Master 127.15.70.62:36949 requested a full tablet report, sending...
I20260811 00:55:15.799885 18385 ts_manager.cc:194] Registered new tserver with Master: 0f5b853ec1244de59eed491f61954ea7 (127.15.70.2:39297)
I20260811 00:55:15.800390 18385 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.2@KRBTEST.COM'} at 127.15.70.2:59629
I20260811 00:55:15.805066 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 18711
I20260811 00:55:15.805234 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance
I20260811 00:55:15.805488 15640 external_mini_cluster.cc:1428] Setting key b3b76261e7b06f653183da0ecf38e46a
I20260811 00:55:15.807269 18463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:15.800401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:52347 (local address 127.15.70.62:36949)
0811 00:55:15.800487 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:15.800490 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:15.800676 (+ 186us) server_negotiation.cc:407] Connection header received
0811 00:55:15.800754 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:15.800755 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:15.800767 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:15.800825 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:15.801259 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:15.801790 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:15.802621 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:15.802841 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:15.802930 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:15.804150 (+ 1220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:15.804151 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:15.804152 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:15.804160 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:15.805895 (+ 1735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:15.806275 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:15.806277 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:15.806277 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:15.806343 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:15.806570 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:15.806571 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:15.806572 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:15.806763 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:15.806850 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:15.807061 (+ 211us) server_negotiation.cc:299] Negotiation successful
0811 00:55:15.807158 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 00:55:15.807288 18914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:15.800331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:36949 (local address 127.15.70.2:52347)
0811 00:55:15.800586 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:15.800597 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:15.800693 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:15.800832 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:15.800832 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:15.801083 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:15.801173 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:15.801175 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:15.801902 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:15.801903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:15.802517 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:15.802519 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:15.802932 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:15.802934 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:15.803054 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:15.803624 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:15.803629 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:15.803970 (+ 341us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:15.805985 (+ 2015us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:15.805987 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:15.805987 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:15.806187 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:15.806417 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:15.806418 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:15.806419 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:15.806495 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:15.806840 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:15.806841 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:15.806901 (+ 60us) client_negotiation.cc:769] Sending connection context
0811 00:55:15.806988 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 00:55:15.807172 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":196,"threads_started":1}
WARNING: no policy specified for kudu/127.15.70.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab.
Entry for principal kudu/127.15.70.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab.
I20260811 00:55:15.843222 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.3:0
--local_ip_for_outbound_sockets=127.15.70.3
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:36949
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:35121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:15.950296 18922 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:15.950577 18922 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:15.950608 18922 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:15.952033 18922 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:15.952097 18922 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:15.952122 18922 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 00:55:15.952134 18922 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 00:55:15.952154 18922 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.3
I20260811 00:55:15.953913 18922 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:35121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.70.3
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.70.62:36949
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18922
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.3
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:15.954264 18922 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:15.954586 18922 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:15.961074 18929 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:15.961053 18935 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:15.961228 18922 server_base.cc:1034] running on GCE node
W20260811 00:55:15.961058 18932 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:15.961570 18922 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:15.961890 18922 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:15.963107 18922 hybrid_clock.cc:648] HybridClock initialized: now 1786409715963086 us; error 43 us; skew 500 ppm
Aug 11 00:55:15 dist-test-slave-h3ft krb5kdc[18308](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409715, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:15.966378 18922 init.cc:377] Logged in from keytab as kudu/127.15.70.3@KRBTEST.COM (short username kudu)
I20260811 00:55:15.967060 18922 webserver.cc:460] Webserver started at http://127.15.70.3:39013/ using document root <none> and password file <none>
I20260811 00:55:15.967366 18922 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:15.967451 18922 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:15.967620 18922 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:15.968890 18922 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-2/data/instance:
uuid: "6367bedaae04427d9f66c3423cd44be0"
format_stamp: "Formatted at 2026-08-11 00:55:15 on dist-test-slave-h3ft"
server_key: "b58b3f95770e0f6b17071367a6535669"
server_key_iv: "2d9bf9fece0a53cbf6431cc91896e399"
server_key_version: "encryptionkey@0"
I20260811 00:55:15.969316 18922 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance:
uuid: "6367bedaae04427d9f66c3423cd44be0"
format_stamp: "Formatted at 2026-08-11 00:55:15 on dist-test-slave-h3ft"
server_key: "b58b3f95770e0f6b17071367a6535669"
server_key_iv: "2d9bf9fece0a53cbf6431cc91896e399"
server_key_version: "encryptionkey@0"
I20260811 00:55:15.970881 18922 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260811 00:55:15.971881 18949 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:15.972189 18922 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 00:55:15.972316 18922 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-2/wal
uuid: "6367bedaae04427d9f66c3423cd44be0"
format_stamp: "Formatted at 2026-08-11 00:55:15 on dist-test-slave-h3ft"
server_key: "b58b3f95770e0f6b17071367a6535669"
server_key_iv: "2d9bf9fece0a53cbf6431cc91896e399"
server_key_version: "encryptionkey@0"
I20260811 00:55:15.972402 18922 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:15.981295 18922 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:15.984174 18922 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:15.984373 18922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:15.985168 18922 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:55:15.985231 18922 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:15.985282 18922 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:55:15.985311 18922 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 00:55:15 dist-test-slave-h3ft krb5kdc[18308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409715, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:15.996132 18922 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.3:34103
I20260811 00:55:15.996245 19138 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.3:34103 every 8 connection(s)
I20260811 00:55:15.996606 18922 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
I20260811 00:55:15.998049 18463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:15.985709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:60271 (local address 127.15.70.62:36949)
0811 00:55:15.985780 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:15.985782 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:15.986007 (+ 225us) server_negotiation.cc:407] Connection header received
0811 00:55:15.986653 (+ 646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:15.986656 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:15.986673 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:15.986753 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:15.987565 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:15.988517 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:15.989638 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:15.989981 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:15.990070 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:15.994035 (+ 3965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:15.994037 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:15.994038 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:15.994066 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:15.996258 (+ 2192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:15.996768 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:15.996771 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:15.996771 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:15.996861 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:15.997210 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:15.997211 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:15.997212 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:15.997381 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:15.997467 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:15.997840 (+ 373us) server_negotiation.cc:299] Negotiation successful
0811 00:55:15.997970 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 00:55:15.998253 18964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:15.985664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:36949 (local address 127.15.70.3:60271)
0811 00:55:15.985853 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:15.985896 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:15.986514 (+ 618us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:15.986839 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:15.986843 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:15.987215 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:15.987448 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:15.987453 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:15.988620 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:15.988621 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:15.989561 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:15.989564 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:15.990089 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:15.990091 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:15.990418 (+ 327us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:15.991240 (+ 822us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:15.991254 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:15.993910 (+ 2656us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:15.996385 (+ 2475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:15.996391 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:15.996394 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:15.996671 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:15.996945 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:15.996946 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:15.996947 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:15.997096 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:15.997467 (+ 371us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:15.997471 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:15.997621 (+ 150us) client_negotiation.cc:769] Sending connection context
0811 00:55:15.997775 (+ 154us) client_negotiation.cc:240] Negotiation successful
0811 00:55:15.997992 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":98,"threads_started":1}
I20260811 00:55:15.998831 19139 heartbeater.cc:347] Connected to a master server at 127.15.70.62:36949
I20260811 00:55:15.998974 19139 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:15.999233 19139 heartbeater.cc:511] Master 127.15.70.62:36949 requested a full tablet report, sending...
I20260811 00:55:15.999739 18385 ts_manager.cc:194] Registered new tserver with Master: 6367bedaae04427d9f66c3423cd44be0 (127.15.70.3:34103)
I20260811 00:55:16.000344 18385 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.3@KRBTEST.COM'} at 127.15.70.3:60271
I20260811 00:55:16.002333 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 18922
I20260811 00:55:16.002444 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance
I20260811 00:55:16.002657 15640 external_mini_cluster.cc:1428] Setting key 9fa115bf5d2425413d2d394d8c797c43
I20260811 00:55:16.003865 15640 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 00:55:16.006701 19146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:16.000218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:36949 (local address 127.15.70.3:52647)
0811 00:55:16.000386 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:16.000397 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:16.000484 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:16.000647 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:16.000648 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:16.000861 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:16.000923 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:16.000924 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.001632 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.001633 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:16.002239 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:16.002241 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.002705 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.002706 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:16.002791 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:16.003405 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:16.003412 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:16.003887 (+ 475us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:16.005499 (+ 1612us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:16.005500 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:16.005501 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:16.005693 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:16.005938 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:16.005939 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:16.005939 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:16.006009 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:16.006307 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:16.006308 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:16.006366 (+ 58us) client_negotiation.cc:769] Sending connection context
0811 00:55:16.006450 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 00:55:16.006590 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":100,"threads_started":1}
I20260811 00:55:16.006698 18463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:16.000293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:52647 (local address 127.15.70.62:36949)
0811 00:55:16.000380 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:16.000382 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:16.000495 (+ 113us) server_negotiation.cc:407] Connection header received
0811 00:55:16.000564 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:16.000565 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:16.000577 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:16.000633 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:16.001006 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.001521 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.002331 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.002614 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.002692 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:16.004003 (+ 1311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:16.004005 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:16.004005 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:16.004013 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:16.005384 (+ 1371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:16.005785 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:16.005787 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:16.005787 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:16.005861 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:16.006086 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:16.006087 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:16.006088 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:16.006226 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:16.006307 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:16.006496 (+ 189us) server_negotiation.cc:299] Negotiation successful
0811 00:55:16.006588 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
Aug 11 00:55:16 dist-test-slave-h3ft krb5kdc[18308](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409716, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 00:55:16 dist-test-slave-h3ft krb5kdc[18308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409716, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:16.034363 18463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:16.025791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36498 (local address 127.15.70.62:36949)
0811 00:55:16.025871 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:16.025873 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:16.025884 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:55:16.025926 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:16.025927 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:16.025938 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:16.026009 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:16.026700 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.027335 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.028139 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.028344 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.028424 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:16.031245 (+ 2821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:16.031247 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:16.031248 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:16.031256 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:16.033005 (+ 1749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:16.033413 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:16.033415 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:16.033415 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:16.033491 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:16.033708 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:16.033710 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:16.033710 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:16.033878 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:16.033997 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:16.034122 (+ 125us) server_negotiation.cc:299] Negotiation successful
0811 00:55:16.034206 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 00:55:16.036320 18385 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36498:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:55:16.038307 18385 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:55:16.046554 19165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:16.041466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46604 (local address 127.15.70.3:34103)
0811 00:55:16.042395 (+ 929us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:16.042399 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:16.042411 (+ 12us) server_negotiation.cc:407] Connection header received
0811 00:55:16.042457 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:16.042459 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:16.042477 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:16.042600 (+ 123us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:16.042903 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.044036 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.045406 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.045995 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.046105 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:16.046187 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:16.046368 (+ 181us) server_negotiation.cc:299] Negotiation successful
0811 00:55:16.046417 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":879,"thread_start_us":131,"threads_started":1}
I20260811 00:55:16.046547 19163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:16.041331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:34103 (local address 127.0.0.1:46604)
0811 00:55:16.041592 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:16.041651 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:16.041736 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:16.042701 (+ 965us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:16.042702 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:16.042705 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:16.042797 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:16.042799 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.044116 (+ 1317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.044117 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:16.045314 (+ 1197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:16.045316 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.046103 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.046104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:16.046211 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:16.046229 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 00:55:16.046343 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 00:55:16.046425 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"mutex_wait_us":40,"thread_start_us":101,"threads_started":1}
I20260811 00:55:16.046960 19167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:16.041616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37486 (local address 127.15.70.2:39297)
0811 00:55:16.041870 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:16.041876 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:16.041898 (+ 22us) server_negotiation.cc:407] Connection header received
0811 00:55:16.041950 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:16.041952 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:16.041967 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:16.042117 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:16.042346 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.043703 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.045242 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.046035 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.046114 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:16.046187 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:16.046422 (+ 235us) server_negotiation.cc:299] Negotiation successful
0811 00:55:16.046470 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":215,"thread_start_us":104,"threads_started":1}
I20260811 00:55:16.046977 19168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:16.041896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39082 (local address 127.15.70.1:33773)
0811 00:55:16.042215 (+ 319us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:16.042221 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:16.042380 (+ 159us) server_negotiation.cc:407] Connection header received
0811 00:55:16.042436 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:16.042439 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:16.042460 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:16.042535 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:16.042780 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.043710 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.045360 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.046128 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.046193 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:16.046248 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:16.046761 (+ 513us) server_negotiation.cc:299] Negotiation successful
0811 00:55:16.046822 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":227,"threads_started":1}
I20260811 00:55:16.047247 19164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:16.041331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.2:39297 (local address 127.0.0.1:37486)
0811 00:55:16.041726 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:16.041739 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:16.041805 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:16.042144 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:16.042148 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:16.042151 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:16.042246 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:16.042250 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.044130 (+ 1880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.044131 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:16.045142 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:16.045146 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.046228 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.046229 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:16.046299 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:16.046304 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 00:55:16.046354 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 00:55:16.047195 (+ 841us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":367,"mutex_wait_us":678,"thread_start_us":106,"threads_started":1}
I20260811 00:55:16.046675 19166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:16.041595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:33773 (local address 127.0.0.1:39082)
0811 00:55:16.042237 (+ 642us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:16.042249 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:16.042313 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:16.042620 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:16.042621 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:16.042624 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:16.042684 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:16.042685 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.043815 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.043816 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:16.045260 (+ 1444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:16.045264 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.046293 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.046293 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:16.046359 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:16.046363 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:55:16.046543 (+ 180us) client_negotiation.cc:240] Negotiation successful
0811 00:55:16.046604 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":618,"mutex_wait_us":65,"thread_start_us":92,"threads_started":1}
I20260811 00:55:16.048151 19035 tablet_service.cc:1467] Processing CreateTablet for tablet e39eac2a6cca4e3bb22356001fc24034 (DEFAULT_TABLE table=test-table [id=dc9a663eca2249a6a6e7962c5bdf0296]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:55:16.048175 18819 tablet_service.cc:1467] Processing CreateTablet for tablet e39eac2a6cca4e3bb22356001fc24034 (DEFAULT_TABLE table=test-table [id=dc9a663eca2249a6a6e7962c5bdf0296]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:55:16.048166 18603 tablet_service.cc:1467] Processing CreateTablet for tablet e39eac2a6cca4e3bb22356001fc24034 (DEFAULT_TABLE table=test-table [id=dc9a663eca2249a6a6e7962c5bdf0296]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:55:16.048624 18603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e39eac2a6cca4e3bb22356001fc24034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:16.048624 18819 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e39eac2a6cca4e3bb22356001fc24034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:16.048625 19035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e39eac2a6cca4e3bb22356001fc24034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:16.052158 19169 tablet_bootstrap.cc:492] T e39eac2a6cca4e3bb22356001fc24034 P 6367bedaae04427d9f66c3423cd44be0: Bootstrap starting.
I20260811 00:55:16.053252 19172 tablet_bootstrap.cc:492] T e39eac2a6cca4e3bb22356001fc24034 P 1fa16116776b4850a8a29353b29663b0: Bootstrap starting.
I20260811 00:55:16.053336 19170 tablet_bootstrap.cc:492] T e39eac2a6cca4e3bb22356001fc24034 P 0f5b853ec1244de59eed491f61954ea7: Bootstrap starting.
I20260811 00:55:16.053633 19169 tablet_bootstrap.cc:654] T e39eac2a6cca4e3bb22356001fc24034 P 6367bedaae04427d9f66c3423cd44be0: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:16.054075 19169 log.cc:824] T e39eac2a6cca4e3bb22356001fc24034 P 6367bedaae04427d9f66c3423cd44be0: Log is configured to *not* fsync() on all Append() calls
I20260811 00:55:16.054124 19172 tablet_bootstrap.cc:654] T e39eac2a6cca4e3bb22356001fc24034 P 1fa16116776b4850a8a29353b29663b0: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:16.054347 19170 tablet_bootstrap.cc:654] T e39eac2a6cca4e3bb22356001fc24034 P 0f5b853ec1244de59eed491f61954ea7: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:16.054522 19172 log.cc:824] T e39eac2a6cca4e3bb22356001fc24034 P 1fa16116776b4850a8a29353b29663b0: Log is configured to *not* fsync() on all Append() calls
I20260811 00:55:16.054771 19170 log.cc:824] T e39eac2a6cca4e3bb22356001fc24034 P 0f5b853ec1244de59eed491f61954ea7: Log is configured to *not* fsync() on all Append() calls
I20260811 00:55:16.055218 19169 tablet_bootstrap.cc:492] T e39eac2a6cca4e3bb22356001fc24034 P 6367bedaae04427d9f66c3423cd44be0: No bootstrap required, opened a new log
I20260811 00:55:16.055315 19169 ts_tablet_manager.cc:1397] T e39eac2a6cca4e3bb22356001fc24034 P 6367bedaae04427d9f66c3423cd44be0: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20260811 00:55:16.055428 19172 tablet_bootstrap.cc:492] T e39eac2a6cca4e3bb22356001fc24034 P 1fa16116776b4850a8a29353b29663b0: No bootstrap required, opened a new log
I20260811 00:55:16.055513 19172 ts_tablet_manager.cc:1397] T e39eac2a6cca4e3bb22356001fc24034 P 1fa16116776b4850a8a29353b29663b0: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 00:55:16.055665 19170 tablet_bootstrap.cc:492] T e39eac2a6cca4e3bb22356001fc24034 P 0f5b853ec1244de59eed491f61954ea7: No bootstrap required, opened a new log
I20260811 00:55:16.055747 19170 ts_tablet_manager.cc:1397] T e39eac2a6cca4e3bb22356001fc24034 P 0f5b853ec1244de59eed491f61954ea7: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 00:55:16.057435 19172 raft_consensus.cc:348] T e39eac2a6cca4e3bb22356001fc24034 P 1fa16116776b4850a8a29353b29663b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } }
I20260811 00:55:16.057619 19172 raft_consensus.cc:374] T e39eac2a6cca4e3bb22356001fc24034 P 1fa16116776b4850a8a29353b29663b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:16.057667 19172 raft_consensus.cc:729] T e39eac2a6cca4e3bb22356001fc24034 P 1fa16116776b4850a8a29353b29663b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fa16116776b4850a8a29353b29663b0, State: Initialized, Role: FOLLOWER
I20260811 00:55:16.057806 19172 consensus_queue.cc:260] T e39eac2a6cca4e3bb22356001fc24034 P 1fa16116776b4850a8a29353b29663b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } }
I20260811 00:55:16.057857 19169 raft_consensus.cc:348] T e39eac2a6cca4e3bb22356001fc24034 P 6367bedaae04427d9f66c3423cd44be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } }
I20260811 00:55:16.058051 19169 raft_consensus.cc:374] T e39eac2a6cca4e3bb22356001fc24034 P 6367bedaae04427d9f66c3423cd44be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:16.058099 19169 raft_consensus.cc:729] T e39eac2a6cca4e3bb22356001fc24034 P 6367bedaae04427d9f66c3423cd44be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6367bedaae04427d9f66c3423cd44be0, State: Initialized, Role: FOLLOWER
I20260811 00:55:16.058137 19172 ts_tablet_manager.cc:1428] T e39eac2a6cca4e3bb22356001fc24034 P 1fa16116776b4850a8a29353b29663b0: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 00:55:16.058295 18696 heartbeater.cc:503] Master 127.15.70.62:36949 was elected leader, sending a full tablet report...
I20260811 00:55:16.058214 19169 consensus_queue.cc:260] T e39eac2a6cca4e3bb22356001fc24034 P 6367bedaae04427d9f66c3423cd44be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } }
I20260811 00:55:16.058727 19170 raft_consensus.cc:348] T e39eac2a6cca4e3bb22356001fc24034 P 0f5b853ec1244de59eed491f61954ea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } }
I20260811 00:55:16.058899 19170 raft_consensus.cc:374] T e39eac2a6cca4e3bb22356001fc24034 P 0f5b853ec1244de59eed491f61954ea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:16.058916 19169 ts_tablet_manager.cc:1428] T e39eac2a6cca4e3bb22356001fc24034 P 6367bedaae04427d9f66c3423cd44be0: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260811 00:55:16.058941 19170 raft_consensus.cc:729] T e39eac2a6cca4e3bb22356001fc24034 P 0f5b853ec1244de59eed491f61954ea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f5b853ec1244de59eed491f61954ea7, State: Initialized, Role: FOLLOWER
I20260811 00:55:16.059077 19170 consensus_queue.cc:260] T e39eac2a6cca4e3bb22356001fc24034 P 0f5b853ec1244de59eed491f61954ea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } }
I20260811 00:55:16.059314 19139 heartbeater.cc:503] Master 127.15.70.62:36949 was elected leader, sending a full tablet report...
I20260811 00:55:16.059392 18908 heartbeater.cc:503] Master 127.15.70.62:36949 was elected leader, sending a full tablet report...
I20260811 00:55:16.059372 19170 ts_tablet_manager.cc:1428] T e39eac2a6cca4e3bb22356001fc24034 P 0f5b853ec1244de59eed491f61954ea7: Time spent starting tablet: real 0.004s user 0.003s sys 0.001s
W20260811 00:55:16.079456 18697 tablet.cc:2369] T e39eac2a6cca4e3bb22356001fc24034 P 1fa16116776b4850a8a29353b29663b0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 00:55:16.097875 19180 raft_consensus.cc:482] T e39eac2a6cca4e3bb22356001fc24034 P 6367bedaae04427d9f66c3423cd44be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:55:16.098150 19180 raft_consensus.cc:504] T e39eac2a6cca4e3bb22356001fc24034 P 6367bedaae04427d9f66c3423cd44be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } }
I20260811 00:55:16.098817 19180 leader_election.cc:288] T e39eac2a6cca4e3bb22356001fc24034 P 6367bedaae04427d9f66c3423cd44be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f5b853ec1244de59eed491f61954ea7 (127.15.70.2:39297), 1fa16116776b4850a8a29353b29663b0 (127.15.70.1:33773)
I20260811 00:55:16.102411 19168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:16.099299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:44833 (local address 127.15.70.1:33773)
0811 00:55:16.099402 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:16.099404 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:16.099599 (+ 195us) server_negotiation.cc:407] Connection header received
0811 00:55:16.099670 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:16.099672 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:16.099686 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:16.099747 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:16.099911 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.100461 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.101523 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.101931 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.102032 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:16.102049 (+ 17us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:16.102274 (+ 225us) server_negotiation.cc:299] Negotiation successful
0811 00:55:16.102325 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 00:55:16.102402 19167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:16.099227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:56077 (local address 127.15.70.2:39297)
0811 00:55:16.099326 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:16.099329 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:16.099346 (+ 17us) server_negotiation.cc:407] Connection header received
0811 00:55:16.099435 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:16.099437 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:16.099453 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:16.099555 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:16.099771 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.100388 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.101509 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.101917 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.102068 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:16.102083 (+ 15us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:16.102241 (+ 158us) server_negotiation.cc:299] Negotiation successful
0811 00:55:16.102298 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 00:55:16.102416 18964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:16.099130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.2:39297 (local address 127.15.70.3:56077)
0811 00:55:16.099251 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:16.099269 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:16.099350 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:16.099578 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:16.099580 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:16.099583 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:16.099671 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:16.099676 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.100492 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.100493 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:16.101385 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:16.101389 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.102076 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.102077 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:16.102164 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:16.102167 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:55:16.102212 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 00:55:16.102284 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":85,"mutex_wait_us":2}
I20260811 00:55:16.102428 19182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:16.099130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:33773 (local address 127.15.70.3:44833)
0811 00:55:16.099516 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:16.099530 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:16.099606 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:16.099769 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:16.099769 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:16.099772 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:16.099843 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:16.099844 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.100556 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.100557 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:16.101392 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:16.101394 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.102079 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.102080 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:16.102176 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:16.102179 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:55:16.102256 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 00:55:16.102298 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":368,"mutex_wait_us":149,"thread_start_us":174,"threads_started":1}
I20260811 00:55:16.102973 18847 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e39eac2a6cca4e3bb22356001fc24034" candidate_uuid: "6367bedaae04427d9f66c3423cd44be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f5b853ec1244de59eed491f61954ea7" is_pre_election: true
I20260811 00:55:16.103143 18634 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e39eac2a6cca4e3bb22356001fc24034" candidate_uuid: "6367bedaae04427d9f66c3423cd44be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fa16116776b4850a8a29353b29663b0" is_pre_election: true
I20260811 00:55:16.103245 18847 raft_consensus.cc:2454] T e39eac2a6cca4e3bb22356001fc24034 P 0f5b853ec1244de59eed491f61954ea7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6367bedaae04427d9f66c3423cd44be0 in term 0.
I20260811 00:55:16.103304 18634 raft_consensus.cc:2454] T e39eac2a6cca4e3bb22356001fc24034 P 1fa16116776b4850a8a29353b29663b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6367bedaae04427d9f66c3423cd44be0 in term 0.
I20260811 00:55:16.103586 18950 leader_election.cc:302] T e39eac2a6cca4e3bb22356001fc24034 P 6367bedaae04427d9f66c3423cd44be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f5b853ec1244de59eed491f61954ea7, 6367bedaae04427d9f66c3423cd44be0; no voters:
I20260811 00:55:16.103766 19180 raft_consensus.cc:2781] T e39eac2a6cca4e3bb22356001fc24034 P 6367bedaae04427d9f66c3423cd44be0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:55:16.103837 19180 raft_consensus.cc:482] T e39eac2a6cca4e3bb22356001fc24034 P 6367bedaae04427d9f66c3423cd44be0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:55:16.103868 19180 raft_consensus.cc:3037] T e39eac2a6cca4e3bb22356001fc24034 P 6367bedaae04427d9f66c3423cd44be0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:16.105019 19180 raft_consensus.cc:504] T e39eac2a6cca4e3bb22356001fc24034 P 6367bedaae04427d9f66c3423cd44be0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } }
I20260811 00:55:16.105206 19180 leader_election.cc:288] T e39eac2a6cca4e3bb22356001fc24034 P 6367bedaae04427d9f66c3423cd44be0 [CANDIDATE]: Term 1 election: Requested vote from peers 0f5b853ec1244de59eed491f61954ea7 (127.15.70.2:39297), 1fa16116776b4850a8a29353b29663b0 (127.15.70.1:33773)
I20260811 00:55:16.105413 18634 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e39eac2a6cca4e3bb22356001fc24034" candidate_uuid: "6367bedaae04427d9f66c3423cd44be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fa16116776b4850a8a29353b29663b0"
I20260811 00:55:16.105453 18847 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e39eac2a6cca4e3bb22356001fc24034" candidate_uuid: "6367bedaae04427d9f66c3423cd44be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f5b853ec1244de59eed491f61954ea7"
I20260811 00:55:16.105544 18634 raft_consensus.cc:3037] T e39eac2a6cca4e3bb22356001fc24034 P 1fa16116776b4850a8a29353b29663b0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:16.105578 18847 raft_consensus.cc:3037] T e39eac2a6cca4e3bb22356001fc24034 P 0f5b853ec1244de59eed491f61954ea7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:16.106480 18634 raft_consensus.cc:2454] T e39eac2a6cca4e3bb22356001fc24034 P 1fa16116776b4850a8a29353b29663b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6367bedaae04427d9f66c3423cd44be0 in term 1.
I20260811 00:55:16.106539 18847 raft_consensus.cc:2454] T e39eac2a6cca4e3bb22356001fc24034 P 0f5b853ec1244de59eed491f61954ea7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6367bedaae04427d9f66c3423cd44be0 in term 1.
I20260811 00:55:16.106729 18952 leader_election.cc:302] T e39eac2a6cca4e3bb22356001fc24034 P 6367bedaae04427d9f66c3423cd44be0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fa16116776b4850a8a29353b29663b0, 6367bedaae04427d9f66c3423cd44be0; no voters:
I20260811 00:55:16.106858 19180 raft_consensus.cc:2781] T e39eac2a6cca4e3bb22356001fc24034 P 6367bedaae04427d9f66c3423cd44be0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:55:16.107103 19180 raft_consensus.cc:686] T e39eac2a6cca4e3bb22356001fc24034 P 6367bedaae04427d9f66c3423cd44be0 [term 1 LEADER]: Becoming Leader. State: Replica: 6367bedaae04427d9f66c3423cd44be0, State: Running, Role: LEADER
I20260811 00:55:16.107251 19180 consensus_queue.cc:237] T e39eac2a6cca4e3bb22356001fc24034 P 6367bedaae04427d9f66c3423cd44be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } }
I20260811 00:55:16.108425 18386 catalog_manager.cc:5495] T e39eac2a6cca4e3bb22356001fc24034 P 6367bedaae04427d9f66c3423cd44be0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6367bedaae04427d9f66c3423cd44be0 (127.15.70.3). New cstate: current_term: 1 leader_uuid: "6367bedaae04427d9f66c3423cd44be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } health_report { overall_health: UNKNOWN } } }
Aug 11 00:55:16 dist-test-slave-h3ft krb5kdc[18308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409715, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:16.153302 19195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:16.144241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:36949 (local address 127.0.0.1:36508)
0811 00:55:16.144548 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:16.144564 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:16.144682 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:16.144872 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:16.144873 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:16.145354 (+ 481us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:16.145433 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:16.145437 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.146205 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.146206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:16.146810 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:16.146813 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.147282 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.147284 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:16.147355 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:16.148112 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:16.148118 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:16.150020 (+ 1902us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:16.152090 (+ 2070us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:16.152101 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:16.152103 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:16.152355 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:16.152572 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:16.152573 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:16.152573 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:16.152663 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:16.152923 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:16.152931 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:16.152984 (+ 53us) client_negotiation.cc:769] Sending connection context
0811 00:55:16.153043 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 00:55:16.153173 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":182,"threads_started":1}
I20260811 00:55:16.153312 18463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:16.144378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36508 (local address 127.15.70.62:36949)
0811 00:55:16.144522 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:16.144527 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:16.144653 (+ 126us) server_negotiation.cc:407] Connection header received
0811 00:55:16.144764 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:16.144765 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:16.144779 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:16.144864 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:16.145539 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.146100 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.146914 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.147190 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.147271 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:16.150129 (+ 2858us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:16.150130 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:16.150131 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:16.150139 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:16.151991 (+ 1852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:16.152431 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:16.152432 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:16.152433 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:16.152498 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:16.152727 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:16.152727 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:16.152728 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:16.152862 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:16.152920 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:16.153084 (+ 164us) server_negotiation.cc:299] Negotiation successful
0811 00:55:16.153227 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":61,"server-negotiator.queue_time_us":95}
I20260811 00:55:16.156459 18386 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:36508:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 00:55:16.156745 18386 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:55:16.159061 18819 tablet_service.cc:1467] Processing CreateTablet for tablet 3757a8af1f434787870aae009a7e6f45 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a8a826c2e611408a96d4fabd4ffd2fc0]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 00:55:16.159144 18603 tablet_service.cc:1467] Processing CreateTablet for tablet 3757a8af1f434787870aae009a7e6f45 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a8a826c2e611408a96d4fabd4ffd2fc0]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 00:55:16.159327 18603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3757a8af1f434787870aae009a7e6f45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:16.159336 18819 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3757a8af1f434787870aae009a7e6f45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:16.159389 19035 tablet_service.cc:1467] Processing CreateTablet for tablet 3757a8af1f434787870aae009a7e6f45 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a8a826c2e611408a96d4fabd4ffd2fc0]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 00:55:16.159576 19035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3757a8af1f434787870aae009a7e6f45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:16.160969 19172 tablet_bootstrap.cc:492] T 3757a8af1f434787870aae009a7e6f45 P 1fa16116776b4850a8a29353b29663b0: Bootstrap starting.
I20260811 00:55:16.161267 19170 tablet_bootstrap.cc:492] T 3757a8af1f434787870aae009a7e6f45 P 0f5b853ec1244de59eed491f61954ea7: Bootstrap starting.
I20260811 00:55:16.161507 19169 tablet_bootstrap.cc:492] T 3757a8af1f434787870aae009a7e6f45 P 6367bedaae04427d9f66c3423cd44be0: Bootstrap starting.
I20260811 00:55:16.161585 19172 tablet_bootstrap.cc:654] T 3757a8af1f434787870aae009a7e6f45 P 1fa16116776b4850a8a29353b29663b0: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:16.162149 19169 tablet_bootstrap.cc:654] T 3757a8af1f434787870aae009a7e6f45 P 6367bedaae04427d9f66c3423cd44be0: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:16.162338 19170 tablet_bootstrap.cc:654] T 3757a8af1f434787870aae009a7e6f45 P 0f5b853ec1244de59eed491f61954ea7: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:16.162636 19172 tablet_bootstrap.cc:492] T 3757a8af1f434787870aae009a7e6f45 P 1fa16116776b4850a8a29353b29663b0: No bootstrap required, opened a new log
I20260811 00:55:16.162711 19172 ts_tablet_manager.cc:1397] T 3757a8af1f434787870aae009a7e6f45 P 1fa16116776b4850a8a29353b29663b0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 00:55:16.162958 19172 raft_consensus.cc:348] T 3757a8af1f434787870aae009a7e6f45 P 1fa16116776b4850a8a29353b29663b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } }
I20260811 00:55:16.163132 19172 raft_consensus.cc:374] T 3757a8af1f434787870aae009a7e6f45 P 1fa16116776b4850a8a29353b29663b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:16.163167 19169 tablet_bootstrap.cc:492] T 3757a8af1f434787870aae009a7e6f45 P 6367bedaae04427d9f66c3423cd44be0: No bootstrap required, opened a new log
I20260811 00:55:16.163182 19172 raft_consensus.cc:729] T 3757a8af1f434787870aae009a7e6f45 P 1fa16116776b4850a8a29353b29663b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fa16116776b4850a8a29353b29663b0, State: Initialized, Role: FOLLOWER
I20260811 00:55:16.163213 19169 ts_tablet_manager.cc:1397] T 3757a8af1f434787870aae009a7e6f45 P 6367bedaae04427d9f66c3423cd44be0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 00:55:16.163245 19172 consensus_queue.cc:260] T 3757a8af1f434787870aae009a7e6f45 P 1fa16116776b4850a8a29353b29663b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } }
I20260811 00:55:16.163420 19172 ts_tablet_manager.cc:1428] T 3757a8af1f434787870aae009a7e6f45 P 1fa16116776b4850a8a29353b29663b0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:16.163461 19169 raft_consensus.cc:348] T 3757a8af1f434787870aae009a7e6f45 P 6367bedaae04427d9f66c3423cd44be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } }
I20260811 00:55:16.163576 19170 tablet_bootstrap.cc:492] T 3757a8af1f434787870aae009a7e6f45 P 0f5b853ec1244de59eed491f61954ea7: No bootstrap required, opened a new log
I20260811 00:55:16.163595 19169 raft_consensus.cc:374] T 3757a8af1f434787870aae009a7e6f45 P 6367bedaae04427d9f66c3423cd44be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:16.163625 19169 raft_consensus.cc:729] T 3757a8af1f434787870aae009a7e6f45 P 6367bedaae04427d9f66c3423cd44be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6367bedaae04427d9f66c3423cd44be0, State: Initialized, Role: FOLLOWER
I20260811 00:55:16.163640 19170 ts_tablet_manager.cc:1397] T 3757a8af1f434787870aae009a7e6f45 P 0f5b853ec1244de59eed491f61954ea7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260811 00:55:16.163689 19169 consensus_queue.cc:260] T 3757a8af1f434787870aae009a7e6f45 P 6367bedaae04427d9f66c3423cd44be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } }
I20260811 00:55:16.163805 19169 ts_tablet_manager.cc:1428] T 3757a8af1f434787870aae009a7e6f45 P 6367bedaae04427d9f66c3423cd44be0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:16.163800 19179 tablet_replica.cc:439] T 3757a8af1f434787870aae009a7e6f45 P 1fa16116776b4850a8a29353b29663b0: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } } }
I20260811 00:55:16.163925 19179 tablet_replica.cc:442] T 3757a8af1f434787870aae009a7e6f45 P 1fa16116776b4850a8a29353b29663b0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 00:55:16.163911 19170 raft_consensus.cc:348] T 3757a8af1f434787870aae009a7e6f45 P 0f5b853ec1244de59eed491f61954ea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } }
I20260811 00:55:16.164014 19170 raft_consensus.cc:374] T 3757a8af1f434787870aae009a7e6f45 P 0f5b853ec1244de59eed491f61954ea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:16.164047 19170 raft_consensus.cc:729] T 3757a8af1f434787870aae009a7e6f45 P 0f5b853ec1244de59eed491f61954ea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f5b853ec1244de59eed491f61954ea7, State: Initialized, Role: FOLLOWER
I20260811 00:55:16.164099 19170 consensus_queue.cc:260] T 3757a8af1f434787870aae009a7e6f45 P 0f5b853ec1244de59eed491f61954ea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } }
I20260811 00:55:16.164096 19180 tablet_replica.cc:439] T 3757a8af1f434787870aae009a7e6f45 P 6367bedaae04427d9f66c3423cd44be0: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } } }
I20260811 00:55:16.164171 19180 tablet_replica.cc:442] T 3757a8af1f434787870aae009a7e6f45 P 6367bedaae04427d9f66c3423cd44be0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 00:55:16.164216 19170 ts_tablet_manager.cc:1428] T 3757a8af1f434787870aae009a7e6f45 P 0f5b853ec1244de59eed491f61954ea7: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 00:55:16.164417 19181 tablet_replica.cc:439] T 3757a8af1f434787870aae009a7e6f45 P 0f5b853ec1244de59eed491f61954ea7: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } } }
I20260811 00:55:16.164551 19181 tablet_replica.cc:442] T 3757a8af1f434787870aae009a7e6f45 P 0f5b853ec1244de59eed491f61954ea7: This TxnStatusTablet replica's current role is: FOLLOWER
W20260811 00:55:16.247573 19140 tablet.cc:2369] T 3757a8af1f434787870aae009a7e6f45 P 6367bedaae04427d9f66c3423cd44be0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 00:55:16.296890 18909 tablet.cc:2369] T 3757a8af1f434787870aae009a7e6f45 P 0f5b853ec1244de59eed491f61954ea7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 00:55:16.313668 19180 raft_consensus.cc:482] T 3757a8af1f434787870aae009a7e6f45 P 6367bedaae04427d9f66c3423cd44be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:55:16.313817 19180 raft_consensus.cc:504] T 3757a8af1f434787870aae009a7e6f45 P 6367bedaae04427d9f66c3423cd44be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } }
I20260811 00:55:16.314071 19180 leader_election.cc:288] T 3757a8af1f434787870aae009a7e6f45 P 6367bedaae04427d9f66c3423cd44be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1fa16116776b4850a8a29353b29663b0 (127.15.70.1:33773), 0f5b853ec1244de59eed491f61954ea7 (127.15.70.2:39297)
I20260811 00:55:16.314430 18847 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3757a8af1f434787870aae009a7e6f45" candidate_uuid: "6367bedaae04427d9f66c3423cd44be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f5b853ec1244de59eed491f61954ea7" is_pre_election: true
I20260811 00:55:16.314414 18634 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3757a8af1f434787870aae009a7e6f45" candidate_uuid: "6367bedaae04427d9f66c3423cd44be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fa16116776b4850a8a29353b29663b0" is_pre_election: true
I20260811 00:55:16.314556 18847 raft_consensus.cc:2454] T 3757a8af1f434787870aae009a7e6f45 P 0f5b853ec1244de59eed491f61954ea7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6367bedaae04427d9f66c3423cd44be0 in term 0.
I20260811 00:55:16.314554 18634 raft_consensus.cc:2454] T 3757a8af1f434787870aae009a7e6f45 P 1fa16116776b4850a8a29353b29663b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6367bedaae04427d9f66c3423cd44be0 in term 0.
I20260811 00:55:16.314745 18952 leader_election.cc:302] T 3757a8af1f434787870aae009a7e6f45 P 6367bedaae04427d9f66c3423cd44be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fa16116776b4850a8a29353b29663b0, 6367bedaae04427d9f66c3423cd44be0; no voters:
I20260811 00:55:16.314903 19180 raft_consensus.cc:2781] T 3757a8af1f434787870aae009a7e6f45 P 6367bedaae04427d9f66c3423cd44be0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:55:16.314961 19180 raft_consensus.cc:482] T 3757a8af1f434787870aae009a7e6f45 P 6367bedaae04427d9f66c3423cd44be0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:55:16.314992 19180 raft_consensus.cc:3037] T 3757a8af1f434787870aae009a7e6f45 P 6367bedaae04427d9f66c3423cd44be0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:16.316061 19180 raft_consensus.cc:504] T 3757a8af1f434787870aae009a7e6f45 P 6367bedaae04427d9f66c3423cd44be0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } }
I20260811 00:55:16.316237 19180 leader_election.cc:288] T 3757a8af1f434787870aae009a7e6f45 P 6367bedaae04427d9f66c3423cd44be0 [CANDIDATE]: Term 1 election: Requested vote from peers 1fa16116776b4850a8a29353b29663b0 (127.15.70.1:33773), 0f5b853ec1244de59eed491f61954ea7 (127.15.70.2:39297)
I20260811 00:55:16.316473 18634 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3757a8af1f434787870aae009a7e6f45" candidate_uuid: "6367bedaae04427d9f66c3423cd44be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fa16116776b4850a8a29353b29663b0"
I20260811 00:55:16.316471 18847 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3757a8af1f434787870aae009a7e6f45" candidate_uuid: "6367bedaae04427d9f66c3423cd44be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f5b853ec1244de59eed491f61954ea7"
I20260811 00:55:16.316567 18847 raft_consensus.cc:3037] T 3757a8af1f434787870aae009a7e6f45 P 0f5b853ec1244de59eed491f61954ea7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:16.316578 18634 raft_consensus.cc:3037] T 3757a8af1f434787870aae009a7e6f45 P 1fa16116776b4850a8a29353b29663b0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:16.317358 18847 raft_consensus.cc:2454] T 3757a8af1f434787870aae009a7e6f45 P 0f5b853ec1244de59eed491f61954ea7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6367bedaae04427d9f66c3423cd44be0 in term 1.
I20260811 00:55:16.317495 18634 raft_consensus.cc:2454] T 3757a8af1f434787870aae009a7e6f45 P 1fa16116776b4850a8a29353b29663b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6367bedaae04427d9f66c3423cd44be0 in term 1.
I20260811 00:55:16.317546 18950 leader_election.cc:302] T 3757a8af1f434787870aae009a7e6f45 P 6367bedaae04427d9f66c3423cd44be0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f5b853ec1244de59eed491f61954ea7, 6367bedaae04427d9f66c3423cd44be0; no voters:
I20260811 00:55:16.317680 19180 raft_consensus.cc:2781] T 3757a8af1f434787870aae009a7e6f45 P 6367bedaae04427d9f66c3423cd44be0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:55:16.317762 19180 raft_consensus.cc:686] T 3757a8af1f434787870aae009a7e6f45 P 6367bedaae04427d9f66c3423cd44be0 [term 1 LEADER]: Becoming Leader. State: Replica: 6367bedaae04427d9f66c3423cd44be0, State: Running, Role: LEADER
I20260811 00:55:16.317830 19180 consensus_queue.cc:237] T 3757a8af1f434787870aae009a7e6f45 P 6367bedaae04427d9f66c3423cd44be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } }
I20260811 00:55:16.318216 19185 tablet_replica.cc:439] T 3757a8af1f434787870aae009a7e6f45 P 6367bedaae04427d9f66c3423cd44be0: TxnStatusTablet state changed. Reason: New leader 6367bedaae04427d9f66c3423cd44be0. Latest consensus state: current_term: 1 leader_uuid: "6367bedaae04427d9f66c3423cd44be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } } }
I20260811 00:55:16.318323 19185 tablet_replica.cc:442] T 3757a8af1f434787870aae009a7e6f45 P 6367bedaae04427d9f66c3423cd44be0: This TxnStatusTablet replica's current role is: LEADER
I20260811 00:55:16.318601 19200 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 00:55:16.318783 19200 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 00:55:16.318660 18383 catalog_manager.cc:5495] T 3757a8af1f434787870aae009a7e6f45 P 6367bedaae04427d9f66c3423cd44be0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6367bedaae04427d9f66c3423cd44be0 (127.15.70.3). New cstate: current_term: 1 leader_uuid: "6367bedaae04427d9f66c3423cd44be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } health_report { overall_health: HEALTHY } } }
I20260811 00:55:16.353717 19165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:16.350712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46618 (local address 127.15.70.3:34103)
0811 00:55:16.350797 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:16.350800 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:16.350812 (+ 12us) server_negotiation.cc:407] Connection header received
0811 00:55:16.350868 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:16.350869 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:16.350898 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:16.350985 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:55:16.351224 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.351830 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.352710 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.352989 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.353081 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:16.353302 (+ 221us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:55:16.353439 (+ 137us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:55:16.353536 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:16.353579 (+ 43us) server_negotiation.cc:299] Negotiation successful
0811 00:55:16.353607 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 00:55:16.353724 19195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:16.350500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:34103 (local address 127.0.0.1:46618)
0811 00:55:16.350608 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:16.350625 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:16.350725 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:16.351056 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:16.351058 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:16.351060 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 00:55:16.351146 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:16.351150 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.351940 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.351942 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:16.352608 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:16.352610 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.353079 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.353080 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:16.353167 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:16.353188 (+ 21us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 00:55:16.353519 (+ 331us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 00:55:16.353531 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 00:55:16.353575 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 00:55:16.353643 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260811 00:55:16.356667 18634 raft_consensus.cc:1261] T 3757a8af1f434787870aae009a7e6f45 P 1fa16116776b4850a8a29353b29663b0 [term 1 FOLLOWER]: Refusing update from remote peer 6367bedaae04427d9f66c3423cd44be0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:55:16.356667 18847 raft_consensus.cc:1261] T 3757a8af1f434787870aae009a7e6f45 P 0f5b853ec1244de59eed491f61954ea7 [term 1 FOLLOWER]: Refusing update from remote peer 6367bedaae04427d9f66c3423cd44be0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:55:16.357151 19185 consensus_queue.cc:1035] T 3757a8af1f434787870aae009a7e6f45 P 6367bedaae04427d9f66c3423cd44be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:55:16.357339 19180 consensus_queue.cc:1035] T 3757a8af1f434787870aae009a7e6f45 P 6367bedaae04427d9f66c3423cd44be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:55:16.358851 19181 tablet_replica.cc:439] T 3757a8af1f434787870aae009a7e6f45 P 0f5b853ec1244de59eed491f61954ea7: TxnStatusTablet state changed. Reason: New leader 6367bedaae04427d9f66c3423cd44be0. Latest consensus state: current_term: 1 leader_uuid: "6367bedaae04427d9f66c3423cd44be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } } }
I20260811 00:55:16.358852 19179 tablet_replica.cc:439] T 3757a8af1f434787870aae009a7e6f45 P 1fa16116776b4850a8a29353b29663b0: TxnStatusTablet state changed. Reason: New leader 6367bedaae04427d9f66c3423cd44be0. Latest consensus state: current_term: 1 leader_uuid: "6367bedaae04427d9f66c3423cd44be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } } }
I20260811 00:55:16.358973 19181 tablet_replica.cc:442] T 3757a8af1f434787870aae009a7e6f45 P 0f5b853ec1244de59eed491f61954ea7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 00:55:16.358989 19179 tablet_replica.cc:442] T 3757a8af1f434787870aae009a7e6f45 P 1fa16116776b4850a8a29353b29663b0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 00:55:16.360440 19181 tablet_replica.cc:439] T 3757a8af1f434787870aae009a7e6f45 P 0f5b853ec1244de59eed491f61954ea7: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6367bedaae04427d9f66c3423cd44be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } } }
I20260811 00:55:16.360534 19181 tablet_replica.cc:442] T 3757a8af1f434787870aae009a7e6f45 P 0f5b853ec1244de59eed491f61954ea7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 00:55:16.360482 19185 tablet_replica.cc:439] T 3757a8af1f434787870aae009a7e6f45 P 6367bedaae04427d9f66c3423cd44be0: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6367bedaae04427d9f66c3423cd44be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } } }
I20260811 00:55:16.360602 19185 tablet_replica.cc:442] T 3757a8af1f434787870aae009a7e6f45 P 6367bedaae04427d9f66c3423cd44be0: This TxnStatusTablet replica's current role is: LEADER
I20260811 00:55:16.360853 19185 tablet_replica.cc:439] T 3757a8af1f434787870aae009a7e6f45 P 6367bedaae04427d9f66c3423cd44be0: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6367bedaae04427d9f66c3423cd44be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } } }
I20260811 00:55:16.360922 19185 tablet_replica.cc:442] T 3757a8af1f434787870aae009a7e6f45 P 6367bedaae04427d9f66c3423cd44be0: This TxnStatusTablet replica's current role is: LEADER
I20260811 00:55:16.361169 19179 tablet_replica.cc:439] T 3757a8af1f434787870aae009a7e6f45 P 1fa16116776b4850a8a29353b29663b0: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6367bedaae04427d9f66c3423cd44be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } } }
I20260811 00:55:16.361256 19179 tablet_replica.cc:442] T 3757a8af1f434787870aae009a7e6f45 P 1fa16116776b4850a8a29353b29663b0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 00:55:16.361385 19204 mvcc.cc:205] Tried to move back new op lower bound from 7317134198193295360 to 7317134198038286336. Current Snapshot: MvccSnapshot[applied={T|T < 7317134198193295360}]
I20260811 00:55:16.361613 19209 mvcc.cc:205] Tried to move back new op lower bound from 7317134198193295360 to 7317134198038286336. Current Snapshot: MvccSnapshot[applied={T|T < 7317134198193295360}]
I20260811 00:55:16.362208 19212 mvcc.cc:205] Tried to move back new op lower bound from 7317134198193295360 to 7317134198038286336. Current Snapshot: MvccSnapshot[applied={T|T < 7317134198193295360}]
I20260811 00:55:16.369189 19165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:16.365748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46632 (local address 127.15.70.3:34103)
0811 00:55:16.365805 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:16.365807 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:16.365817 (+ 10us) server_negotiation.cc:407] Connection header received
0811 00:55:16.365849 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:16.365850 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:16.365863 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:16.365931 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:55:16.366108 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.366973 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.368323 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.368574 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.368666 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:16.368840 (+ 174us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:55:16.368893 (+ 53us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:55:16.368967 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:16.369051 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 00:55:16.369075 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 00:55:16.376006 19165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:16.373147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:40167 (local address 127.15.70.3:34103)
0811 00:55:16.373197 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:16.373200 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:16.373246 (+ 46us) server_negotiation.cc:407] Connection header received
0811 00:55:16.373321 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:16.373322 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:16.373333 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:16.373417 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:55:16.373604 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.374141 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.375131 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.375335 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.375422 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:16.375673 (+ 251us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:55:16.375719 (+ 46us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:55:16.375790 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:16.375851 (+ 61us) server_negotiation.cc:299] Negotiation successful
0811 00:55:16.375880 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 00:55:16.376006 19146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:16.373089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:34103 (local address 127.15.70.3:40167)
0811 00:55:16.373192 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:16.373206 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:16.373265 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:16.373418 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:16.373419 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:16.373420 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 00:55:16.373510 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:16.373512 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.374246 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.374247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:16.374972 (+ 725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:16.374974 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.375434 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.375436 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:16.375516 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:16.375559 (+ 43us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 00:55:16.375790 (+ 231us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 00:55:16.375792 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 00:55:16.375844 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 00:55:16.375898 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58,"mutex_wait_us":4}
I20260811 00:55:16.379343 18847 raft_consensus.cc:1261] T e39eac2a6cca4e3bb22356001fc24034 P 0f5b853ec1244de59eed491f61954ea7 [term 1 FOLLOWER]: Refusing update from remote peer 6367bedaae04427d9f66c3423cd44be0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:55:16.379343 18634 raft_consensus.cc:1261] T e39eac2a6cca4e3bb22356001fc24034 P 1fa16116776b4850a8a29353b29663b0 [term 1 FOLLOWER]: Refusing update from remote peer 6367bedaae04427d9f66c3423cd44be0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:55:16.379624 19219 consensus_queue.cc:1035] T e39eac2a6cca4e3bb22356001fc24034 P 6367bedaae04427d9f66c3423cd44be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:55:16.379761 19180 consensus_queue.cc:1035] T e39eac2a6cca4e3bb22356001fc24034 P 6367bedaae04427d9f66c3423cd44be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:55:16.396248 18386 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36498:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:55:16.396405 18386 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36498:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:55:16.397475 18386 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b7ef8465cf0f481ca4e51342b1f5f224: Sending DeleteTablet for 3 replicas of tablet e39eac2a6cca4e3bb22356001fc24034
I20260811 00:55:16.397878 18603 tablet_service.cc:1514] Processing DeleteTablet for tablet e39eac2a6cca4e3bb22356001fc24034 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:55:16 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:39082
I20260811 00:55:16.397907 18819 tablet_service.cc:1514] Processing DeleteTablet for tablet e39eac2a6cca4e3bb22356001fc24034 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:55:16 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:37486
I20260811 00:55:16.398307 19231 tablet_replica.cc:330] T e39eac2a6cca4e3bb22356001fc24034 P 0f5b853ec1244de59eed491f61954ea7: stopping tablet replica
I20260811 00:55:16.398252 19035 tablet_service.cc:1514] Processing DeleteTablet for tablet e39eac2a6cca4e3bb22356001fc24034 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:55:16 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:46604
I20260811 00:55:16.398469 19231 raft_consensus.cc:2229] T e39eac2a6cca4e3bb22356001fc24034 P 0f5b853ec1244de59eed491f61954ea7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:55:16.398379 18386 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36498:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 00:55:16.398551 19231 raft_consensus.cc:2258] T e39eac2a6cca4e3bb22356001fc24034 P 0f5b853ec1244de59eed491f61954ea7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 00:55:16.398599 18386 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:55:16.399302 19232 tablet_replica.cc:330] T e39eac2a6cca4e3bb22356001fc24034 P 1fa16116776b4850a8a29353b29663b0: stopping tablet replica
I20260811 00:55:16.400013 19234 tablet_replica.cc:330] T e39eac2a6cca4e3bb22356001fc24034 P 6367bedaae04427d9f66c3423cd44be0: stopping tablet replica
I20260811 00:55:16.400547 18819 tablet_service.cc:1467] Processing CreateTablet for tablet 59a28bf2351d4bfda2485b571b99a6ec (DEFAULT_TABLE table=test-table [id=727d26e555d44df18603c30dcb23aae0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:55:16.400745 18819 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59a28bf2351d4bfda2485b571b99a6ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:16.400770 18603 tablet_service.cc:1467] Processing CreateTablet for tablet 59a28bf2351d4bfda2485b571b99a6ec (DEFAULT_TABLE table=test-table [id=727d26e555d44df18603c30dcb23aae0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:55:16.400908 18603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59a28bf2351d4bfda2485b571b99a6ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:16.400918 19234 raft_consensus.cc:2229] T e39eac2a6cca4e3bb22356001fc24034 P 6367bedaae04427d9f66c3423cd44be0 [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:55:16.401160 19234 raft_consensus.cc:2258] T e39eac2a6cca4e3bb22356001fc24034 P 6367bedaae04427d9f66c3423cd44be0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:55:16.401754 19234 ts_tablet_manager.cc:1905] T e39eac2a6cca4e3bb22356001fc24034 P 6367bedaae04427d9f66c3423cd44be0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:55:16.402720 19170 tablet_bootstrap.cc:492] T 59a28bf2351d4bfda2485b571b99a6ec P 0f5b853ec1244de59eed491f61954ea7: Bootstrap starting.
I20260811 00:55:16.402823 19172 tablet_bootstrap.cc:492] T 59a28bf2351d4bfda2485b571b99a6ec P 1fa16116776b4850a8a29353b29663b0: Bootstrap starting.
I20260811 00:55:16.403313 19170 tablet_bootstrap.cc:654] T 59a28bf2351d4bfda2485b571b99a6ec P 0f5b853ec1244de59eed491f61954ea7: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:16.403378 19035 tablet_service.cc:1467] Processing CreateTablet for tablet 59a28bf2351d4bfda2485b571b99a6ec (DEFAULT_TABLE table=test-table [id=727d26e555d44df18603c30dcb23aae0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:55:16.403509 19035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59a28bf2351d4bfda2485b571b99a6ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:16.403597 19172 tablet_bootstrap.cc:654] T 59a28bf2351d4bfda2485b571b99a6ec P 1fa16116776b4850a8a29353b29663b0: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:16.404503 19234 ts_tablet_manager.cc:1918] T e39eac2a6cca4e3bb22356001fc24034 P 6367bedaae04427d9f66c3423cd44be0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 00:55:16.404608 19234 log.cc:1196] T e39eac2a6cca4e3bb22356001fc24034 P 6367bedaae04427d9f66c3423cd44be0: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-2/wal/wals/e39eac2a6cca4e3bb22356001fc24034
I20260811 00:55:16.404964 19234 ts_tablet_manager.cc:1939] T e39eac2a6cca4e3bb22356001fc24034 P 6367bedaae04427d9f66c3423cd44be0: Deleting consensus metadata
I20260811 00:55:16.405316 19169 tablet_bootstrap.cc:492] T 59a28bf2351d4bfda2485b571b99a6ec P 6367bedaae04427d9f66c3423cd44be0: Bootstrap starting.
I20260811 00:55:16.405609 18360 catalog_manager.cc:4841] TS 6367bedaae04427d9f66c3423cd44be0 (127.15.70.3:34103): tablet e39eac2a6cca4e3bb22356001fc24034 (table test-table [id=dc9a663eca2249a6a6e7962c5bdf0296]) successfully deleted
I20260811 00:55:16.405828 19169 tablet_bootstrap.cc:654] T 59a28bf2351d4bfda2485b571b99a6ec P 6367bedaae04427d9f66c3423cd44be0: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:16.406016 19231 ts_tablet_manager.cc:1905] T e39eac2a6cca4e3bb22356001fc24034 P 0f5b853ec1244de59eed491f61954ea7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:55:16.406673 19169 tablet_bootstrap.cc:492] T 59a28bf2351d4bfda2485b571b99a6ec P 6367bedaae04427d9f66c3423cd44be0: No bootstrap required, opened a new log
I20260811 00:55:16.406739 19169 ts_tablet_manager.cc:1397] T 59a28bf2351d4bfda2485b571b99a6ec P 6367bedaae04427d9f66c3423cd44be0: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:16.406960 19169 raft_consensus.cc:348] T 59a28bf2351d4bfda2485b571b99a6ec P 6367bedaae04427d9f66c3423cd44be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } }
I20260811 00:55:16.407138 19169 raft_consensus.cc:374] T 59a28bf2351d4bfda2485b571b99a6ec P 6367bedaae04427d9f66c3423cd44be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:16.407178 19169 raft_consensus.cc:729] T 59a28bf2351d4bfda2485b571b99a6ec P 6367bedaae04427d9f66c3423cd44be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6367bedaae04427d9f66c3423cd44be0, State: Initialized, Role: FOLLOWER
I20260811 00:55:16.407235 19169 consensus_queue.cc:260] T 59a28bf2351d4bfda2485b571b99a6ec P 6367bedaae04427d9f66c3423cd44be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } }
I20260811 00:55:16.407361 19169 ts_tablet_manager.cc:1428] T 59a28bf2351d4bfda2485b571b99a6ec P 6367bedaae04427d9f66c3423cd44be0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:16.407852 19172 tablet_bootstrap.cc:492] T 59a28bf2351d4bfda2485b571b99a6ec P 1fa16116776b4850a8a29353b29663b0: No bootstrap required, opened a new log
I20260811 00:55:16.407930 19172 ts_tablet_manager.cc:1397] T 59a28bf2351d4bfda2485b571b99a6ec P 1fa16116776b4850a8a29353b29663b0: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20260811 00:55:16.407953 19170 tablet_bootstrap.cc:492] T 59a28bf2351d4bfda2485b571b99a6ec P 0f5b853ec1244de59eed491f61954ea7: No bootstrap required, opened a new log
I20260811 00:55:16.408003 19170 ts_tablet_manager.cc:1397] T 59a28bf2351d4bfda2485b571b99a6ec P 0f5b853ec1244de59eed491f61954ea7: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20260811 00:55:16.408200 19170 raft_consensus.cc:348] T 59a28bf2351d4bfda2485b571b99a6ec P 0f5b853ec1244de59eed491f61954ea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } }
I20260811 00:55:16.408275 19170 raft_consensus.cc:374] T 59a28bf2351d4bfda2485b571b99a6ec P 0f5b853ec1244de59eed491f61954ea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:16.408296 19170 raft_consensus.cc:729] T 59a28bf2351d4bfda2485b571b99a6ec P 0f5b853ec1244de59eed491f61954ea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f5b853ec1244de59eed491f61954ea7, State: Initialized, Role: FOLLOWER
I20260811 00:55:16.408274 19172 raft_consensus.cc:348] T 59a28bf2351d4bfda2485b571b99a6ec P 1fa16116776b4850a8a29353b29663b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } }
I20260811 00:55:16.408349 19170 consensus_queue.cc:260] T 59a28bf2351d4bfda2485b571b99a6ec P 0f5b853ec1244de59eed491f61954ea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } }
I20260811 00:55:16.408384 19172 raft_consensus.cc:374] T 59a28bf2351d4bfda2485b571b99a6ec P 1fa16116776b4850a8a29353b29663b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:16.408417 19172 raft_consensus.cc:729] T 59a28bf2351d4bfda2485b571b99a6ec P 1fa16116776b4850a8a29353b29663b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fa16116776b4850a8a29353b29663b0, State: Initialized, Role: FOLLOWER
I20260811 00:55:16.408440 19170 ts_tablet_manager.cc:1428] T 59a28bf2351d4bfda2485b571b99a6ec P 0f5b853ec1244de59eed491f61954ea7: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:16.408488 19231 ts_tablet_manager.cc:1918] T e39eac2a6cca4e3bb22356001fc24034 P 0f5b853ec1244de59eed491f61954ea7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 00:55:16.408484 19172 consensus_queue.cc:260] T 59a28bf2351d4bfda2485b571b99a6ec P 1fa16116776b4850a8a29353b29663b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } }
I20260811 00:55:16.408567 19231 log.cc:1196] T e39eac2a6cca4e3bb22356001fc24034 P 0f5b853ec1244de59eed491f61954ea7: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-1/wal/wals/e39eac2a6cca4e3bb22356001fc24034
I20260811 00:55:16.408596 19172 ts_tablet_manager.cc:1428] T 59a28bf2351d4bfda2485b571b99a6ec P 1fa16116776b4850a8a29353b29663b0: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260811 00:55:16.408922 19231 ts_tablet_manager.cc:1939] T e39eac2a6cca4e3bb22356001fc24034 P 0f5b853ec1244de59eed491f61954ea7: Deleting consensus metadata
I20260811 00:55:16.409389 19232 raft_consensus.cc:2229] T e39eac2a6cca4e3bb22356001fc24034 P 1fa16116776b4850a8a29353b29663b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:55:16.409504 19232 raft_consensus.cc:2258] T e39eac2a6cca4e3bb22356001fc24034 P 1fa16116776b4850a8a29353b29663b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:55:16.409480 18358 catalog_manager.cc:4841] TS 0f5b853ec1244de59eed491f61954ea7 (127.15.70.2:39297): tablet e39eac2a6cca4e3bb22356001fc24034 (table test-table [id=dc9a663eca2249a6a6e7962c5bdf0296]) successfully deleted
I20260811 00:55:16.410223 19232 ts_tablet_manager.cc:1905] T e39eac2a6cca4e3bb22356001fc24034 P 1fa16116776b4850a8a29353b29663b0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:55:16.411985 19232 ts_tablet_manager.cc:1918] T e39eac2a6cca4e3bb22356001fc24034 P 1fa16116776b4850a8a29353b29663b0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 00:55:16.412077 19232 log.cc:1196] T e39eac2a6cca4e3bb22356001fc24034 P 1fa16116776b4850a8a29353b29663b0: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-0/wal/wals/e39eac2a6cca4e3bb22356001fc24034
I20260811 00:55:16.412374 19232 ts_tablet_manager.cc:1939] T e39eac2a6cca4e3bb22356001fc24034 P 1fa16116776b4850a8a29353b29663b0: Deleting consensus metadata
I20260811 00:55:16.413077 18360 catalog_manager.cc:4841] TS 1fa16116776b4850a8a29353b29663b0 (127.15.70.1:33773): tablet e39eac2a6cca4e3bb22356001fc24034 (table test-table [id=dc9a663eca2249a6a6e7962c5bdf0296]) successfully deleted
I20260811 00:55:16.567755 19179 raft_consensus.cc:482] T 59a28bf2351d4bfda2485b571b99a6ec P 1fa16116776b4850a8a29353b29663b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:55:16.567972 19179 raft_consensus.cc:504] T 59a28bf2351d4bfda2485b571b99a6ec P 1fa16116776b4850a8a29353b29663b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } }
I20260811 00:55:16.568495 19179 leader_election.cc:288] T 59a28bf2351d4bfda2485b571b99a6ec P 1fa16116776b4850a8a29353b29663b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f5b853ec1244de59eed491f61954ea7 (127.15.70.2:39297), 6367bedaae04427d9f66c3423cd44be0 (127.15.70.3:34103)
I20260811 00:55:16.572839 19167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:16.568926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:52069 (local address 127.15.70.2:39297)
0811 00:55:16.568987 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:16.568990 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:16.569090 (+ 100us) server_negotiation.cc:407] Connection header received
0811 00:55:16.569236 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:16.569237 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:16.569246 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:16.569272 (+ 26us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:16.569577 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.570349 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.571796 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.572384 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.572480 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:16.572497 (+ 17us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:16.572696 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 00:55:16.572752 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 00:55:16.572886 19246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:16.568772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.2:39297 (local address 127.15.70.1:52069)
0811 00:55:16.568949 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:16.568964 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:16.569138 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:16.569373 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:16.569374 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:16.569375 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:16.569466 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:16.569469 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.570471 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.570472 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:16.571677 (+ 1205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:16.571681 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.572491 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.572492 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:16.572584 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:16.572602 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 00:55:16.572663 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 00:55:16.572720 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"mutex_wait_us":5,"thread_start_us":89,"threads_started":1}
I20260811 00:55:16.573432 19165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:16.569048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:43097 (local address 127.15.70.3:34103)
0811 00:55:16.569102 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:16.569104 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:16.569115 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:55:16.569222 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:16.569223 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:16.569239 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:16.569324 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:16.570509 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.571240 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.572353 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.572960 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.573050 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:16.573067 (+ 17us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:16.573282 (+ 215us) server_negotiation.cc:299] Negotiation successful
0811 00:55:16.573337 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 00:55:16.573400 19245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:16.568772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:34103 (local address 127.15.70.1:43097)
0811 00:55:16.569022 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:16.569031 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:16.569125 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:16.569342 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:16.569343 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:16.569345 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:16.569467 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:16.569471 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.571346 (+ 1875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.571348 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:16.572243 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:16.572246 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.573108 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.573109 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:16.573186 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:16.573190 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:55:16.573244 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 00:55:16.573298 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"mutex_wait_us":29,"thread_start_us":69,"threads_started":1}
I20260811 00:55:16.573691 18847 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59a28bf2351d4bfda2485b571b99a6ec" candidate_uuid: "1fa16116776b4850a8a29353b29663b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f5b853ec1244de59eed491f61954ea7" is_pre_election: true
I20260811 00:55:16.573823 18847 raft_consensus.cc:2454] T 59a28bf2351d4bfda2485b571b99a6ec P 0f5b853ec1244de59eed491f61954ea7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1fa16116776b4850a8a29353b29663b0 in term 0.
I20260811 00:55:16.573935 19066 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59a28bf2351d4bfda2485b571b99a6ec" candidate_uuid: "1fa16116776b4850a8a29353b29663b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6367bedaae04427d9f66c3423cd44be0" is_pre_election: true
I20260811 00:55:16.574066 18518 leader_election.cc:302] T 59a28bf2351d4bfda2485b571b99a6ec P 1fa16116776b4850a8a29353b29663b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f5b853ec1244de59eed491f61954ea7, 1fa16116776b4850a8a29353b29663b0; no voters:
I20260811 00:55:16.574153 19066 raft_consensus.cc:2454] T 59a28bf2351d4bfda2485b571b99a6ec P 6367bedaae04427d9f66c3423cd44be0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1fa16116776b4850a8a29353b29663b0 in term 0.
I20260811 00:55:16.574255 19179 raft_consensus.cc:2781] T 59a28bf2351d4bfda2485b571b99a6ec P 1fa16116776b4850a8a29353b29663b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:55:16.574314 19179 raft_consensus.cc:482] T 59a28bf2351d4bfda2485b571b99a6ec P 1fa16116776b4850a8a29353b29663b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:55:16.574337 19179 raft_consensus.cc:3037] T 59a28bf2351d4bfda2485b571b99a6ec P 1fa16116776b4850a8a29353b29663b0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:16.575555 19179 raft_consensus.cc:504] T 59a28bf2351d4bfda2485b571b99a6ec P 1fa16116776b4850a8a29353b29663b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } }
I20260811 00:55:16.575740 19179 leader_election.cc:288] T 59a28bf2351d4bfda2485b571b99a6ec P 1fa16116776b4850a8a29353b29663b0 [CANDIDATE]: Term 1 election: Requested vote from peers 0f5b853ec1244de59eed491f61954ea7 (127.15.70.2:39297), 6367bedaae04427d9f66c3423cd44be0 (127.15.70.3:34103)
I20260811 00:55:16.575915 18847 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59a28bf2351d4bfda2485b571b99a6ec" candidate_uuid: "1fa16116776b4850a8a29353b29663b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f5b853ec1244de59eed491f61954ea7"
I20260811 00:55:16.575978 19066 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59a28bf2351d4bfda2485b571b99a6ec" candidate_uuid: "1fa16116776b4850a8a29353b29663b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6367bedaae04427d9f66c3423cd44be0"
I20260811 00:55:16.576017 18847 raft_consensus.cc:3037] T 59a28bf2351d4bfda2485b571b99a6ec P 0f5b853ec1244de59eed491f61954ea7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:16.576073 19066 raft_consensus.cc:3037] T 59a28bf2351d4bfda2485b571b99a6ec P 6367bedaae04427d9f66c3423cd44be0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:16.577085 19066 raft_consensus.cc:2454] T 59a28bf2351d4bfda2485b571b99a6ec P 6367bedaae04427d9f66c3423cd44be0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fa16116776b4850a8a29353b29663b0 in term 1.
I20260811 00:55:16.577102 18847 raft_consensus.cc:2454] T 59a28bf2351d4bfda2485b571b99a6ec P 0f5b853ec1244de59eed491f61954ea7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fa16116776b4850a8a29353b29663b0 in term 1.
I20260811 00:55:16.577291 18519 leader_election.cc:302] T 59a28bf2351d4bfda2485b571b99a6ec P 1fa16116776b4850a8a29353b29663b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fa16116776b4850a8a29353b29663b0, 6367bedaae04427d9f66c3423cd44be0; no voters:
I20260811 00:55:16.577435 19179 raft_consensus.cc:2781] T 59a28bf2351d4bfda2485b571b99a6ec P 1fa16116776b4850a8a29353b29663b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:55:16.577688 19179 raft_consensus.cc:686] T 59a28bf2351d4bfda2485b571b99a6ec P 1fa16116776b4850a8a29353b29663b0 [term 1 LEADER]: Becoming Leader. State: Replica: 1fa16116776b4850a8a29353b29663b0, State: Running, Role: LEADER
I20260811 00:55:16.577785 19179 consensus_queue.cc:237] T 59a28bf2351d4bfda2485b571b99a6ec P 1fa16116776b4850a8a29353b29663b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } }
I20260811 00:55:16.579766 18386 catalog_manager.cc:5495] T 59a28bf2351d4bfda2485b571b99a6ec P 1fa16116776b4850a8a29353b29663b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1fa16116776b4850a8a29353b29663b0 (127.15.70.1). New cstate: current_term: 1 leader_uuid: "1fa16116776b4850a8a29353b29663b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } health_report { overall_health: UNKNOWN } } }
I20260811 00:55:16.596580 19168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:16.593230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39094 (local address 127.15.70.1:33773)
0811 00:55:16.593279 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:16.593281 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:16.593312 (+ 31us) server_negotiation.cc:407] Connection header received
0811 00:55:16.593377 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:16.593378 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:16.593412 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:16.593513 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:55:16.593720 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.594637 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.595549 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.595827 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.595909 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:16.596155 (+ 246us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:55:16.596340 (+ 185us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:55:16.596420 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:16.596443 (+ 23us) server_negotiation.cc:299] Negotiation successful
0811 00:55:16.596468 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 00:55:16.603655 19165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:16.599977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:56915 (local address 127.15.70.3:34103)
0811 00:55:16.600037 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:16.600040 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:16.600256 (+ 216us) server_negotiation.cc:407] Connection header received
0811 00:55:16.600306 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:16.600307 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:16.600320 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:16.600384 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:55:16.600774 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.601598 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.602628 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.602899 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.602973 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:16.603306 (+ 333us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:55:16.603346 (+ 40us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:55:16.603404 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:16.603536 (+ 132us) server_negotiation.cc:299] Negotiation successful
0811 00:55:16.603560 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 00:55:16.603683 19257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:16.599894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:34103 (local address 127.15.70.1:56915)
0811 00:55:16.600180 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:16.600193 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:16.600255 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:16.600425 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:16.600427 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:16.600429 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 00:55:16.600668 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:16.600670 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.601720 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.601722 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:16.602522 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:16.602526 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.603049 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.603051 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:16.603154 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:16.603198 (+ 44us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 00:55:16.603450 (+ 252us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 00:55:16.603454 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:55:16.603520 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 00:55:16.603570 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":171,"threads_started":1}
I20260811 00:55:16.606655 18847 raft_consensus.cc:1261] T 59a28bf2351d4bfda2485b571b99a6ec P 0f5b853ec1244de59eed491f61954ea7 [term 1 FOLLOWER]: Refusing update from remote peer 1fa16116776b4850a8a29353b29663b0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:55:16.606688 19066 raft_consensus.cc:1261] T 59a28bf2351d4bfda2485b571b99a6ec P 6367bedaae04427d9f66c3423cd44be0 [term 1 FOLLOWER]: Refusing update from remote peer 1fa16116776b4850a8a29353b29663b0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:55:16.607123 19248 consensus_queue.cc:1035] T 59a28bf2351d4bfda2485b571b99a6ec P 1fa16116776b4850a8a29353b29663b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:55:16.607290 19179 consensus_queue.cc:1035] T 59a28bf2351d4bfda2485b571b99a6ec P 1fa16116776b4850a8a29353b29663b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:55:16.616812 19146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:16.614039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:33773 (local address 127.15.70.3:55521)
0811 00:55:16.614090 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:16.614104 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:16.614155 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:16.614368 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:16.614369 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:16.614371 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 00:55:16.614440 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:16.614442 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.615267 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.615268 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:16.615959 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:16.615963 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.616337 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.616338 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:16.616400 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:16.616406 (+ 6us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 00:55:16.616615 (+ 209us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 00:55:16.616618 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:55:16.616672 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 00:55:16.616737 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
I20260811 00:55:16.616794 19168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:16.614118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:55521 (local address 127.15.70.1:33773)
0811 00:55:16.614238 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:16.614241 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:16.614249 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:55:16.614276 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:16.614277 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:16.614292 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:16.614371 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:55:16.614524 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.615177 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.616026 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:16.616247 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:16.616339 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:16.616500 (+ 161us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:55:16.616541 (+ 41us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:55:16.616613 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:16.616677 (+ 64us) server_negotiation.cc:299] Negotiation successful
0811 00:55:16.616699 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
W20260811 00:55:16.617271 19209 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 00:55:18.149366 18386 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36498:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:55:18.149559 18386 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36498:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:55:18.150694 18386 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b7ef8465cf0f481ca4e51342b1f5f224: Sending DeleteTablet for 3 replicas of tablet 59a28bf2351d4bfda2485b571b99a6ec
I20260811 00:55:18.151119 18819 tablet_service.cc:1514] Processing DeleteTablet for tablet 59a28bf2351d4bfda2485b571b99a6ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:55:18 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:37486
I20260811 00:55:18.151116 18603 tablet_service.cc:1514] Processing DeleteTablet for tablet 59a28bf2351d4bfda2485b571b99a6ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:55:18 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:39082
I20260811 00:55:18.151146 19035 tablet_service.cc:1514] Processing DeleteTablet for tablet 59a28bf2351d4bfda2485b571b99a6ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:55:18 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:46604
I20260811 00:55:18.151921 19298 tablet_replica.cc:330] T 59a28bf2351d4bfda2485b571b99a6ec P 0f5b853ec1244de59eed491f61954ea7: stopping tablet replica
I20260811 00:55:18.152024 19298 raft_consensus.cc:2229] T 59a28bf2351d4bfda2485b571b99a6ec P 0f5b853ec1244de59eed491f61954ea7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:55:18.152084 19298 raft_consensus.cc:2258] T 59a28bf2351d4bfda2485b571b99a6ec P 0f5b853ec1244de59eed491f61954ea7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:55:18.152396 19298 ts_tablet_manager.cc:1905] T 59a28bf2351d4bfda2485b571b99a6ec P 0f5b853ec1244de59eed491f61954ea7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:55:18.154600 19297 tablet_replica.cc:330] T 59a28bf2351d4bfda2485b571b99a6ec P 6367bedaae04427d9f66c3423cd44be0: stopping tablet replica
I20260811 00:55:18.154728 19297 raft_consensus.cc:2229] T 59a28bf2351d4bfda2485b571b99a6ec P 6367bedaae04427d9f66c3423cd44be0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:55:18.154788 19297 raft_consensus.cc:2258] T 59a28bf2351d4bfda2485b571b99a6ec P 6367bedaae04427d9f66c3423cd44be0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:55:18.155123 19296 tablet_replica.cc:330] T 59a28bf2351d4bfda2485b571b99a6ec P 1fa16116776b4850a8a29353b29663b0: stopping tablet replica
I20260811 00:55:18.155215 19296 raft_consensus.cc:2229] T 59a28bf2351d4bfda2485b571b99a6ec P 1fa16116776b4850a8a29353b29663b0 [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:55:18.155355 19296 raft_consensus.cc:2258] T 59a28bf2351d4bfda2485b571b99a6ec P 1fa16116776b4850a8a29353b29663b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:55:18.155666 19296 ts_tablet_manager.cc:1905] T 59a28bf2351d4bfda2485b571b99a6ec P 1fa16116776b4850a8a29353b29663b0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:55:18.155712 19297 ts_tablet_manager.cc:1905] T 59a28bf2351d4bfda2485b571b99a6ec P 6367bedaae04427d9f66c3423cd44be0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:55:18.157840 19296 ts_tablet_manager.cc:1918] T 59a28bf2351d4bfda2485b571b99a6ec P 1fa16116776b4850a8a29353b29663b0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 00:55:18.157876 19297 ts_tablet_manager.cc:1918] T 59a28bf2351d4bfda2485b571b99a6ec P 6367bedaae04427d9f66c3423cd44be0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 00:55:18.157945 19297 log.cc:1196] T 59a28bf2351d4bfda2485b571b99a6ec P 6367bedaae04427d9f66c3423cd44be0: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-2/wal/wals/59a28bf2351d4bfda2485b571b99a6ec
I20260811 00:55:18.157945 19296 log.cc:1196] T 59a28bf2351d4bfda2485b571b99a6ec P 1fa16116776b4850a8a29353b29663b0: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-0/wal/wals/59a28bf2351d4bfda2485b571b99a6ec
I20260811 00:55:18.158214 19297 ts_tablet_manager.cc:1939] T 59a28bf2351d4bfda2485b571b99a6ec P 6367bedaae04427d9f66c3423cd44be0: Deleting consensus metadata
I20260811 00:55:18.158226 19296 ts_tablet_manager.cc:1939] T 59a28bf2351d4bfda2485b571b99a6ec P 1fa16116776b4850a8a29353b29663b0: Deleting consensus metadata
I20260811 00:55:18.158885 18360 catalog_manager.cc:4841] TS 1fa16116776b4850a8a29353b29663b0 (127.15.70.1:33773): tablet 59a28bf2351d4bfda2485b571b99a6ec (table test-table [id=727d26e555d44df18603c30dcb23aae0]) successfully deleted
I20260811 00:55:18.159082 18360 catalog_manager.cc:4841] TS 6367bedaae04427d9f66c3423cd44be0 (127.15.70.3:34103): tablet 59a28bf2351d4bfda2485b571b99a6ec (table test-table [id=727d26e555d44df18603c30dcb23aae0]) successfully deleted
I20260811 00:55:18.162355 19298 ts_tablet_manager.cc:1918] T 59a28bf2351d4bfda2485b571b99a6ec P 0f5b853ec1244de59eed491f61954ea7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 00:55:18.162475 19298 log.cc:1196] T 59a28bf2351d4bfda2485b571b99a6ec P 0f5b853ec1244de59eed491f61954ea7: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-1/wal/wals/59a28bf2351d4bfda2485b571b99a6ec
I20260811 00:55:18.162832 19298 ts_tablet_manager.cc:1939] T 59a28bf2351d4bfda2485b571b99a6ec P 0f5b853ec1244de59eed491f61954ea7: Deleting consensus metadata
I20260811 00:55:18.163408 18358 catalog_manager.cc:4841] TS 0f5b853ec1244de59eed491f61954ea7 (127.15.70.2:39297): tablet 59a28bf2351d4bfda2485b571b99a6ec (table test-table [id=727d26e555d44df18603c30dcb23aae0]) successfully deleted
Aug 11 00:55:18 dist-test-slave-h3ft krb5kdc[18308](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409718, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 00:55:18 dist-test-slave-h3ft krb5kdc[18308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409718, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:18.192413 19311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:18.176923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36514 (local address 127.15.70.62:36949)
0811 00:55:18.177171 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:18.177174 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:18.177187 (+ 13us) server_negotiation.cc:407] Connection header received
0811 00:55:18.177223 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:18.177224 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:18.177238 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:18.177326 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:18.178340 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:18.178963 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:18.179897 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:18.180278 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:18.180371 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:18.188394 (+ 8023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:18.188398 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:18.188398 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:18.188412 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:18.190609 (+ 2197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:18.191259 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:18.191261 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:18.191262 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:18.191353 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:18.191616 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:18.191617 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:18.191618 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:18.191790 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:18.191938 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:18.192099 (+ 161us) server_negotiation.cc:299] Negotiation successful
0811 00:55:18.192230 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":159,"threads_started":1}
I20260811 00:55:18.194414 18386 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36514:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:55:18.194641 18386 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:55:18.196951 19035 tablet_service.cc:1467] Processing CreateTablet for tablet d1f219d76a9443c0b07965092eaeeb0a (DEFAULT_TABLE table=test-table [id=861f9ef438aa48f6abb47fbde346c2da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:55:18.196949 18603 tablet_service.cc:1467] Processing CreateTablet for tablet d1f219d76a9443c0b07965092eaeeb0a (DEFAULT_TABLE table=test-table [id=861f9ef438aa48f6abb47fbde346c2da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:55:18.196950 18819 tablet_service.cc:1467] Processing CreateTablet for tablet d1f219d76a9443c0b07965092eaeeb0a (DEFAULT_TABLE table=test-table [id=861f9ef438aa48f6abb47fbde346c2da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:55:18.197176 18819 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1f219d76a9443c0b07965092eaeeb0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:18.197177 19035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1f219d76a9443c0b07965092eaeeb0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:18.197182 18603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1f219d76a9443c0b07965092eaeeb0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:18.198995 19312 tablet_bootstrap.cc:492] T d1f219d76a9443c0b07965092eaeeb0a P 1fa16116776b4850a8a29353b29663b0: Bootstrap starting.
I20260811 00:55:18.199188 19315 tablet_bootstrap.cc:492] T d1f219d76a9443c0b07965092eaeeb0a P 6367bedaae04427d9f66c3423cd44be0: Bootstrap starting.
I20260811 00:55:18.199553 19312 tablet_bootstrap.cc:654] T d1f219d76a9443c0b07965092eaeeb0a P 1fa16116776b4850a8a29353b29663b0: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:18.199672 19315 tablet_bootstrap.cc:654] T d1f219d76a9443c0b07965092eaeeb0a P 6367bedaae04427d9f66c3423cd44be0: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:18.200004 19314 tablet_bootstrap.cc:492] T d1f219d76a9443c0b07965092eaeeb0a P 0f5b853ec1244de59eed491f61954ea7: Bootstrap starting.
I20260811 00:55:18.200424 19312 tablet_bootstrap.cc:492] T d1f219d76a9443c0b07965092eaeeb0a P 1fa16116776b4850a8a29353b29663b0: No bootstrap required, opened a new log
I20260811 00:55:18.200497 19312 ts_tablet_manager.cc:1397] T d1f219d76a9443c0b07965092eaeeb0a P 1fa16116776b4850a8a29353b29663b0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 00:55:18.200551 19315 tablet_bootstrap.cc:492] T d1f219d76a9443c0b07965092eaeeb0a P 6367bedaae04427d9f66c3423cd44be0: No bootstrap required, opened a new log
I20260811 00:55:18.200613 19315 ts_tablet_manager.cc:1397] T d1f219d76a9443c0b07965092eaeeb0a P 6367bedaae04427d9f66c3423cd44be0: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:18.200677 19312 raft_consensus.cc:348] T d1f219d76a9443c0b07965092eaeeb0a P 1fa16116776b4850a8a29353b29663b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } }
I20260811 00:55:18.200784 19312 raft_consensus.cc:374] T d1f219d76a9443c0b07965092eaeeb0a P 1fa16116776b4850a8a29353b29663b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:18.200806 19312 raft_consensus.cc:729] T d1f219d76a9443c0b07965092eaeeb0a P 1fa16116776b4850a8a29353b29663b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fa16116776b4850a8a29353b29663b0, State: Initialized, Role: FOLLOWER
I20260811 00:55:18.200770 19315 raft_consensus.cc:348] T d1f219d76a9443c0b07965092eaeeb0a P 6367bedaae04427d9f66c3423cd44be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } }
I20260811 00:55:18.200858 19315 raft_consensus.cc:374] T d1f219d76a9443c0b07965092eaeeb0a P 6367bedaae04427d9f66c3423cd44be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:18.200881 19315 raft_consensus.cc:729] T d1f219d76a9443c0b07965092eaeeb0a P 6367bedaae04427d9f66c3423cd44be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6367bedaae04427d9f66c3423cd44be0, State: Initialized, Role: FOLLOWER
I20260811 00:55:18.200858 19312 consensus_queue.cc:260] T d1f219d76a9443c0b07965092eaeeb0a P 1fa16116776b4850a8a29353b29663b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } }
I20260811 00:55:18.200937 19315 consensus_queue.cc:260] T d1f219d76a9443c0b07965092eaeeb0a P 6367bedaae04427d9f66c3423cd44be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } }
I20260811 00:55:18.201007 19312 ts_tablet_manager.cc:1428] T d1f219d76a9443c0b07965092eaeeb0a P 1fa16116776b4850a8a29353b29663b0: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 00:55:18.201049 19315 ts_tablet_manager.cc:1428] T d1f219d76a9443c0b07965092eaeeb0a P 6367bedaae04427d9f66c3423cd44be0: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 00:55:18.201447 19314 tablet_bootstrap.cc:654] T d1f219d76a9443c0b07965092eaeeb0a P 0f5b853ec1244de59eed491f61954ea7: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:18.202354 19314 tablet_bootstrap.cc:492] T d1f219d76a9443c0b07965092eaeeb0a P 0f5b853ec1244de59eed491f61954ea7: No bootstrap required, opened a new log
I20260811 00:55:18.202407 19314 ts_tablet_manager.cc:1397] T d1f219d76a9443c0b07965092eaeeb0a P 0f5b853ec1244de59eed491f61954ea7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 00:55:18.202529 19314 raft_consensus.cc:348] T d1f219d76a9443c0b07965092eaeeb0a P 0f5b853ec1244de59eed491f61954ea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } }
I20260811 00:55:18.202629 19314 raft_consensus.cc:374] T d1f219d76a9443c0b07965092eaeeb0a P 0f5b853ec1244de59eed491f61954ea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:18.202652 19314 raft_consensus.cc:729] T d1f219d76a9443c0b07965092eaeeb0a P 0f5b853ec1244de59eed491f61954ea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f5b853ec1244de59eed491f61954ea7, State: Initialized, Role: FOLLOWER
I20260811 00:55:18.202730 19314 consensus_queue.cc:260] T d1f219d76a9443c0b07965092eaeeb0a P 0f5b853ec1244de59eed491f61954ea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } }
I20260811 00:55:18.202971 19314 ts_tablet_manager.cc:1428] T d1f219d76a9443c0b07965092eaeeb0a P 0f5b853ec1244de59eed491f61954ea7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:18.354566 19288 raft_consensus.cc:482] T d1f219d76a9443c0b07965092eaeeb0a P 1fa16116776b4850a8a29353b29663b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:55:18.354776 19288 raft_consensus.cc:504] T d1f219d76a9443c0b07965092eaeeb0a P 1fa16116776b4850a8a29353b29663b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } }
I20260811 00:55:18.355108 19288 leader_election.cc:288] T d1f219d76a9443c0b07965092eaeeb0a P 1fa16116776b4850a8a29353b29663b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f5b853ec1244de59eed491f61954ea7 (127.15.70.2:39297), 6367bedaae04427d9f66c3423cd44be0 (127.15.70.3:34103)
I20260811 00:55:18.355471 19066 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1f219d76a9443c0b07965092eaeeb0a" candidate_uuid: "1fa16116776b4850a8a29353b29663b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6367bedaae04427d9f66c3423cd44be0" is_pre_election: true
I20260811 00:55:18.355470 18847 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1f219d76a9443c0b07965092eaeeb0a" candidate_uuid: "1fa16116776b4850a8a29353b29663b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f5b853ec1244de59eed491f61954ea7" is_pre_election: true
I20260811 00:55:18.355634 18847 raft_consensus.cc:2454] T d1f219d76a9443c0b07965092eaeeb0a P 0f5b853ec1244de59eed491f61954ea7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1fa16116776b4850a8a29353b29663b0 in term 0.
I20260811 00:55:18.355633 19066 raft_consensus.cc:2454] T d1f219d76a9443c0b07965092eaeeb0a P 6367bedaae04427d9f66c3423cd44be0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1fa16116776b4850a8a29353b29663b0 in term 0.
I20260811 00:55:18.355844 18519 leader_election.cc:302] T d1f219d76a9443c0b07965092eaeeb0a P 1fa16116776b4850a8a29353b29663b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fa16116776b4850a8a29353b29663b0, 6367bedaae04427d9f66c3423cd44be0; no voters:
I20260811 00:55:18.356027 19288 raft_consensus.cc:2781] T d1f219d76a9443c0b07965092eaeeb0a P 1fa16116776b4850a8a29353b29663b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:55:18.356101 19288 raft_consensus.cc:482] T d1f219d76a9443c0b07965092eaeeb0a P 1fa16116776b4850a8a29353b29663b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:55:18.356137 19288 raft_consensus.cc:3037] T d1f219d76a9443c0b07965092eaeeb0a P 1fa16116776b4850a8a29353b29663b0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:18.357141 19288 raft_consensus.cc:504] T d1f219d76a9443c0b07965092eaeeb0a P 1fa16116776b4850a8a29353b29663b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } }
I20260811 00:55:18.357329 19288 leader_election.cc:288] T d1f219d76a9443c0b07965092eaeeb0a P 1fa16116776b4850a8a29353b29663b0 [CANDIDATE]: Term 1 election: Requested vote from peers 0f5b853ec1244de59eed491f61954ea7 (127.15.70.2:39297), 6367bedaae04427d9f66c3423cd44be0 (127.15.70.3:34103)
I20260811 00:55:18.357601 19066 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1f219d76a9443c0b07965092eaeeb0a" candidate_uuid: "1fa16116776b4850a8a29353b29663b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6367bedaae04427d9f66c3423cd44be0"
I20260811 00:55:18.357601 18847 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1f219d76a9443c0b07965092eaeeb0a" candidate_uuid: "1fa16116776b4850a8a29353b29663b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f5b853ec1244de59eed491f61954ea7"
I20260811 00:55:18.357733 19066 raft_consensus.cc:3037] T d1f219d76a9443c0b07965092eaeeb0a P 6367bedaae04427d9f66c3423cd44be0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:18.357733 18847 raft_consensus.cc:3037] T d1f219d76a9443c0b07965092eaeeb0a P 0f5b853ec1244de59eed491f61954ea7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:18.358755 18847 raft_consensus.cc:2454] T d1f219d76a9443c0b07965092eaeeb0a P 0f5b853ec1244de59eed491f61954ea7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fa16116776b4850a8a29353b29663b0 in term 1.
I20260811 00:55:18.358785 19066 raft_consensus.cc:2454] T d1f219d76a9443c0b07965092eaeeb0a P 6367bedaae04427d9f66c3423cd44be0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fa16116776b4850a8a29353b29663b0 in term 1.
I20260811 00:55:18.358989 18519 leader_election.cc:302] T d1f219d76a9443c0b07965092eaeeb0a P 1fa16116776b4850a8a29353b29663b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fa16116776b4850a8a29353b29663b0, 6367bedaae04427d9f66c3423cd44be0; no voters:
I20260811 00:55:18.359184 19288 raft_consensus.cc:2781] T d1f219d76a9443c0b07965092eaeeb0a P 1fa16116776b4850a8a29353b29663b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:55:18.359246 19288 raft_consensus.cc:686] T d1f219d76a9443c0b07965092eaeeb0a P 1fa16116776b4850a8a29353b29663b0 [term 1 LEADER]: Becoming Leader. State: Replica: 1fa16116776b4850a8a29353b29663b0, State: Running, Role: LEADER
I20260811 00:55:18.359329 19288 consensus_queue.cc:237] T d1f219d76a9443c0b07965092eaeeb0a P 1fa16116776b4850a8a29353b29663b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } }
I20260811 00:55:18.360256 18383 catalog_manager.cc:5495] T d1f219d76a9443c0b07965092eaeeb0a P 1fa16116776b4850a8a29353b29663b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1fa16116776b4850a8a29353b29663b0 (127.15.70.1). New cstate: current_term: 1 leader_uuid: "1fa16116776b4850a8a29353b29663b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } health_report { overall_health: UNKNOWN } } }
I20260811 00:55:18.391083 19326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:18.388282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39106 (local address 127.15.70.1:33773)
0811 00:55:18.388498 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:18.388500 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:18.388506 (+ 6us) server_negotiation.cc:407] Connection header received
0811 00:55:18.388531 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:18.388531 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:18.388545 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:18.388609 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:55:18.388792 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:18.389352 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:18.390221 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:18.390446 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:18.390514 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:18.390676 (+ 162us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:55:18.390720 (+ 44us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:55:18.390767 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:18.390818 (+ 51us) server_negotiation.cc:299] Negotiation successful
0811 00:55:18.390843 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":136,"threads_started":1}
I20260811 00:55:18.394512 18847 raft_consensus.cc:1261] T d1f219d76a9443c0b07965092eaeeb0a P 0f5b853ec1244de59eed491f61954ea7 [term 1 FOLLOWER]: Refusing update from remote peer 1fa16116776b4850a8a29353b29663b0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:55:18.394577 19066 raft_consensus.cc:1261] T d1f219d76a9443c0b07965092eaeeb0a P 6367bedaae04427d9f66c3423cd44be0 [term 1 FOLLOWER]: Refusing update from remote peer 1fa16116776b4850a8a29353b29663b0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:55:18.394871 19248 consensus_queue.cc:1035] T d1f219d76a9443c0b07965092eaeeb0a P 1fa16116776b4850a8a29353b29663b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:55:18.395069 19248 consensus_queue.cc:1035] T d1f219d76a9443c0b07965092eaeeb0a P 1fa16116776b4850a8a29353b29663b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:55:18.406720 18383 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36514:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:55:18.406905 18383 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36514:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:55:18.407809 18383 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b7ef8465cf0f481ca4e51342b1f5f224: Sending DeleteTablet for 3 replicas of tablet d1f219d76a9443c0b07965092eaeeb0a
I20260811 00:55:18.408147 18603 tablet_service.cc:1514] Processing DeleteTablet for tablet d1f219d76a9443c0b07965092eaeeb0a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:55:18 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:39082
I20260811 00:55:18.408131 19035 tablet_service.cc:1514] Processing DeleteTablet for tablet d1f219d76a9443c0b07965092eaeeb0a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:55:18 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:46604
I20260811 00:55:18.408215 18819 tablet_service.cc:1514] Processing DeleteTablet for tablet d1f219d76a9443c0b07965092eaeeb0a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:55:18 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:37486
I20260811 00:55:18.408310 19296 tablet_replica.cc:330] T d1f219d76a9443c0b07965092eaeeb0a P 1fa16116776b4850a8a29353b29663b0: stopping tablet replica
I20260811 00:55:18.408335 19297 tablet_replica.cc:330] T d1f219d76a9443c0b07965092eaeeb0a P 6367bedaae04427d9f66c3423cd44be0: stopping tablet replica
I20260811 00:55:18.408334 19298 tablet_replica.cc:330] T d1f219d76a9443c0b07965092eaeeb0a P 0f5b853ec1244de59eed491f61954ea7: stopping tablet replica
I20260811 00:55:18.408376 19296 raft_consensus.cc:2229] T d1f219d76a9443c0b07965092eaeeb0a P 1fa16116776b4850a8a29353b29663b0 [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:55:18.408397 19298 raft_consensus.cc:2229] T d1f219d76a9443c0b07965092eaeeb0a P 0f5b853ec1244de59eed491f61954ea7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:55:18.408407 19297 raft_consensus.cc:2229] T d1f219d76a9443c0b07965092eaeeb0a P 6367bedaae04427d9f66c3423cd44be0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:55:18.408447 19296 raft_consensus.cc:2258] T d1f219d76a9443c0b07965092eaeeb0a P 1fa16116776b4850a8a29353b29663b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:55:18.408452 19298 raft_consensus.cc:2258] T d1f219d76a9443c0b07965092eaeeb0a P 0f5b853ec1244de59eed491f61954ea7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:55:18.408459 19297 raft_consensus.cc:2258] T d1f219d76a9443c0b07965092eaeeb0a P 6367bedaae04427d9f66c3423cd44be0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:55:18.408826 19297 ts_tablet_manager.cc:1905] T d1f219d76a9443c0b07965092eaeeb0a P 6367bedaae04427d9f66c3423cd44be0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:55:18.408766 18383 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36514:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:55:18.408972 18383 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:55:18.409019 19298 ts_tablet_manager.cc:1905] T d1f219d76a9443c0b07965092eaeeb0a P 0f5b853ec1244de59eed491f61954ea7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:55:18.409099 19296 ts_tablet_manager.cc:1905] T d1f219d76a9443c0b07965092eaeeb0a P 1fa16116776b4850a8a29353b29663b0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:55:18.410813 19298 ts_tablet_manager.cc:1918] T d1f219d76a9443c0b07965092eaeeb0a P 0f5b853ec1244de59eed491f61954ea7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 00:55:18.410912 19298 log.cc:1196] T d1f219d76a9443c0b07965092eaeeb0a P 0f5b853ec1244de59eed491f61954ea7: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-1/wal/wals/d1f219d76a9443c0b07965092eaeeb0a
I20260811 00:55:18.411036 19297 ts_tablet_manager.cc:1918] T d1f219d76a9443c0b07965092eaeeb0a P 6367bedaae04427d9f66c3423cd44be0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 00:55:18.411075 19296 ts_tablet_manager.cc:1918] T d1f219d76a9443c0b07965092eaeeb0a P 1fa16116776b4850a8a29353b29663b0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 00:55:18.411118 19297 log.cc:1196] T d1f219d76a9443c0b07965092eaeeb0a P 6367bedaae04427d9f66c3423cd44be0: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-2/wal/wals/d1f219d76a9443c0b07965092eaeeb0a
I20260811 00:55:18.411128 19296 log.cc:1196] T d1f219d76a9443c0b07965092eaeeb0a P 1fa16116776b4850a8a29353b29663b0: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-0/wal/wals/d1f219d76a9443c0b07965092eaeeb0a
I20260811 00:55:18.411288 19298 ts_tablet_manager.cc:1939] T d1f219d76a9443c0b07965092eaeeb0a P 0f5b853ec1244de59eed491f61954ea7: Deleting consensus metadata
I20260811 00:55:18.411373 19297 ts_tablet_manager.cc:1939] T d1f219d76a9443c0b07965092eaeeb0a P 6367bedaae04427d9f66c3423cd44be0: Deleting consensus metadata
I20260811 00:55:18.411373 19296 ts_tablet_manager.cc:1939] T d1f219d76a9443c0b07965092eaeeb0a P 1fa16116776b4850a8a29353b29663b0: Deleting consensus metadata
I20260811 00:55:18.411803 18358 catalog_manager.cc:4841] TS 0f5b853ec1244de59eed491f61954ea7 (127.15.70.2:39297): tablet d1f219d76a9443c0b07965092eaeeb0a (table test-table [id=861f9ef438aa48f6abb47fbde346c2da]) successfully deleted
I20260811 00:55:18.412007 18360 catalog_manager.cc:4841] TS 6367bedaae04427d9f66c3423cd44be0 (127.15.70.3:34103): tablet d1f219d76a9443c0b07965092eaeeb0a (table test-table [id=861f9ef438aa48f6abb47fbde346c2da]) successfully deleted
I20260811 00:55:18.412151 18360 catalog_manager.cc:4841] TS 1fa16116776b4850a8a29353b29663b0 (127.15.70.1:33773): tablet d1f219d76a9443c0b07965092eaeeb0a (table test-table [id=861f9ef438aa48f6abb47fbde346c2da]) successfully deleted
I20260811 00:55:18.413239 18603 tablet_service.cc:1467] Processing CreateTablet for tablet 6612c0d8d6244ed6a90da306fb8e35bf (DEFAULT_TABLE table=test-table [id=c01f5fdf78ba49e192fa7523713a7fc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:55:18.413292 18819 tablet_service.cc:1467] Processing CreateTablet for tablet 6612c0d8d6244ed6a90da306fb8e35bf (DEFAULT_TABLE table=test-table [id=c01f5fdf78ba49e192fa7523713a7fc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:55:18.413398 18603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6612c0d8d6244ed6a90da306fb8e35bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:18.413439 18819 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6612c0d8d6244ed6a90da306fb8e35bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:18.414873 19312 tablet_bootstrap.cc:492] T 6612c0d8d6244ed6a90da306fb8e35bf P 1fa16116776b4850a8a29353b29663b0: Bootstrap starting.
I20260811 00:55:18.414954 19314 tablet_bootstrap.cc:492] T 6612c0d8d6244ed6a90da306fb8e35bf P 0f5b853ec1244de59eed491f61954ea7: Bootstrap starting.
I20260811 00:55:18.415056 19035 tablet_service.cc:1467] Processing CreateTablet for tablet 6612c0d8d6244ed6a90da306fb8e35bf (DEFAULT_TABLE table=test-table [id=c01f5fdf78ba49e192fa7523713a7fc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:55:18.415212 19035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6612c0d8d6244ed6a90da306fb8e35bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:18.415488 19312 tablet_bootstrap.cc:654] T 6612c0d8d6244ed6a90da306fb8e35bf P 1fa16116776b4850a8a29353b29663b0: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:18.415546 19314 tablet_bootstrap.cc:654] T 6612c0d8d6244ed6a90da306fb8e35bf P 0f5b853ec1244de59eed491f61954ea7: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:18.417034 19315 tablet_bootstrap.cc:492] T 6612c0d8d6244ed6a90da306fb8e35bf P 6367bedaae04427d9f66c3423cd44be0: Bootstrap starting.
I20260811 00:55:18.417403 19314 tablet_bootstrap.cc:492] T 6612c0d8d6244ed6a90da306fb8e35bf P 0f5b853ec1244de59eed491f61954ea7: No bootstrap required, opened a new log
I20260811 00:55:18.417497 19314 ts_tablet_manager.cc:1397] T 6612c0d8d6244ed6a90da306fb8e35bf P 0f5b853ec1244de59eed491f61954ea7: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260811 00:55:18.417572 19315 tablet_bootstrap.cc:654] T 6612c0d8d6244ed6a90da306fb8e35bf P 6367bedaae04427d9f66c3423cd44be0: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:18.417585 19312 tablet_bootstrap.cc:492] T 6612c0d8d6244ed6a90da306fb8e35bf P 1fa16116776b4850a8a29353b29663b0: No bootstrap required, opened a new log
I20260811 00:55:18.417654 19312 ts_tablet_manager.cc:1397] T 6612c0d8d6244ed6a90da306fb8e35bf P 1fa16116776b4850a8a29353b29663b0: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 00:55:18.417735 19314 raft_consensus.cc:348] T 6612c0d8d6244ed6a90da306fb8e35bf P 0f5b853ec1244de59eed491f61954ea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } }
I20260811 00:55:18.417845 19314 raft_consensus.cc:374] T 6612c0d8d6244ed6a90da306fb8e35bf P 0f5b853ec1244de59eed491f61954ea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:18.417868 19314 raft_consensus.cc:729] T 6612c0d8d6244ed6a90da306fb8e35bf P 0f5b853ec1244de59eed491f61954ea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f5b853ec1244de59eed491f61954ea7, State: Initialized, Role: FOLLOWER
I20260811 00:55:18.417826 19312 raft_consensus.cc:348] T 6612c0d8d6244ed6a90da306fb8e35bf P 1fa16116776b4850a8a29353b29663b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } }
I20260811 00:55:18.417932 19314 consensus_queue.cc:260] T 6612c0d8d6244ed6a90da306fb8e35bf P 0f5b853ec1244de59eed491f61954ea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } }
I20260811 00:55:18.417944 19312 raft_consensus.cc:374] T 6612c0d8d6244ed6a90da306fb8e35bf P 1fa16116776b4850a8a29353b29663b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:18.417987 19312 raft_consensus.cc:729] T 6612c0d8d6244ed6a90da306fb8e35bf P 1fa16116776b4850a8a29353b29663b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fa16116776b4850a8a29353b29663b0, State: Initialized, Role: FOLLOWER
I20260811 00:55:18.418059 19314 ts_tablet_manager.cc:1428] T 6612c0d8d6244ed6a90da306fb8e35bf P 0f5b853ec1244de59eed491f61954ea7: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260811 00:55:18.418048 19312 consensus_queue.cc:260] T 6612c0d8d6244ed6a90da306fb8e35bf P 1fa16116776b4850a8a29353b29663b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } }
I20260811 00:55:18.418177 19312 ts_tablet_manager.cc:1428] T 6612c0d8d6244ed6a90da306fb8e35bf P 1fa16116776b4850a8a29353b29663b0: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 00:55:18.418326 19315 tablet_bootstrap.cc:492] T 6612c0d8d6244ed6a90da306fb8e35bf P 6367bedaae04427d9f66c3423cd44be0: No bootstrap required, opened a new log
I20260811 00:55:18.418377 19315 ts_tablet_manager.cc:1397] T 6612c0d8d6244ed6a90da306fb8e35bf P 6367bedaae04427d9f66c3423cd44be0: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:18.418534 19315 raft_consensus.cc:348] T 6612c0d8d6244ed6a90da306fb8e35bf P 6367bedaae04427d9f66c3423cd44be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } }
I20260811 00:55:18.418588 19315 raft_consensus.cc:374] T 6612c0d8d6244ed6a90da306fb8e35bf P 6367bedaae04427d9f66c3423cd44be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:18.418633 19315 raft_consensus.cc:729] T 6612c0d8d6244ed6a90da306fb8e35bf P 6367bedaae04427d9f66c3423cd44be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6367bedaae04427d9f66c3423cd44be0, State: Initialized, Role: FOLLOWER
I20260811 00:55:18.418687 19315 consensus_queue.cc:260] T 6612c0d8d6244ed6a90da306fb8e35bf P 6367bedaae04427d9f66c3423cd44be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } }
I20260811 00:55:18.418794 19315 ts_tablet_manager.cc:1428] T 6612c0d8d6244ed6a90da306fb8e35bf P 6367bedaae04427d9f66c3423cd44be0: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 00:55:18.579989 19321 raft_consensus.cc:482] T 6612c0d8d6244ed6a90da306fb8e35bf P 0f5b853ec1244de59eed491f61954ea7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:55:18.580156 19321 raft_consensus.cc:504] T 6612c0d8d6244ed6a90da306fb8e35bf P 0f5b853ec1244de59eed491f61954ea7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } }
I20260811 00:55:18.580699 19321 leader_election.cc:288] T 6612c0d8d6244ed6a90da306fb8e35bf P 0f5b853ec1244de59eed491f61954ea7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1fa16116776b4850a8a29353b29663b0 (127.15.70.1:33773), 6367bedaae04427d9f66c3423cd44be0 (127.15.70.3:34103)
I20260811 00:55:18.585620 19346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:18.581380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:33227 (local address 127.15.70.3:34103)
0811 00:55:18.581531 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:18.581534 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:18.581663 (+ 129us) server_negotiation.cc:407] Connection header received
0811 00:55:18.581756 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:18.581757 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:18.581771 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:18.581868 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:18.582093 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:18.582810 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:18.584391 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:18.585116 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:18.585214 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:18.585232 (+ 18us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:18.585459 (+ 227us) server_negotiation.cc:299] Negotiation successful
0811 00:55:18.585514 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":75,"threads_started":1}
I20260811 00:55:18.585619 19326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:18.581091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:59793 (local address 127.15.70.1:33773)
0811 00:55:18.581169 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:18.581173 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:18.581328 (+ 155us) server_negotiation.cc:407] Connection header received
0811 00:55:18.581428 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:18.581430 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:18.581444 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:18.581518 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:18.581789 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:18.582611 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:18.584366 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:18.585116 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:18.585214 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:18.585233 (+ 19us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:18.585459 (+ 226us) server_negotiation.cc:299] Negotiation successful
0811 00:55:18.585514 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 00:55:18.585677 19343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:18.581004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:33773 (local address 127.15.70.2:59793)
0811 00:55:18.581210 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:18.581225 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:18.581352 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:18.581558 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:18.581560 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:18.581564 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:18.581697 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:18.581700 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:18.582732 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:18.582734 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:18.584221 (+ 1487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:18.584226 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:18.585235 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:18.585236 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:18.585347 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:18.585350 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:55:18.585427 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 00:55:18.585514 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"mutex_wait_us":81,"thread_start_us":125,"threads_started":1}
I20260811 00:55:18.585677 19344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:18.581283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:34103 (local address 127.15.70.2:33227)
0811 00:55:18.581561 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:18.581574 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:18.581661 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:18.581909 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:18.581910 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:18.581912 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:18.581979 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:18.581981 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:18.582929 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:18.582930 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:18.584221 (+ 1291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:18.584226 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:18.585234 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:18.585236 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:18.585344 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:18.585350 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 00:55:18.585426 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 00:55:18.585514 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"mutex_wait_us":15,"thread_start_us":130,"threads_started":1}
I20260811 00:55:18.586102 18634 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6612c0d8d6244ed6a90da306fb8e35bf" candidate_uuid: "0f5b853ec1244de59eed491f61954ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fa16116776b4850a8a29353b29663b0" is_pre_election: true
I20260811 00:55:18.586249 18634 raft_consensus.cc:2454] T 6612c0d8d6244ed6a90da306fb8e35bf P 1fa16116776b4850a8a29353b29663b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f5b853ec1244de59eed491f61954ea7 in term 0.
I20260811 00:55:18.586251 19066 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6612c0d8d6244ed6a90da306fb8e35bf" candidate_uuid: "0f5b853ec1244de59eed491f61954ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6367bedaae04427d9f66c3423cd44be0" is_pre_election: true
I20260811 00:55:18.586387 19066 raft_consensus.cc:2454] T 6612c0d8d6244ed6a90da306fb8e35bf P 6367bedaae04427d9f66c3423cd44be0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f5b853ec1244de59eed491f61954ea7 in term 0.
I20260811 00:55:18.586512 18739 leader_election.cc:302] T 6612c0d8d6244ed6a90da306fb8e35bf P 0f5b853ec1244de59eed491f61954ea7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f5b853ec1244de59eed491f61954ea7, 1fa16116776b4850a8a29353b29663b0; no voters:
I20260811 00:55:18.586726 19321 raft_consensus.cc:2781] T 6612c0d8d6244ed6a90da306fb8e35bf P 0f5b853ec1244de59eed491f61954ea7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:55:18.586779 19321 raft_consensus.cc:482] T 6612c0d8d6244ed6a90da306fb8e35bf P 0f5b853ec1244de59eed491f61954ea7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:55:18.586805 19321 raft_consensus.cc:3037] T 6612c0d8d6244ed6a90da306fb8e35bf P 0f5b853ec1244de59eed491f61954ea7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:18.587850 19321 raft_consensus.cc:504] T 6612c0d8d6244ed6a90da306fb8e35bf P 0f5b853ec1244de59eed491f61954ea7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } }
I20260811 00:55:18.588050 19321 leader_election.cc:288] T 6612c0d8d6244ed6a90da306fb8e35bf P 0f5b853ec1244de59eed491f61954ea7 [CANDIDATE]: Term 1 election: Requested vote from peers 1fa16116776b4850a8a29353b29663b0 (127.15.70.1:33773), 6367bedaae04427d9f66c3423cd44be0 (127.15.70.3:34103)
I20260811 00:55:18.588272 19066 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6612c0d8d6244ed6a90da306fb8e35bf" candidate_uuid: "0f5b853ec1244de59eed491f61954ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6367bedaae04427d9f66c3423cd44be0"
I20260811 00:55:18.588274 18634 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6612c0d8d6244ed6a90da306fb8e35bf" candidate_uuid: "0f5b853ec1244de59eed491f61954ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fa16116776b4850a8a29353b29663b0"
I20260811 00:55:18.588375 19066 raft_consensus.cc:3037] T 6612c0d8d6244ed6a90da306fb8e35bf P 6367bedaae04427d9f66c3423cd44be0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:18.588397 18634 raft_consensus.cc:3037] T 6612c0d8d6244ed6a90da306fb8e35bf P 1fa16116776b4850a8a29353b29663b0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:18.589248 18634 raft_consensus.cc:2454] T 6612c0d8d6244ed6a90da306fb8e35bf P 1fa16116776b4850a8a29353b29663b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f5b853ec1244de59eed491f61954ea7 in term 1.
I20260811 00:55:18.589254 19066 raft_consensus.cc:2454] T 6612c0d8d6244ed6a90da306fb8e35bf P 6367bedaae04427d9f66c3423cd44be0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f5b853ec1244de59eed491f61954ea7 in term 1.
I20260811 00:55:18.589478 18739 leader_election.cc:302] T 6612c0d8d6244ed6a90da306fb8e35bf P 0f5b853ec1244de59eed491f61954ea7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f5b853ec1244de59eed491f61954ea7, 6367bedaae04427d9f66c3423cd44be0; no voters:
I20260811 00:55:18.589589 19321 raft_consensus.cc:2781] T 6612c0d8d6244ed6a90da306fb8e35bf P 0f5b853ec1244de59eed491f61954ea7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:55:18.589859 19321 raft_consensus.cc:686] T 6612c0d8d6244ed6a90da306fb8e35bf P 0f5b853ec1244de59eed491f61954ea7 [term 1 LEADER]: Becoming Leader. State: Replica: 0f5b853ec1244de59eed491f61954ea7, State: Running, Role: LEADER
I20260811 00:55:18.589953 19321 consensus_queue.cc:237] T 6612c0d8d6244ed6a90da306fb8e35bf P 0f5b853ec1244de59eed491f61954ea7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } }
I20260811 00:55:18.591094 18383 catalog_manager.cc:5495] T 6612c0d8d6244ed6a90da306fb8e35bf P 0f5b853ec1244de59eed491f61954ea7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f5b853ec1244de59eed491f61954ea7 (127.15.70.2). New cstate: current_term: 1 leader_uuid: "0f5b853ec1244de59eed491f61954ea7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f5b853ec1244de59eed491f61954ea7" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 } health_report { overall_health: UNKNOWN } } }
I20260811 00:55:18.607805 19350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:18.604693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44900 (local address 127.15.70.2:39297)
0811 00:55:18.604927 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:18.604929 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:18.604935 (+ 6us) server_negotiation.cc:407] Connection header received
0811 00:55:18.604982 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:18.604982 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:18.605012 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:18.605100 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:55:18.605248 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:18.605823 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:18.606655 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:18.606884 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:18.606945 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:18.607252 (+ 307us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:55:18.607431 (+ 179us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:55:18.607507 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:18.607602 (+ 95us) server_negotiation.cc:299] Negotiation successful
0811 00:55:18.607628 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":160,"threads_started":1}
I20260811 00:55:18.614193 19354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:18.611279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:34103 (local address 127.15.70.2:35985)
0811 00:55:18.611475 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:18.611508 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:18.611597 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:18.611796 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:18.611798 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:18.611800 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 00:55:18.611872 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:18.611874 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:18.612619 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:18.612619 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:18.613238 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:18.613240 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:18.613673 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:18.613674 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:18.613723 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:18.613740 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 00:55:18.614010 (+ 270us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 00:55:18.614013 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:55:18.614060 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 00:55:18.614106 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":94,"threads_started":1}
I20260811 00:55:18.614179 19346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:18.611470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:35985 (local address 127.15.70.3:34103)
0811 00:55:18.611565 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:18.611568 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:18.611581 (+ 13us) server_negotiation.cc:407] Connection header received
0811 00:55:18.611693 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:18.611694 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:18.611713 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:18.611781 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:55:18.611959 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:18.612533 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:18.613338 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:18.613582 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:18.613645 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:18.613865 (+ 220us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:55:18.613915 (+ 50us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:55:18.613984 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:18.614065 (+ 81us) server_negotiation.cc:299] Negotiation successful
0811 00:55:18.614094 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 00:55:18.616907 18634 raft_consensus.cc:1261] T 6612c0d8d6244ed6a90da306fb8e35bf P 1fa16116776b4850a8a29353b29663b0 [term 1 FOLLOWER]: Refusing update from remote peer 0f5b853ec1244de59eed491f61954ea7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:55:18.616940 19066 raft_consensus.cc:1261] T 6612c0d8d6244ed6a90da306fb8e35bf P 6367bedaae04427d9f66c3423cd44be0 [term 1 FOLLOWER]: Refusing update from remote peer 0f5b853ec1244de59eed491f61954ea7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:55:18.617259 19347 consensus_queue.cc:1035] T 6612c0d8d6244ed6a90da306fb8e35bf P 0f5b853ec1244de59eed491f61954ea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6367bedaae04427d9f66c3423cd44be0" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:55:18.617429 19321 consensus_queue.cc:1035] T 6612c0d8d6244ed6a90da306fb8e35bf P 0f5b853ec1244de59eed491f61954ea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fa16116776b4850a8a29353b29663b0" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:55:18.626194 19350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:18.623407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:53325 (local address 127.15.70.2:39297)
0811 00:55:18.623455 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:18.623458 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:18.623542 (+ 84us) server_negotiation.cc:407] Connection header received
0811 00:55:18.623620 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:18.623621 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:18.623635 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:18.623692 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:55:18.623826 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:18.624353 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:18.625488 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:18.625780 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:18.625836 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:18.625974 (+ 138us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:55:18.626010 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:55:18.626058 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:18.626092 (+ 34us) server_negotiation.cc:299] Negotiation successful
0811 00:55:18.626115 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 00:55:18.626214 19361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:18.623304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.2:39297 (local address 127.15.70.3:53325)
0811 00:55:18.623471 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:18.623485 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:18.623562 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:18.623694 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:18.623695 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:18.623698 (+ 3us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 00:55:18.623774 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:18.623776 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:18.624442 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:18.624443 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:18.625335 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:18.625340 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:18.625849 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:18.625850 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:18.625900 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:18.625907 (+ 7us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 00:55:18.626058 (+ 151us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 00:55:18.626059 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 00:55:18.626090 (+ 31us) client_negotiation.cc:240] Negotiation successful
0811 00:55:18.626139 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":115,"threads_started":1}
W20260811 00:55:18.626607 19267 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 00:55:20.157927 18385 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36514:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:55:20.158071 18385 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36514:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:55:20.159392 18385 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b7ef8465cf0f481ca4e51342b1f5f224: Sending DeleteTablet for 3 replicas of tablet 6612c0d8d6244ed6a90da306fb8e35bf
I20260811 00:55:20.159791 18603 tablet_service.cc:1514] Processing DeleteTablet for tablet 6612c0d8d6244ed6a90da306fb8e35bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:55:20 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:39082
I20260811 00:55:20.159791 19035 tablet_service.cc:1514] Processing DeleteTablet for tablet 6612c0d8d6244ed6a90da306fb8e35bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:55:20 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:46604
I20260811 00:55:20.160043 18819 tablet_service.cc:1514] Processing DeleteTablet for tablet 6612c0d8d6244ed6a90da306fb8e35bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:55:20 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:37486
I20260811 00:55:20.160116 19401 tablet_replica.cc:330] T 6612c0d8d6244ed6a90da306fb8e35bf P 1fa16116776b4850a8a29353b29663b0: stopping tablet replica
I20260811 00:55:20.160290 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 18497
I20260811 00:55:20.172186 19403 tablet_replica.cc:330] T 6612c0d8d6244ed6a90da306fb8e35bf P 0f5b853ec1244de59eed491f61954ea7: stopping tablet replica
I20260811 00:55:20.172435 19403 raft_consensus.cc:2229] T 6612c0d8d6244ed6a90da306fb8e35bf P 0f5b853ec1244de59eed491f61954ea7 [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:55:20.172734 19403 raft_consensus.cc:2258] T 6612c0d8d6244ed6a90da306fb8e35bf P 0f5b853ec1244de59eed491f61954ea7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:55:20.173508 19403 ts_tablet_manager.cc:1905] T 6612c0d8d6244ed6a90da306fb8e35bf P 0f5b853ec1244de59eed491f61954ea7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:55:20.175625 19403 ts_tablet_manager.cc:1918] T 6612c0d8d6244ed6a90da306fb8e35bf P 0f5b853ec1244de59eed491f61954ea7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 00:55:20.175734 19403 log.cc:1196] T 6612c0d8d6244ed6a90da306fb8e35bf P 0f5b853ec1244de59eed491f61954ea7: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-1/wal/wals/6612c0d8d6244ed6a90da306fb8e35bf
I20260811 00:55:20.175876 19402 tablet_replica.cc:330] T 6612c0d8d6244ed6a90da306fb8e35bf P 6367bedaae04427d9f66c3423cd44be0: stopping tablet replica
I20260811 00:55:20.175983 19402 raft_consensus.cc:2229] T 6612c0d8d6244ed6a90da306fb8e35bf P 6367bedaae04427d9f66c3423cd44be0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:55:20.176075 19402 raft_consensus.cc:2258] T 6612c0d8d6244ed6a90da306fb8e35bf P 6367bedaae04427d9f66c3423cd44be0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:55:20.176182 19403 ts_tablet_manager.cc:1939] T 6612c0d8d6244ed6a90da306fb8e35bf P 0f5b853ec1244de59eed491f61954ea7: Deleting consensus metadata
I20260811 00:55:20.176429 19402 ts_tablet_manager.cc:1905] T 6612c0d8d6244ed6a90da306fb8e35bf P 6367bedaae04427d9f66c3423cd44be0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:55:20.176762 18358 catalog_manager.cc:4841] TS 0f5b853ec1244de59eed491f61954ea7 (127.15.70.2:39297): tablet 6612c0d8d6244ed6a90da306fb8e35bf (table test-table [id=c01f5fdf78ba49e192fa7523713a7fc4]) successfully deleted
I20260811 00:55:20.178277 19402 ts_tablet_manager.cc:1918] T 6612c0d8d6244ed6a90da306fb8e35bf P 6367bedaae04427d9f66c3423cd44be0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 00:55:20.178357 19402 log.cc:1196] T 6612c0d8d6244ed6a90da306fb8e35bf P 6367bedaae04427d9f66c3423cd44be0: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409704606556-15640-0/minicluster-data/ts-2/wal/wals/6612c0d8d6244ed6a90da306fb8e35bf
I20260811 00:55:20.178601 19402 ts_tablet_manager.cc:1939] T 6612c0d8d6244ed6a90da306fb8e35bf P 6367bedaae04427d9f66c3423cd44be0: Deleting consensus metadata
I20260811 00:55:20.179420 18360 catalog_manager.cc:4841] TS 6367bedaae04427d9f66c3423cd44be0 (127.15.70.3:34103): tablet 6612c0d8d6244ed6a90da306fb8e35bf (table test-table [id=c01f5fdf78ba49e192fa7523713a7fc4]) successfully deleted
W20260811 00:55:20.183352 18360 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.70.1:33773 (error 108)
I20260811 00:55:20.183777 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 18711
I20260811 00:55:20.192421 19405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:20.186938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:33773 (local address 127.0.0.1:49094)
0811 00:55:20.192244 (+ 5306us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:20.192343 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.1:33773: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":5264,"thread_start_us":1533,"threads_started":1}
W20260811 00:55:20.192798 18360 catalog_manager.cc:4584] TS 1fa16116776b4850a8a29353b29663b0 (127.15.70.1:33773): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6612c0d8d6244ed6a90da306fb8e35bf: Network error: Client connection negotiation failed: client connection to 127.15.70.1:33773: connect: Connection refused (error 111)
I20260811 00:55:20.208909 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 18922
I20260811 00:55:20.233609 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 18326
2026-08-11T00:55:20Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6575 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:55:20 dist-test-slave-h3ft krb5kdc[19410](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:55:20 dist-test-slave-h3ft krb5kdc[19410](info): set up 2 sockets
Aug 11 00:55:20 dist-test-slave-h3ft krb5kdc[19410](info): commencing operation
krb5kdc: starting...
W20260811 00:55:21.612197 15640 mini_kdc.cc:121] Time spent starting KDC: real 1.334s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Aug 11 00:55:21 dist-test-slave-h3ft krb5kdc[19410](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409721, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:55:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:55:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.70.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
I20260811 00:55:21.778237 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:44677
--webserver_interface=127.15.70.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:42487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:44677
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:21.880077 19434 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:21.880422 19434 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:21.880470 19434 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:21.881860 19434 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:55:21.881953 19434 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:21.881979 19434 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:21.882002 19434 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:55:21.882030 19434 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:55:21.883924 19434 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:42487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:44677
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:44677
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19434
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:21.884290 19434 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:21.884593 19434 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:21.891242 19444 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:21.891263 19441 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:21.891244 19447 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:21.891268 19434 server_base.cc:1034] running on GCE node
I20260811 00:55:21.891913 19434 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:21.892398 19434 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:21.893616 19434 hybrid_clock.cc:648] HybridClock initialized: now 1786409721893602 us; error 57 us; skew 500 ppm
Aug 11 00:55:21 dist-test-slave-h3ft krb5kdc[19410](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409721, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:21.897065 19434 init.cc:377] Logged in from keytab as kudu/127.15.70.62@KRBTEST.COM (short username kudu)
I20260811 00:55:21.897725 19434 webserver.cc:460] Webserver started at http://127.15.70.62:46039/ using document root <none> and password file <none>
I20260811 00:55:21.898034 19434 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:21.898118 19434 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:21.898298 19434 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:21.899843 19434 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "8882fa582daa4ef18f6c4f1e3a6b9de0"
format_stamp: "Formatted at 2026-08-11 00:55:21 on dist-test-slave-h3ft"
server_key: "d62ef4577a7d81a17fb098fde613243a"
server_key_iv: "5aa2823627350efcdd2d3258f4aeef25"
server_key_version: "encryptionkey@0"
I20260811 00:55:21.900322 19434 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "8882fa582daa4ef18f6c4f1e3a6b9de0"
format_stamp: "Formatted at 2026-08-11 00:55:21 on dist-test-slave-h3ft"
server_key: "d62ef4577a7d81a17fb098fde613243a"
server_key_iv: "5aa2823627350efcdd2d3258f4aeef25"
server_key_version: "encryptionkey@0"
I20260811 00:55:21.902325 19434 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260811 00:55:21.903370 19459 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:21.903584 19434 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:21.903712 19434 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "8882fa582daa4ef18f6c4f1e3a6b9de0"
format_stamp: "Formatted at 2026-08-11 00:55:21 on dist-test-slave-h3ft"
server_key: "d62ef4577a7d81a17fb098fde613243a"
server_key_iv: "5aa2823627350efcdd2d3258f4aeef25"
server_key_version: "encryptionkey@0"
I20260811 00:55:21.903806 19434 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:21.918735 19434 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:21.921512 19434 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:21.921741 19434 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:21.927588 19434 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:44677
I20260811 00:55:21.927649 19542 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:44677 every 8 connection(s)
I20260811 00:55:21.928150 19434 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:55:21.929385 19544 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:21.932566 19544 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8882fa582daa4ef18f6c4f1e3a6b9de0: Bootstrap starting.
I20260811 00:55:21.933420 19544 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8882fa582daa4ef18f6c4f1e3a6b9de0: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:21.933825 19544 log.cc:824] T 00000000000000000000000000000000 P 8882fa582daa4ef18f6c4f1e3a6b9de0: Log is configured to *not* fsync() on all Append() calls
I20260811 00:55:21.934844 19544 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8882fa582daa4ef18f6c4f1e3a6b9de0: No bootstrap required, opened a new log
I20260811 00:55:21.936966 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 19434
I20260811 00:55:21.937088 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 00:55:21.937101 19544 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8882fa582daa4ef18f6c4f1e3a6b9de0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8882fa582daa4ef18f6c4f1e3a6b9de0" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 44677 } }
I20260811 00:55:21.937309 15640 external_mini_cluster.cc:1428] Setting key fc04de7d5057ab8b559ab2d7cc390e10
I20260811 00:55:21.937347 19544 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8882fa582daa4ef18f6c4f1e3a6b9de0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:21.937394 19544 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8882fa582daa4ef18f6c4f1e3a6b9de0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8882fa582daa4ef18f6c4f1e3a6b9de0, State: Initialized, Role: FOLLOWER
I20260811 00:55:21.937635 19544 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8882fa582daa4ef18f6c4f1e3a6b9de0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8882fa582daa4ef18f6c4f1e3a6b9de0" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 44677 } }
I20260811 00:55:21.937724 19544 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8882fa582daa4ef18f6c4f1e3a6b9de0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:55:21.937750 19544 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8882fa582daa4ef18f6c4f1e3a6b9de0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:55:21.937834 19544 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8882fa582daa4ef18f6c4f1e3a6b9de0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:21.939160 19544 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8882fa582daa4ef18f6c4f1e3a6b9de0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8882fa582daa4ef18f6c4f1e3a6b9de0" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 44677 } }
I20260811 00:55:21.939311 19544 leader_election.cc:302] T 00000000000000000000000000000000 P 8882fa582daa4ef18f6c4f1e3a6b9de0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8882fa582daa4ef18f6c4f1e3a6b9de0; no voters:
I20260811 00:55:21.939572 19544 leader_election.cc:288] T 00000000000000000000000000000000 P 8882fa582daa4ef18f6c4f1e3a6b9de0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:55:21.939642 19550 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8882fa582daa4ef18f6c4f1e3a6b9de0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:55:21.939952 19544 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8882fa582daa4ef18f6c4f1e3a6b9de0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:55:21.939929 19550 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8882fa582daa4ef18f6c4f1e3a6b9de0 [term 1 LEADER]: Becoming Leader. State: Replica: 8882fa582daa4ef18f6c4f1e3a6b9de0, State: Running, Role: LEADER
I20260811 00:55:21.940225 19550 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8882fa582daa4ef18f6c4f1e3a6b9de0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8882fa582daa4ef18f6c4f1e3a6b9de0" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 44677 } }
I20260811 00:55:21.940744 19552 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8882fa582daa4ef18f6c4f1e3a6b9de0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8882fa582daa4ef18f6c4f1e3a6b9de0. Latest consensus state: current_term: 1 leader_uuid: "8882fa582daa4ef18f6c4f1e3a6b9de0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8882fa582daa4ef18f6c4f1e3a6b9de0" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 44677 } } }
I20260811 00:55:21.940899 19552 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8882fa582daa4ef18f6c4f1e3a6b9de0 [sys.catalog]: This master's current role is: LEADER
I20260811 00:55:21.940943 19551 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8882fa582daa4ef18f6c4f1e3a6b9de0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8882fa582daa4ef18f6c4f1e3a6b9de0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8882fa582daa4ef18f6c4f1e3a6b9de0" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 44677 } } }
I20260811 00:55:21.941051 19551 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8882fa582daa4ef18f6c4f1e3a6b9de0 [sys.catalog]: This master's current role is: LEADER
W20260811 00:55:21.942584 19571 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8882fa582daa4ef18f6c4f1e3a6b9de0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 00:55:21.942830 19571 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 00:55:21.942924 19561 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:55:21.943158 19561 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:55:21.946177 19561 catalog_manager.cc:1347] Generated new cluster ID: 4a734822dda645ce98c941f59b273081
I20260811 00:55:21.946251 19561 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 00:55:21 dist-test-slave-h3ft krb5kdc[19410](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409721, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:21.951133 19549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:21.938108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55508 (local address 127.15.70.62:44677)
0811 00:55:21.938337 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:21.938348 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:21.938388 (+ 40us) server_negotiation.cc:407] Connection header received
0811 00:55:21.938572 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:21.938580 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:21.938641 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:21.938820 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:21.939851 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:21.941468 (+ 1617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:21.942701 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:21.943411 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:21.943573 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:21.947132 (+ 3559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:21.947138 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:21.947139 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:21.947157 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:21.949232 (+ 2075us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:21.949697 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:21.949707 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:21.949708 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:21.949836 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:21.950076 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:21.950077 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:21.950078 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:21.950388 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:21.950596 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:21.950686 (+ 90us) server_negotiation.cc:299] Negotiation successful
0811 00:55:21.950859 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":125,"threads_started":1}
I20260811 00:55:21.963822 19561 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:55:21.964519 19561 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:55:21.975317 19561 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8882fa582daa4ef18f6c4f1e3a6b9de0: Generated new TSK 0
I20260811 00:55:21.975651 19561 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.70.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab.
Entry for principal kudu/127.15.70.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab.
I20260811 00:55:22.015233 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.1:0
--local_ip_for_outbound_sockets=127.15.70.1
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:44677
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:42487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:22.116479 19585 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:22.116770 19585 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:22.116799 19585 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:22.118201 19585 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:22.118258 19585 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:22.118288 19585 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.1
I20260811 00:55:22.120028 19585 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:42487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:44677
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19585
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.1
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:22.120292 19585 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:22.120543 19585 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:22.126885 19594 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:22.126866 19592 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:22.126865 19596 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:22.127242 19585 server_base.cc:1034] running on GCE node
I20260811 00:55:22.127501 19585 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:22.127766 19585 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:22.128966 19585 hybrid_clock.cc:648] HybridClock initialized: now 1786409722128925 us; error 58 us; skew 500 ppm
Aug 11 00:55:22 dist-test-slave-h3ft krb5kdc[19410](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409722, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:22.132531 19585 init.cc:377] Logged in from keytab as kudu/127.15.70.1@KRBTEST.COM (short username kudu)
I20260811 00:55:22.133138 19585 webserver.cc:460] Webserver started at http://127.15.70.1:38689/ using document root <none> and password file <none>
I20260811 00:55:22.133430 19585 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:22.133509 19585 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:22.133682 19585 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:22.135125 19585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-0/data/instance:
uuid: "402e833338274216976f6535d499d7db"
format_stamp: "Formatted at 2026-08-11 00:55:22 on dist-test-slave-h3ft"
server_key: "ba517aec86dad1c48c6121d9cf165bca"
server_key_iv: "7350479de1459e65baf09cf83d39a24f"
server_key_version: "encryptionkey@0"
I20260811 00:55:22.135682 19585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance:
uuid: "402e833338274216976f6535d499d7db"
format_stamp: "Formatted at 2026-08-11 00:55:22 on dist-test-slave-h3ft"
server_key: "ba517aec86dad1c48c6121d9cf165bca"
server_key_iv: "7350479de1459e65baf09cf83d39a24f"
server_key_version: "encryptionkey@0"
I20260811 00:55:22.137804 19585 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 00:55:22.138859 19611 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:22.139221 19585 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:22.139379 19585 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-0/wal
uuid: "402e833338274216976f6535d499d7db"
format_stamp: "Formatted at 2026-08-11 00:55:22 on dist-test-slave-h3ft"
server_key: "ba517aec86dad1c48c6121d9cf165bca"
server_key_iv: "7350479de1459e65baf09cf83d39a24f"
server_key_version: "encryptionkey@0"
I20260811 00:55:22.139503 19585 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:22.150313 19585 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:22.153955 19585 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:22.154170 19585 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:22.154495 19585 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:55:22.154961 19585 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:55:22.155052 19585 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:22.155109 19585 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:55:22.155130 19585 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:22.167789 19585 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.1:39961
I20260811 00:55:22.167860 19793 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.1:39961 every 8 connection(s)
I20260811 00:55:22.168306 19585 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
I20260811 00:55:22.174099 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 19585
I20260811 00:55:22.174198 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance
I20260811 00:55:22.174422 15640 external_mini_cluster.cc:1428] Setting key 907b50c6acf0fbeea64b0bf3e53c71e0
Aug 11 00:55:22 dist-test-slave-h3ft krb5kdc[19410](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409722, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:22.180282 19549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:22.169281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:42759 (local address 127.15.70.62:44677)
0811 00:55:22.169356 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:22.169364 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:22.169584 (+ 220us) server_negotiation.cc:407] Connection header received
0811 00:55:22.170182 (+ 598us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:22.170183 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:22.170196 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:22.170265 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:22.171557 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:22.172155 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:22.173306 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:22.173546 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:22.173608 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:22.176390 (+ 2782us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:22.176392 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:22.176393 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:22.176404 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:22.178322 (+ 1918us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:22.179029 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:22.179030 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:22.179031 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:22.179119 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:22.179425 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:22.179426 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:22.179427 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:22.179587 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:22.179670 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:22.180030 (+ 360us) server_negotiation.cc:299] Negotiation successful
0811 00:55:22.180172 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 00:55:22.180506 19800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:22.169227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:44677 (local address 127.15.70.1:42759)
0811 00:55:22.169419 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:22.169473 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:22.170086 (+ 613us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:22.170350 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:22.170354 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:22.171186 (+ 832us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:22.171449 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:22.171456 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:22.172255 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:22.172256 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:22.173217 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:22.173220 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:22.173651 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:22.173652 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:22.173770 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:22.174488 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:22.174499 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:22.176259 (+ 1760us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:22.178471 (+ 2212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:22.178483 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:22.178486 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:22.178858 (+ 372us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:22.179196 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:22.179198 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:22.179198 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:22.179343 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:22.179669 (+ 326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:22.179678 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:22.179877 (+ 199us) client_negotiation.cc:769] Sending connection context
0811 00:55:22.180004 (+ 127us) client_negotiation.cc:240] Negotiation successful
0811 00:55:22.180210 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":104,"threads_started":1}
I20260811 00:55:22.181327 19798 heartbeater.cc:347] Connected to a master server at 127.15.70.62:44677
I20260811 00:55:22.181465 19798 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:22.181697 19798 heartbeater.cc:511] Master 127.15.70.62:44677 requested a full tablet report, sending...
I20260811 00:55:22.182492 19485 ts_manager.cc:194] Registered new tserver with Master: 402e833338274216976f6535d499d7db (127.15.70.1:39961)
I20260811 00:55:22.183651 19485 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.1@KRBTEST.COM'} at 127.15.70.1:42759
WARNING: no policy specified for kudu/127.15.70.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab.
Entry for principal kudu/127.15.70.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab.
I20260811 00:55:22.211534 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.2:0
--local_ip_for_outbound_sockets=127.15.70.2
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:44677
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:42487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:22.310380 19804 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:22.310668 19804 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:22.310699 19804 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:22.312039 19804 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:22.312095 19804 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:22.312129 19804 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.2
I20260811 00:55:22.313884 19804 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:42487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:44677
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19804
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.2
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:22.314232 19804 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:22.314544 19804 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:22.320904 19809 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:22.320904 19817 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:22.321066 19804 server_base.cc:1034] running on GCE node
W20260811 00:55:22.320987 19813 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:22.321403 19804 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:22.321662 19804 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:22.322875 19804 hybrid_clock.cc:648] HybridClock initialized: now 1786409722322855 us; error 52 us; skew 500 ppm
Aug 11 00:55:22 dist-test-slave-h3ft krb5kdc[19410](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409722, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:22.331784 19804 init.cc:377] Logged in from keytab as kudu/127.15.70.2@KRBTEST.COM (short username kudu)
I20260811 00:55:22.332609 19804 webserver.cc:460] Webserver started at http://127.15.70.2:45219/ using document root <none> and password file <none>
I20260811 00:55:22.332908 19804 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:22.332986 19804 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:22.333177 19804 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:22.334568 19804 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-1/data/instance:
uuid: "9e948998c80a4380b83d1a2304cb20d7"
format_stamp: "Formatted at 2026-08-11 00:55:22 on dist-test-slave-h3ft"
server_key: "4c34e81304cddbefd2ff66c0617e0121"
server_key_iv: "5c99a35be2ee1205e3214f24572e0807"
server_key_version: "encryptionkey@0"
I20260811 00:55:22.335172 19804 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance:
uuid: "9e948998c80a4380b83d1a2304cb20d7"
format_stamp: "Formatted at 2026-08-11 00:55:22 on dist-test-slave-h3ft"
server_key: "4c34e81304cddbefd2ff66c0617e0121"
server_key_iv: "5c99a35be2ee1205e3214f24572e0807"
server_key_version: "encryptionkey@0"
I20260811 00:55:22.337113 19804 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 00:55:22.338231 19828 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:22.338461 19804 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:22.338593 19804 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-1/wal
uuid: "9e948998c80a4380b83d1a2304cb20d7"
format_stamp: "Formatted at 2026-08-11 00:55:22 on dist-test-slave-h3ft"
server_key: "4c34e81304cddbefd2ff66c0617e0121"
server_key_iv: "5c99a35be2ee1205e3214f24572e0807"
server_key_version: "encryptionkey@0"
I20260811 00:55:22.338687 19804 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:22.351143 19804 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:22.354014 19804 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:22.354229 19804 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:22.354540 19804 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:55:22.354966 19804 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:55:22.355057 19804 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:22.355116 19804 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:55:22.355166 19804 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:22.363653 19804 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.2:37953
I20260811 00:55:22.363719 20017 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.2:37953 every 8 connection(s)
I20260811 00:55:22.364202 19804 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
I20260811 00:55:22.369927 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 19804
I20260811 00:55:22.370064 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance
I20260811 00:55:22.370335 15640 external_mini_cluster.cc:1428] Setting key 661ec2392ee7f1c5f8d54cea4b542b0b
Aug 11 00:55:22 dist-test-slave-h3ft krb5kdc[19410](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409722, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:22.377229 19549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:22.365320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:41083 (local address 127.15.70.62:44677)
0811 00:55:22.365424 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:22.365427 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:22.365597 (+ 170us) server_negotiation.cc:407] Connection header received
0811 00:55:22.366297 (+ 700us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:22.366298 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:22.366314 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:22.366369 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:22.367707 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:22.368305 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:22.369692 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:22.370031 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:22.370168 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:22.373326 (+ 3158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:22.373330 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:22.373330 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:22.373343 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:22.375341 (+ 1998us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:22.375914 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:22.375916 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:22.375916 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:22.375994 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:22.376322 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:22.376323 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:22.376323 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:22.376484 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:22.376576 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:22.376961 (+ 385us) server_negotiation.cc:299] Negotiation successful
0811 00:55:22.377106 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 00:55:22.377509 20022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:22.365213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:44677 (local address 127.15.70.2:41083)
0811 00:55:22.365424 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:22.365477 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:22.366185 (+ 708us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:22.366451 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:22.366456 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:22.367314 (+ 858us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:22.367596 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:22.367603 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:22.368474 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:22.368476 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:22.369530 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:22.369533 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:22.370200 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:22.370202 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:22.370449 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:22.371354 (+ 905us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:22.371365 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:22.373196 (+ 1831us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:22.375460 (+ 2264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:22.375473 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:22.375476 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:22.375810 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:22.376085 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:22.376086 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:22.376087 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:22.376237 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:22.376562 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:22.376571 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:22.376791 (+ 220us) client_negotiation.cc:769] Sending connection context
0811 00:55:22.376922 (+ 131us) client_negotiation.cc:240] Negotiation successful
0811 00:55:22.377162 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":87,"threads_started":1}
I20260811 00:55:22.378207 20020 heartbeater.cc:347] Connected to a master server at 127.15.70.62:44677
I20260811 00:55:22.378367 20020 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:22.378679 20020 heartbeater.cc:511] Master 127.15.70.62:44677 requested a full tablet report, sending...
I20260811 00:55:22.379304 19485 ts_manager.cc:194] Registered new tserver with Master: 9e948998c80a4380b83d1a2304cb20d7 (127.15.70.2:37953)
I20260811 00:55:22.379779 19485 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.2@KRBTEST.COM'} at 127.15.70.2:41083
WARNING: no policy specified for kudu/127.15.70.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab.
Entry for principal kudu/127.15.70.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab.
I20260811 00:55:22.408008 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.3:0
--local_ip_for_outbound_sockets=127.15.70.3
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:44677
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:42487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:22.511425 20029 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:22.511739 20029 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:22.511771 20029 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:22.513841 20029 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:22.513991 20029 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:22.514053 20029 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.3
I20260811 00:55:22.517167 20029 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:42487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:44677
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20029
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.3
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:22.517620 20029 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:22.518008 20029 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:22.526475 20037 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:22.529141 20043 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:22.529302 20040 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:22.530031 20029 server_base.cc:1034] running on GCE node
I20260811 00:55:22.530366 20029 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:22.530773 20029 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:22.531997 20029 hybrid_clock.cc:648] HybridClock initialized: now 1786409722531944 us; error 69 us; skew 500 ppm
Aug 11 00:55:22 dist-test-slave-h3ft krb5kdc[19410](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409722, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:22.536855 20029 init.cc:377] Logged in from keytab as kudu/127.15.70.3@KRBTEST.COM (short username kudu)
I20260811 00:55:22.537650 20029 webserver.cc:460] Webserver started at http://127.15.70.3:33617/ using document root <none> and password file <none>
I20260811 00:55:22.538020 20029 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:22.538112 20029 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:22.538308 20029 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:22.540364 20029 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-2/data/instance:
uuid: "f35bbcfcf9a343c4bad5ed1f82330c84"
format_stamp: "Formatted at 2026-08-11 00:55:22 on dist-test-slave-h3ft"
server_key: "202873d4a73061ff635e1e1ef2b8e61f"
server_key_iv: "561c8744804e0e9493a0b048a8db9d6f"
server_key_version: "encryptionkey@0"
I20260811 00:55:22.540822 20029 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance:
uuid: "f35bbcfcf9a343c4bad5ed1f82330c84"
format_stamp: "Formatted at 2026-08-11 00:55:22 on dist-test-slave-h3ft"
server_key: "202873d4a73061ff635e1e1ef2b8e61f"
server_key_iv: "561c8744804e0e9493a0b048a8db9d6f"
server_key_version: "encryptionkey@0"
I20260811 00:55:22.543152 20029 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 00:55:22.544348 20054 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:22.544562 20029 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:22.544688 20029 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-2/wal
uuid: "f35bbcfcf9a343c4bad5ed1f82330c84"
format_stamp: "Formatted at 2026-08-11 00:55:22 on dist-test-slave-h3ft"
server_key: "202873d4a73061ff635e1e1ef2b8e61f"
server_key_iv: "561c8744804e0e9493a0b048a8db9d6f"
server_key_version: "encryptionkey@0"
I20260811 00:55:22.544800 20029 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:22.578122 20029 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:22.581318 20029 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:22.581590 20029 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:22.581956 20029 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:55:22.582508 20029 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:55:22.582578 20029 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:22.582619 20029 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:55:22.582648 20029 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:22.593338 20029 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.3:37419
I20260811 00:55:22.593430 20253 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.3:37419 every 8 connection(s)
I20260811 00:55:22.593895 20029 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
I20260811 00:55:22.597045 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 20029
I20260811 00:55:22.597180 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance
I20260811 00:55:22.597410 15640 external_mini_cluster.cc:1428] Setting key 0a0259fe8d1a4bd549743434d892cc35
Aug 11 00:55:22 dist-test-slave-h3ft krb5kdc[19410](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409722, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:22.607460 19549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:22.594966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:50403 (local address 127.15.70.62:44677)
0811 00:55:22.595091 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:22.595093 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:22.595353 (+ 260us) server_negotiation.cc:407] Connection header received
0811 00:55:22.596084 (+ 731us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:22.596086 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:22.596105 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:22.596168 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:22.597755 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:22.598444 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:22.600038 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:22.600305 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:22.600385 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:22.603527 (+ 3142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:22.603530 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:22.603530 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:22.603541 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:22.605268 (+ 1727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:22.605837 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:22.605838 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:22.605839 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:22.605911 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:22.606349 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:22.606351 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:22.606351 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:22.606580 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:22.606686 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:22.607253 (+ 567us) server_negotiation.cc:299] Negotiation successful
0811 00:55:22.607364 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 00:55:22.607641 20260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:22.594940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:44677 (local address 127.15.70.3:50403)
0811 00:55:22.595192 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:22.595243 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:22.595906 (+ 663us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:22.596267 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:22.596272 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:22.597234 (+ 962us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:22.597633 (+ 399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:22.597641 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:22.598578 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:22.598579 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:22.599883 (+ 1304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:22.599888 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:22.600419 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:22.600420 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:22.600572 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:22.601316 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:22.601327 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:22.603389 (+ 2062us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:22.605408 (+ 2019us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:22.605419 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:22.605422 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:22.605731 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:22.606021 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:22.606022 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:22.606040 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:22.606209 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:22.606670 (+ 461us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:22.606677 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:22.606868 (+ 191us) client_negotiation.cc:769] Sending connection context
0811 00:55:22.606973 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 00:55:22.607283 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":143,"threads_started":1}
I20260811 00:55:22.608320 20257 heartbeater.cc:347] Connected to a master server at 127.15.70.62:44677
I20260811 00:55:22.608453 20257 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:22.608749 20257 heartbeater.cc:511] Master 127.15.70.62:44677 requested a full tablet report, sending...
I20260811 00:55:22.609306 19482 ts_manager.cc:194] Registered new tserver with Master: f35bbcfcf9a343c4bad5ed1f82330c84 (127.15.70.3:37419)
I20260811 00:55:22.609788 15640 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 00:55:22.609853 19482 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.3@KRBTEST.COM'} at 127.15.70.3:50403
W20260811 00:55:22.627146 19549 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:55:22.625741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55522 (local address 127.15.70.62:44677)
0811 00:55:22.625867 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:22.625870 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:22.625987 (+ 117us) server_negotiation.cc:407] Connection header received
0811 00:55:22.626107 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:22.626108 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:22.626122 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:22.626212 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:22.626983 (+ 771us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55522: BlockingRecv error: recv got EOF from 127.0.0.1:55522 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 00:55:22.628765 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 19585
I20260811 00:55:22.666613 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 19804
I20260811 00:55:22.684906 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 20029
I20260811 00:55:22.707322 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 19434
2026-08-11T00:55:22Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2465 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409704606556-15640-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:55:22 dist-test-slave-h3ft krb5kdc[20274](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:55:22 dist-test-slave-h3ft krb5kdc[20274](info): set up 2 sockets
Aug 11 00:55:22 dist-test-slave-h3ft krb5kdc[20274](info): commencing operation
krb5kdc: starting...
W20260811 00:55:24.073905 15640 mini_kdc.cc:121] Time spent starting KDC: real 1.330s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Aug 11 00:55:24 dist-test-slave-h3ft krb5kdc[20274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409724, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:55:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:55:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.70.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
I20260811 00:55:24.227355 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:43767
--webserver_interface=127.15.70.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:40591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:43767
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:24.327524 20294 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:24.327873 20294 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:24.327920 20294 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:24.329322 20294 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:55:24.329419 20294 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:24.329444 20294 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:24.329474 20294 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:55:24.329504 20294 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:55:24.331423 20294 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:40591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:43767
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:43767
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20294
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:24.331813 20294 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:24.332131 20294 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:24.338416 20303 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:24.338433 20301 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:24.338450 20309 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:24.338795 20294 server_base.cc:1034] running on GCE node
I20260811 00:55:24.339183 20294 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:24.339555 20294 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:24.340739 20294 hybrid_clock.cc:648] HybridClock initialized: now 1786409724340705 us; error 53 us; skew 500 ppm
Aug 11 00:55:24 dist-test-slave-h3ft krb5kdc[20274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409724, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:24.349933 20294 init.cc:377] Logged in from keytab as kudu/127.15.70.62@KRBTEST.COM (short username kudu)
I20260811 00:55:24.350622 20294 webserver.cc:460] Webserver started at http://127.15.70.62:34095/ using document root <none> and password file <none>
I20260811 00:55:24.350942 20294 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:24.351043 20294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:24.351267 20294 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:24.352679 20294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "8a262a1fb7d54cdaad71b2446a204b7e"
format_stamp: "Formatted at 2026-08-11 00:55:24 on dist-test-slave-h3ft"
server_key: "d7d759a712bf6ad4fc8eccd53575ad02"
server_key_iv: "4898522dd109ab7ebffa2a3fc5062142"
server_key_version: "encryptionkey@0"
I20260811 00:55:24.353122 20294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "8a262a1fb7d54cdaad71b2446a204b7e"
format_stamp: "Formatted at 2026-08-11 00:55:24 on dist-test-slave-h3ft"
server_key: "d7d759a712bf6ad4fc8eccd53575ad02"
server_key_iv: "4898522dd109ab7ebffa2a3fc5062142"
server_key_version: "encryptionkey@0"
I20260811 00:55:24.354797 20294 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 00:55:24.355888 20320 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:24.356209 20294 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:24.356369 20294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "8a262a1fb7d54cdaad71b2446a204b7e"
format_stamp: "Formatted at 2026-08-11 00:55:24 on dist-test-slave-h3ft"
server_key: "d7d759a712bf6ad4fc8eccd53575ad02"
server_key_iv: "4898522dd109ab7ebffa2a3fc5062142"
server_key_version: "encryptionkey@0"
I20260811 00:55:24.356467 20294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:24.368078 20294 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:24.371163 20294 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:24.371379 20294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:24.377272 20294 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:43767
I20260811 00:55:24.377307 20406 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:43767 every 8 connection(s)
I20260811 00:55:24.378046 20294 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:55:24.379076 20409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:24.382089 20409 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a262a1fb7d54cdaad71b2446a204b7e: Bootstrap starting.
I20260811 00:55:24.382925 20409 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8a262a1fb7d54cdaad71b2446a204b7e: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:24.383378 20409 log.cc:824] T 00000000000000000000000000000000 P 8a262a1fb7d54cdaad71b2446a204b7e: Log is configured to *not* fsync() on all Append() calls
I20260811 00:55:24.384433 20409 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a262a1fb7d54cdaad71b2446a204b7e: No bootstrap required, opened a new log
I20260811 00:55:24.385901 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 20294
I20260811 00:55:24.386030 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 00:55:24.386248 15640 external_mini_cluster.cc:1428] Setting key fdfd738d389540fed6a4e6ff1f5f8728
I20260811 00:55:24.387344 20409 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8a262a1fb7d54cdaad71b2446a204b7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a262a1fb7d54cdaad71b2446a204b7e" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 43767 } }
I20260811 00:55:24.387634 20409 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8a262a1fb7d54cdaad71b2446a204b7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:24.387681 20409 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8a262a1fb7d54cdaad71b2446a204b7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a262a1fb7d54cdaad71b2446a204b7e, State: Initialized, Role: FOLLOWER
I20260811 00:55:24.387887 20409 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a262a1fb7d54cdaad71b2446a204b7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a262a1fb7d54cdaad71b2446a204b7e" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 43767 } }
I20260811 00:55:24.388002 20409 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8a262a1fb7d54cdaad71b2446a204b7e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:55:24.388055 20409 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8a262a1fb7d54cdaad71b2446a204b7e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:55:24.388137 20409 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8a262a1fb7d54cdaad71b2446a204b7e [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:24.388919 20409 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8a262a1fb7d54cdaad71b2446a204b7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a262a1fb7d54cdaad71b2446a204b7e" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 43767 } }
I20260811 00:55:24.389058 20409 leader_election.cc:302] T 00000000000000000000000000000000 P 8a262a1fb7d54cdaad71b2446a204b7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8a262a1fb7d54cdaad71b2446a204b7e; no voters:
I20260811 00:55:24.389276 20409 leader_election.cc:288] T 00000000000000000000000000000000 P 8a262a1fb7d54cdaad71b2446a204b7e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:55:24.389362 20416 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8a262a1fb7d54cdaad71b2446a204b7e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:55:24.389621 20416 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8a262a1fb7d54cdaad71b2446a204b7e [term 1 LEADER]: Becoming Leader. State: Replica: 8a262a1fb7d54cdaad71b2446a204b7e, State: Running, Role: LEADER
I20260811 00:55:24.389636 20409 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8a262a1fb7d54cdaad71b2446a204b7e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:55:24.389767 20416 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8a262a1fb7d54cdaad71b2446a204b7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a262a1fb7d54cdaad71b2446a204b7e" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 43767 } }
I20260811 00:55:24.390259 20416 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a262a1fb7d54cdaad71b2446a204b7e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8a262a1fb7d54cdaad71b2446a204b7e. Latest consensus state: current_term: 1 leader_uuid: "8a262a1fb7d54cdaad71b2446a204b7e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a262a1fb7d54cdaad71b2446a204b7e" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 43767 } } }
I20260811 00:55:24.390357 20416 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a262a1fb7d54cdaad71b2446a204b7e [sys.catalog]: This master's current role is: LEADER
I20260811 00:55:24.390805 20417 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a262a1fb7d54cdaad71b2446a204b7e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8a262a1fb7d54cdaad71b2446a204b7e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a262a1fb7d54cdaad71b2446a204b7e" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 43767 } } }
I20260811 00:55:24.390897 20417 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a262a1fb7d54cdaad71b2446a204b7e [sys.catalog]: This master's current role is: LEADER
I20260811 00:55:24.391083 20423 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:55:24.391727 20423 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:55:24.394035 20423 catalog_manager.cc:1347] Generated new cluster ID: f6382501b1a648dfa3370afddc1aa535
I20260811 00:55:24.394117 20423 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 00:55:24 dist-test-slave-h3ft krb5kdc[20274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409724, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:24.402962 20414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:24.386993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41446 (local address 127.15.70.62:43767)
0811 00:55:24.387948 (+ 955us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:24.387960 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:24.388002 (+ 42us) server_negotiation.cc:407] Connection header received
0811 00:55:24.388231 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:24.388242 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:24.388325 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:24.388542 (+ 217us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:24.389651 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:24.391509 (+ 1858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:24.392988 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:24.393700 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:24.393860 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:24.397469 (+ 3609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:24.397478 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:24.397478 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:24.397497 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:24.400362 (+ 2865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:24.400975 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:24.400980 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:24.400989 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:24.401168 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:24.401409 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:24.401410 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:24.401410 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:24.401828 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:24.402026 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:24.402384 (+ 358us) server_negotiation.cc:299] Negotiation successful
0811 00:55:24.402601 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":818,"thread_start_us":715,"threads_started":1}
I20260811 00:55:24.404843 15640 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 00:55:24.416631 20423 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:55:24.417328 20423 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:55:24.421963 20423 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8a262a1fb7d54cdaad71b2446a204b7e: Generated new TSK 0
I20260811 00:55:24.422267 20423 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:55:24.430946 20414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:24.426196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41460 (local address 127.15.70.62:43767)
0811 00:55:24.426268 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:24.426271 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:24.426428 (+ 157us) server_negotiation.cc:407] Connection header received
0811 00:55:24.426500 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:24.426502 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:24.426513 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:24.426586 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:24.427242 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:24.427874 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:24.429042 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:24.429294 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:24.429357 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:24.430294 (+ 937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:24.430296 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:24.430296 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:55:24.430606 (+ 310us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:24.430630 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:55:24.430637 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:24.430692 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:24.430783 (+ 91us) server_negotiation.cc:299] Negotiation successful
0811 00:55:24.430813 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 00:55:24.434485 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 20294
2026-08-11T00:55:24Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1722 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:55:24 dist-test-slave-h3ft krb5kdc[20458](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:55:24 dist-test-slave-h3ft krb5kdc[20458](info): set up 2 sockets
Aug 11 00:55:24 dist-test-slave-h3ft krb5kdc[20458](info): commencing operation
krb5kdc: starting...
W20260811 00:55:25.796849 15640 mini_kdc.cc:121] Time spent starting KDC: real 1.330s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Aug 11 00:55:25 dist-test-slave-h3ft krb5kdc[20458](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409725, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:55:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:55:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.70.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
I20260811 00:55:25.955699 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:41983
--webserver_interface=127.15.70.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:35803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:41983
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:26.054454 20485 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:26.054883 20485 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:26.054936 20485 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:26.056484 20485 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:55:26.056598 20485 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:26.056625 20485 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:26.056649 20485 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:55:26.056672 20485 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:55:26.058624 20485 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:35803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:41983
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:41983
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20485
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:26.059029 20485 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:26.059371 20485 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:26.065411 20491 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:26.065435 20493 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:26.065443 20497 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:26.065785 20485 server_base.cc:1034] running on GCE node
I20260811 00:55:26.066151 20485 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:26.066560 20485 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:26.067749 20485 hybrid_clock.cc:648] HybridClock initialized: now 1786409726067721 us; error 47 us; skew 500 ppm
Aug 11 00:55:26 dist-test-slave-h3ft krb5kdc[20458](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409726, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:26.071398 20485 init.cc:377] Logged in from keytab as kudu/127.15.70.62@KRBTEST.COM (short username kudu)
I20260811 00:55:26.072121 20485 webserver.cc:460] Webserver started at http://127.15.70.62:42503/ using document root <none> and password file <none>
I20260811 00:55:26.072430 20485 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:26.072485 20485 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:26.072633 20485 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:26.074044 20485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "0af4ee9b9a054e1da71a4464a0720076"
format_stamp: "Formatted at 2026-08-11 00:55:26 on dist-test-slave-h3ft"
server_key: "5b11b1f38e957d6cefbeaa1c0940f8a2"
server_key_iv: "08ac156ff9774b3910bdf5927356d4cc"
server_key_version: "encryptionkey@0"
I20260811 00:55:26.074472 20485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "0af4ee9b9a054e1da71a4464a0720076"
format_stamp: "Formatted at 2026-08-11 00:55:26 on dist-test-slave-h3ft"
server_key: "5b11b1f38e957d6cefbeaa1c0940f8a2"
server_key_iv: "08ac156ff9774b3910bdf5927356d4cc"
server_key_version: "encryptionkey@0"
I20260811 00:55:26.076486 20485 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260811 00:55:26.077484 20508 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:26.077751 20485 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:26.077922 20485 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "0af4ee9b9a054e1da71a4464a0720076"
format_stamp: "Formatted at 2026-08-11 00:55:26 on dist-test-slave-h3ft"
server_key: "5b11b1f38e957d6cefbeaa1c0940f8a2"
server_key_iv: "08ac156ff9774b3910bdf5927356d4cc"
server_key_version: "encryptionkey@0"
I20260811 00:55:26.078025 20485 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:26.094726 20485 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:26.097517 20485 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:26.097774 20485 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:26.103703 20485 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:41983
I20260811 00:55:26.103739 20611 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:41983 every 8 connection(s)
I20260811 00:55:26.104295 20485 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:55:26.105803 20612 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:26.109042 20612 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0af4ee9b9a054e1da71a4464a0720076: Bootstrap starting.
I20260811 00:55:26.109810 20612 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0af4ee9b9a054e1da71a4464a0720076: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:26.110141 20612 log.cc:824] T 00000000000000000000000000000000 P 0af4ee9b9a054e1da71a4464a0720076: Log is configured to *not* fsync() on all Append() calls
I20260811 00:55:26.111166 20612 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0af4ee9b9a054e1da71a4464a0720076: No bootstrap required, opened a new log
I20260811 00:55:26.113180 20612 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0af4ee9b9a054e1da71a4464a0720076 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0af4ee9b9a054e1da71a4464a0720076" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41983 } }
I20260811 00:55:26.113381 20612 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0af4ee9b9a054e1da71a4464a0720076 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:26.113409 20612 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0af4ee9b9a054e1da71a4464a0720076 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0af4ee9b9a054e1da71a4464a0720076, State: Initialized, Role: FOLLOWER
I20260811 00:55:26.113552 20612 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0af4ee9b9a054e1da71a4464a0720076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0af4ee9b9a054e1da71a4464a0720076" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41983 } }
I20260811 00:55:26.113617 20612 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0af4ee9b9a054e1da71a4464a0720076 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:55:26.113762 20612 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0af4ee9b9a054e1da71a4464a0720076 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:55:26.113847 20612 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0af4ee9b9a054e1da71a4464a0720076 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:26.113941 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 20485
I20260811 00:55:26.114069 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 00:55:26.114295 15640 external_mini_cluster.cc:1428] Setting key 713b9bd9a4bf5746c5948036236ad288
I20260811 00:55:26.115448 20612 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0af4ee9b9a054e1da71a4464a0720076 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0af4ee9b9a054e1da71a4464a0720076" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41983 } }
I20260811 00:55:26.115574 20612 leader_election.cc:302] T 00000000000000000000000000000000 P 0af4ee9b9a054e1da71a4464a0720076 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0af4ee9b9a054e1da71a4464a0720076; no voters:
I20260811 00:55:26.115818 20612 leader_election.cc:288] T 00000000000000000000000000000000 P 0af4ee9b9a054e1da71a4464a0720076 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:55:26.115880 20618 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0af4ee9b9a054e1da71a4464a0720076 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:55:26.116175 20618 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0af4ee9b9a054e1da71a4464a0720076 [term 1 LEADER]: Becoming Leader. State: Replica: 0af4ee9b9a054e1da71a4464a0720076, State: Running, Role: LEADER
I20260811 00:55:26.116286 20612 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0af4ee9b9a054e1da71a4464a0720076 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:55:26.116356 20618 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0af4ee9b9a054e1da71a4464a0720076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0af4ee9b9a054e1da71a4464a0720076" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41983 } }
I20260811 00:55:26.116971 20618 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0af4ee9b9a054e1da71a4464a0720076 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0af4ee9b9a054e1da71a4464a0720076. Latest consensus state: current_term: 1 leader_uuid: "0af4ee9b9a054e1da71a4464a0720076" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0af4ee9b9a054e1da71a4464a0720076" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41983 } } }
I20260811 00:55:26.117141 20618 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0af4ee9b9a054e1da71a4464a0720076 [sys.catalog]: This master's current role is: LEADER
I20260811 00:55:26.117456 20620 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0af4ee9b9a054e1da71a4464a0720076 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0af4ee9b9a054e1da71a4464a0720076" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0af4ee9b9a054e1da71a4464a0720076" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41983 } } }
I20260811 00:55:26.117566 20620 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0af4ee9b9a054e1da71a4464a0720076 [sys.catalog]: This master's current role is: LEADER
I20260811 00:55:26.118247 20630 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:55:26.118875 20630 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:55:26.121044 20630 catalog_manager.cc:1347] Generated new cluster ID: 9c0ced2673104df38b237fd54226d7e8
I20260811 00:55:26.121109 20630 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 00:55:26 dist-test-slave-h3ft krb5kdc[20458](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409725, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:26.130360 20617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:26.115103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45376 (local address 127.15.70.62:41983)
0811 00:55:26.115376 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:26.115387 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:26.115424 (+ 37us) server_negotiation.cc:407] Connection header received
0811 00:55:26.115614 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:26.115622 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:26.115714 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:26.115922 (+ 208us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:26.116928 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:26.118736 (+ 1808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:26.119947 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:26.120562 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:26.120689 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:26.124535 (+ 3846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:26.124543 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:26.124543 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:26.124577 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:26.127295 (+ 2718us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:26.127896 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:26.127903 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:26.127904 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:26.128080 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:26.128333 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:26.128334 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:26.128335 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:26.128823 (+ 488us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:26.129092 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:26.129830 (+ 738us) server_negotiation.cc:299] Negotiation successful
0811 00:55:26.130029 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":158,"threads_started":1}
I20260811 00:55:26.143520 20630 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:55:26.144541 20630 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:55:26.149750 20630 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0af4ee9b9a054e1da71a4464a0720076: Generated new TSK 0
I20260811 00:55:26.150048 20630 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.70.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab.
Entry for principal kudu/127.15.70.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab.
I20260811 00:55:26.195494 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.1:0
--local_ip_for_outbound_sockets=127.15.70.1
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:41983
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:35803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:26.344709 20648 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:26.344988 20648 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:26.345018 20648 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:26.346271 20648 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:26.346313 20648 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:26.346340 20648 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.1
I20260811 00:55:26.347920 20648 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:35803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:41983
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20648
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.1
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:26.348173 20648 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:26.348418 20648 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 00:55:26.354665 20648 server_base.cc:1034] running on GCE node
W20260811 00:55:26.354643 20657 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:26.354643 20661 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:26.354619 20658 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:26.355178 20648 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:26.355461 20648 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:26.356624 20648 hybrid_clock.cc:648] HybridClock initialized: now 1786409726356619 us; error 48 us; skew 500 ppm
Aug 11 00:55:26 dist-test-slave-h3ft krb5kdc[20458](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409726, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:26.359927 20648 init.cc:377] Logged in from keytab as kudu/127.15.70.1@KRBTEST.COM (short username kudu)
I20260811 00:55:26.360500 20648 webserver.cc:460] Webserver started at http://127.15.70.1:41625/ using document root <none> and password file <none>
I20260811 00:55:26.360805 20648 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:26.360857 20648 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:26.361050 20648 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:26.362314 20648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-0/data/instance:
uuid: "8279abd8aebb4b179ef5bee6272afa36"
format_stamp: "Formatted at 2026-08-11 00:55:26 on dist-test-slave-h3ft"
server_key: "4fd7a468f3ab1b357311538386fcfcd4"
server_key_iv: "fbf8bfe674271264cdf207ca9f6b1054"
server_key_version: "encryptionkey@0"
I20260811 00:55:26.362742 20648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance:
uuid: "8279abd8aebb4b179ef5bee6272afa36"
format_stamp: "Formatted at 2026-08-11 00:55:26 on dist-test-slave-h3ft"
server_key: "4fd7a468f3ab1b357311538386fcfcd4"
server_key_iv: "fbf8bfe674271264cdf207ca9f6b1054"
server_key_version: "encryptionkey@0"
I20260811 00:55:26.364380 20648 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260811 00:55:26.365417 20676 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:26.365664 20648 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:26.365789 20648 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-0/wal
uuid: "8279abd8aebb4b179ef5bee6272afa36"
format_stamp: "Formatted at 2026-08-11 00:55:26 on dist-test-slave-h3ft"
server_key: "4fd7a468f3ab1b357311538386fcfcd4"
server_key_iv: "fbf8bfe674271264cdf207ca9f6b1054"
server_key_version: "encryptionkey@0"
I20260811 00:55:26.365877 20648 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:26.378731 20648 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:26.381436 20648 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:26.381665 20648 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:26.382025 20648 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:55:26.382431 20648 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:55:26.382491 20648 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:26.382545 20648 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:55:26.382568 20648 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:26.389988 20648 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.1:36113
I20260811 00:55:26.390080 20859 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.1:36113 every 8 connection(s)
I20260811 00:55:26.390506 20648 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
I20260811 00:55:26.395316 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 20648
I20260811 00:55:26.395457 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance
I20260811 00:55:26.395679 15640 external_mini_cluster.cc:1428] Setting key 65fd8e42d981311f593b79a9acd6d6fe
Aug 11 00:55:26 dist-test-slave-h3ft krb5kdc[20458](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409726, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:26.403208 20617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:26.391538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:60815 (local address 127.15.70.62:41983)
0811 00:55:26.391618 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:26.391621 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:26.391894 (+ 273us) server_negotiation.cc:407] Connection header received
0811 00:55:26.392514 (+ 620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:26.392515 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:26.392532 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:26.392639 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:26.393966 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:26.394557 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:26.396235 (+ 1678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:26.396466 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:26.396582 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:26.399578 (+ 2996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:26.399580 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:26.399580 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:26.399591 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:26.401241 (+ 1650us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:26.401910 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:26.401912 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:26.401912 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:26.401984 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:26.402341 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:26.402342 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:26.402343 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:26.402493 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:26.402553 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:26.402969 (+ 416us) server_negotiation.cc:299] Negotiation successful
0811 00:55:26.403121 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 00:55:26.403576 20865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:26.391496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:41983 (local address 127.15.70.1:60815)
0811 00:55:26.391724 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:26.391779 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:26.392413 (+ 634us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:26.392768 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:26.392772 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:26.393541 (+ 769us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:26.393812 (+ 271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:26.393818 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:26.394829 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:26.394830 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:26.396148 (+ 1318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:26.396152 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:26.396575 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:26.396576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:26.396749 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:26.397439 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:26.397450 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:26.399445 (+ 1995us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:26.401344 (+ 1899us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:26.401355 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:26.401358 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:26.401811 (+ 453us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:26.402064 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:26.402065 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:26.402066 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:26.402259 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:26.402572 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:26.402580 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:26.402805 (+ 225us) client_negotiation.cc:769] Sending connection context
0811 00:55:26.402946 (+ 141us) client_negotiation.cc:240] Negotiation successful
0811 00:55:26.403214 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":135,"threads_started":1}
I20260811 00:55:26.404304 20860 heartbeater.cc:347] Connected to a master server at 127.15.70.62:41983
I20260811 00:55:26.404440 20860 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:26.404673 20860 heartbeater.cc:511] Master 127.15.70.62:41983 requested a full tablet report, sending...
I20260811 00:55:26.405344 20537 ts_manager.cc:194] Registered new tserver with Master: 8279abd8aebb4b179ef5bee6272afa36 (127.15.70.1:36113)
I20260811 00:55:26.406054 20537 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.1@KRBTEST.COM'} at 127.15.70.1:60815
WARNING: no policy specified for kudu/127.15.70.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab.
Entry for principal kudu/127.15.70.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab.
I20260811 00:55:26.430749 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.2:0
--local_ip_for_outbound_sockets=127.15.70.2
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:41983
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:35803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:26.531158 20868 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:26.531486 20868 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:26.531533 20868 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:26.532912 20868 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:26.532992 20868 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:26.533044 20868 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.2
I20260811 00:55:26.534825 20868 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:35803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:41983
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20868
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.2
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:26.535229 20868 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:26.535547 20868 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:26.541744 20881 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:26.541736 20883 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:26.541736 20880 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:26.542289 20868 server_base.cc:1034] running on GCE node
I20260811 00:55:26.542606 20868 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:26.542973 20868 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:26.544287 20868 hybrid_clock.cc:648] HybridClock initialized: now 1786409726544260 us; error 52 us; skew 500 ppm
Aug 11 00:55:26 dist-test-slave-h3ft krb5kdc[20458](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409726, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:26.547851 20868 init.cc:377] Logged in from keytab as kudu/127.15.70.2@KRBTEST.COM (short username kudu)
I20260811 00:55:26.548552 20868 webserver.cc:460] Webserver started at http://127.15.70.2:42097/ using document root <none> and password file <none>
I20260811 00:55:26.548861 20868 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:26.548939 20868 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:26.549137 20868 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:26.550446 20868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-1/data/instance:
uuid: "5174199c65014a8bb2571a856c12f633"
format_stamp: "Formatted at 2026-08-11 00:55:26 on dist-test-slave-h3ft"
server_key: "690eb4aabbe7abd0ce7ab12a5c56d7bc"
server_key_iv: "14416b0ea446596998b7f625f06dba3a"
server_key_version: "encryptionkey@0"
I20260811 00:55:26.550880 20868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance:
uuid: "5174199c65014a8bb2571a856c12f633"
format_stamp: "Formatted at 2026-08-11 00:55:26 on dist-test-slave-h3ft"
server_key: "690eb4aabbe7abd0ce7ab12a5c56d7bc"
server_key_iv: "14416b0ea446596998b7f625f06dba3a"
server_key_version: "encryptionkey@0"
I20260811 00:55:26.552603 20868 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 00:55:26.553534 20894 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:26.553807 20868 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:26.553917 20868 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-1/wal
uuid: "5174199c65014a8bb2571a856c12f633"
format_stamp: "Formatted at 2026-08-11 00:55:26 on dist-test-slave-h3ft"
server_key: "690eb4aabbe7abd0ce7ab12a5c56d7bc"
server_key_iv: "14416b0ea446596998b7f625f06dba3a"
server_key_version: "encryptionkey@0"
I20260811 00:55:26.553997 20868 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:26.583945 20868 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:26.587435 20868 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:26.587626 20868 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:26.587910 20868 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:55:26.588419 20868 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:55:26.588475 20868 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:26.588506 20868 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:55:26.588518 20868 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:26.597105 20868 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.2:45697
I20260811 00:55:26.597150 21083 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.2:45697 every 8 connection(s)
I20260811 00:55:26.597615 20868 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
I20260811 00:55:26.599263 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 20868
I20260811 00:55:26.599390 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance
I20260811 00:55:26.599633 15640 external_mini_cluster.cc:1428] Setting key 43249e8091cd81fae4509b00767cfd96
Aug 11 00:55:26 dist-test-slave-h3ft krb5kdc[20458](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409726, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:26.611343 20617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:26.598598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:46793 (local address 127.15.70.62:41983)
0811 00:55:26.598660 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:26.598662 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:26.598981 (+ 319us) server_negotiation.cc:407] Connection header received
0811 00:55:26.599881 (+ 900us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:26.599883 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:26.599902 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:26.599977 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:26.601751 (+ 1774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:26.602308 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:26.603866 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:26.604107 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:26.604200 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:26.607594 (+ 3394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:26.607597 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:26.607598 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:26.607608 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:26.609392 (+ 1784us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:26.610003 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:26.610005 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:26.610006 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:26.610082 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:26.610406 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:26.610407 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:26.610408 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:26.610574 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:26.610689 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:26.611094 (+ 405us) server_negotiation.cc:299] Negotiation successful
0811 00:55:26.611222 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
WARNING: no policy specified for kudu/127.15.70.3@KRBTEST.COM; defaulting to no policy
I20260811 00:55:26.611605 21087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:26.598560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:41983 (local address 127.15.70.2:46793)
0811 00:55:26.598739 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:26.598794 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:26.599728 (+ 934us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:26.600183 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:26.600188 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:26.601199 (+ 1011us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:26.601594 (+ 395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:26.601605 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:26.602441 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:26.602442 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:26.603729 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:26.603733 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:26.604212 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:26.604213 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:26.604429 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:26.605166 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:26.605180 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:26.607427 (+ 2247us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:26.609531 (+ 2104us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:26.609546 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:26.609550 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:26.609888 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:26.610163 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:26.610164 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:26.610165 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:26.610321 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:26.610687 (+ 366us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:26.610699 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:26.610898 (+ 199us) client_negotiation.cc:769] Sending connection context
0811 00:55:26.611049 (+ 151us) client_negotiation.cc:240] Negotiation successful
0811 00:55:26.611280 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":88,"threads_started":1}
I20260811 00:55:26.612262 21084 heartbeater.cc:347] Connected to a master server at 127.15.70.62:41983
I20260811 00:55:26.612433 21084 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:26.612707 21084 heartbeater.cc:511] Master 127.15.70.62:41983 requested a full tablet report, sending...
I20260811 00:55:26.613302 20537 ts_manager.cc:194] Registered new tserver with Master: 5174199c65014a8bb2571a856c12f633 (127.15.70.2:45697)
I20260811 00:55:26.613754 20537 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.2@KRBTEST.COM'} at 127.15.70.2:46793
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab.
Entry for principal kudu/127.15.70.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab.
I20260811 00:55:26.634786 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.3:0
--local_ip_for_outbound_sockets=127.15.70.3
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:41983
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:35803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:26.736838 21094 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:26.737135 21094 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:26.737164 21094 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:26.738564 21094 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:26.738626 21094 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:26.738657 21094 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.3
I20260811 00:55:26.740458 21094 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:35803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:41983
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21094
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.3
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:26.740803 21094 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:26.741109 21094 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:26.747078 21105 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:26.747138 21109 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:26.747138 21106 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:26.747408 21094 server_base.cc:1034] running on GCE node
I20260811 00:55:26.747793 21094 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:26.748085 21094 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:26.749258 21094 hybrid_clock.cc:648] HybridClock initialized: now 1786409726749228 us; error 57 us; skew 500 ppm
Aug 11 00:55:26 dist-test-slave-h3ft krb5kdc[20458](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409726, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:26.753382 21094 init.cc:377] Logged in from keytab as kudu/127.15.70.3@KRBTEST.COM (short username kudu)
I20260811 00:55:26.753973 21094 webserver.cc:460] Webserver started at http://127.15.70.3:33321/ using document root <none> and password file <none>
I20260811 00:55:26.754269 21094 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:26.754321 21094 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:26.754495 21094 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:26.755858 21094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-2/data/instance:
uuid: "713f1caa5154497dbcd09e7baea7ff87"
format_stamp: "Formatted at 2026-08-11 00:55:26 on dist-test-slave-h3ft"
server_key: "2870f34995b50b0a3cf18e7952656c8f"
server_key_iv: "dce4dd2dab8198a6a3185758ab855c47"
server_key_version: "encryptionkey@0"
I20260811 00:55:26.756282 21094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance:
uuid: "713f1caa5154497dbcd09e7baea7ff87"
format_stamp: "Formatted at 2026-08-11 00:55:26 on dist-test-slave-h3ft"
server_key: "2870f34995b50b0a3cf18e7952656c8f"
server_key_iv: "dce4dd2dab8198a6a3185758ab855c47"
server_key_version: "encryptionkey@0"
I20260811 00:55:26.757915 21094 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 00:55:26.758828 21118 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:26.759073 21094 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:26.759191 21094 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-2/wal
uuid: "713f1caa5154497dbcd09e7baea7ff87"
format_stamp: "Formatted at 2026-08-11 00:55:26 on dist-test-slave-h3ft"
server_key: "2870f34995b50b0a3cf18e7952656c8f"
server_key_iv: "dce4dd2dab8198a6a3185758ab855c47"
server_key_version: "encryptionkey@0"
I20260811 00:55:26.759277 21094 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:26.783514 21094 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:26.786019 21094 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:26.786180 21094 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:26.786417 21094 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:55:26.786835 21094 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:55:26.786875 21094 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:26.786935 21094 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:55:26.786962 21094 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:26.794831 21094 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.3:35379
I20260811 00:55:26.794878 21302 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.3:35379 every 8 connection(s)
I20260811 00:55:26.795383 21094 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
I20260811 00:55:26.803321 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 21094
I20260811 00:55:26.803511 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance
I20260811 00:55:26.803781 15640 external_mini_cluster.cc:1428] Setting key 025ad963bf9f212016dba453784f46a5
Aug 11 00:55:26 dist-test-slave-h3ft krb5kdc[20458](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409726, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:26.807942 20617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:26.796506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:40565 (local address 127.15.70.62:41983)
0811 00:55:26.796633 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:26.796636 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:26.796862 (+ 226us) server_negotiation.cc:407] Connection header received
0811 00:55:26.797562 (+ 700us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:26.797564 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:26.797582 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:26.797633 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:26.798922 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:26.799619 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:26.801179 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:26.801451 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:26.801570 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:26.804901 (+ 3331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:26.804903 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:26.804903 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:26.804913 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:26.806431 (+ 1518us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:26.806894 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:26.806895 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:26.806895 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:26.806953 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:26.807297 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:26.807297 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:26.807297 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:26.807441 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:26.807500 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:26.807782 (+ 282us) server_negotiation.cc:299] Negotiation successful
0811 00:55:26.807859 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 00:55:26.808246 21305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:26.796398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:41983 (local address 127.15.70.3:40565)
0811 00:55:26.796702 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:26.796751 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:26.797430 (+ 679us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:26.797742 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:26.797746 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:26.798499 (+ 753us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:26.798784 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:26.798791 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:26.799873 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:26.799874 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:26.801018 (+ 1144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:26.801022 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:26.801587 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:26.801589 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:26.801770 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:26.802612 (+ 842us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:26.802623 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:26.804797 (+ 2174us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:26.806523 (+ 1726us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:26.806533 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:26.806535 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:26.806821 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:26.807100 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:26.807101 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:26.807101 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:26.807234 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:26.807494 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:26.807498 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:26.807658 (+ 160us) client_negotiation.cc:769] Sending connection context
0811 00:55:26.807751 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 00:55:26.807914 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":121,"threads_started":1}
I20260811 00:55:26.808882 21303 heartbeater.cc:347] Connected to a master server at 127.15.70.62:41983
I20260811 00:55:26.809021 21303 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:26.809293 21303 heartbeater.cc:511] Master 127.15.70.62:41983 requested a full tablet report, sending...
I20260811 00:55:26.809801 20537 ts_manager.cc:194] Registered new tserver with Master: 713f1caa5154497dbcd09e7baea7ff87 (127.15.70.3:35379)
I20260811 00:55:26.810263 20537 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.3@KRBTEST.COM'} at 127.15.70.3:40565
I20260811 00:55:26.816546 15640 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 00:55:26 dist-test-slave-h3ft krb5kdc[20458](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409726, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 11 00:55:26 dist-test-slave-h3ft krb5kdc[20458](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409726, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:26.847208 20617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:26.837473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45392 (local address 127.15.70.62:41983)
0811 00:55:26.837591 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:26.837594 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:26.837728 (+ 134us) server_negotiation.cc:407] Connection header received
0811 00:55:26.837849 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:26.837850 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:26.837872 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:26.837947 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:26.838702 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:26.839367 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:26.840216 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:26.840425 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:26.840515 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:26.843789 (+ 3274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:26.843792 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:26.843792 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:26.843803 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:26.845699 (+ 1896us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:26.846144 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:26.846146 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:26.846146 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:26.846219 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:26.846469 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:26.846471 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:26.846471 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:26.846689 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:26.846811 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:26.846927 (+ 116us) server_negotiation.cc:299] Negotiation successful
0811 00:55:26.847062 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260811 00:55:26.848097 20537 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:45392
I20260811 00:55:26.848963 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 20648
I20260811 00:55:26.882150 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 20868
I20260811 00:55:26.896114 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 21094
I20260811 00:55:26.914448 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 20485
2026-08-11T00:55:26Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2484 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:55:26 dist-test-slave-h3ft krb5kdc[21319](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:55:26 dist-test-slave-h3ft krb5kdc[21319](info): set up 2 sockets
Aug 11 00:55:26 dist-test-slave-h3ft krb5kdc[21319](info): commencing operation
krb5kdc: starting...
W20260811 00:55:28.404991 15640 mini_kdc.cc:121] Time spent starting KDC: real 1.454s user 0.006s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
W20260811 00:55:28.536938 15640 mini_kdc.cc:253] Time spent creating user principal test-admin: real 0.132s user 0.000s sys 0.003s
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
W20260811 00:55:28.765705 15640 mini_kdc.cc:253] Time spent creating user principal test-user: real 0.229s user 0.000s sys 0.003s
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
W20260811 00:55:28.993079 15640 mini_kdc.cc:253] Time spent creating user principal joe-interloper: real 0.227s user 0.000s sys 0.003s
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/krb5kdc/test-user.keytab.
W20260811 00:55:29.147276 15640 mini_kdc.cc:302] Time spent creating keytab for test-user: real 0.154s user 0.000s sys 0.003s
Aug 11 00:55:29 dist-test-slave-h3ft krb5kdc[21319](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409729, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:55:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:55:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.70.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
I20260811 00:55:29.211915 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:39869
--webserver_interface=127.15.70.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:38373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:39869
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:29.312129 21340 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:29.312435 21340 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:29.312462 21340 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:29.313882 21340 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:55:29.313947 21340 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:29.313963 21340 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:29.313978 21340 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:55:29.314038 21340 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:55:29.315884 21340 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:38373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:39869
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:39869
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21340
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:29.316258 21340 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:29.316565 21340 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:29.322621 21347 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:29.322804 21340 server_base.cc:1034] running on GCE node
W20260811 00:55:29.322661 21354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:29.322631 21350 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:29.323334 21340 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:29.323787 21340 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:29.324996 21340 hybrid_clock.cc:648] HybridClock initialized: now 1786409729324987 us; error 43 us; skew 500 ppm
Aug 11 00:55:29 dist-test-slave-h3ft krb5kdc[21319](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409729, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:29.328379 21340 init.cc:377] Logged in from keytab as kudu/127.15.70.62@KRBTEST.COM (short username kudu)
I20260811 00:55:29.329005 21340 webserver.cc:460] Webserver started at http://127.15.70.62:35435/ using document root <none> and password file <none>
I20260811 00:55:29.329293 21340 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:29.329370 21340 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:29.329557 21340 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:29.330866 21340 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "5ec8d839095a4686955842c38eba469e"
format_stamp: "Formatted at 2026-08-11 00:55:29 on dist-test-slave-h3ft"
server_key: "0f753c17ff1af0ecf0738719f6e6089f"
server_key_iv: "a8850a7680dde869bfef7a41130de579"
server_key_version: "encryptionkey@0"
I20260811 00:55:29.331364 21340 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "5ec8d839095a4686955842c38eba469e"
format_stamp: "Formatted at 2026-08-11 00:55:29 on dist-test-slave-h3ft"
server_key: "0f753c17ff1af0ecf0738719f6e6089f"
server_key_iv: "a8850a7680dde869bfef7a41130de579"
server_key_version: "encryptionkey@0"
I20260811 00:55:29.333009 21340 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:29.333935 21364 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:29.334169 21340 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:29.334295 21340 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "5ec8d839095a4686955842c38eba469e"
format_stamp: "Formatted at 2026-08-11 00:55:29 on dist-test-slave-h3ft"
server_key: "0f753c17ff1af0ecf0738719f6e6089f"
server_key_iv: "a8850a7680dde869bfef7a41130de579"
server_key_version: "encryptionkey@0"
I20260811 00:55:29.334381 21340 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:29.384644 21340 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:29.387398 21340 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:29.387643 21340 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:29.393162 21340 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:39869
I20260811 00:55:29.393219 21453 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:39869 every 8 connection(s)
I20260811 00:55:29.393919 21340 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:55:29.394934 21454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:29.398023 21454 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ec8d839095a4686955842c38eba469e: Bootstrap starting.
I20260811 00:55:29.398764 21454 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5ec8d839095a4686955842c38eba469e: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:29.399187 21454 log.cc:824] T 00000000000000000000000000000000 P 5ec8d839095a4686955842c38eba469e: Log is configured to *not* fsync() on all Append() calls
I20260811 00:55:29.400085 21454 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ec8d839095a4686955842c38eba469e: No bootstrap required, opened a new log
I20260811 00:55:29.401315 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 21340
I20260811 00:55:29.401467 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 00:55:29.401698 15640 external_mini_cluster.cc:1428] Setting key 255f163dd530dac6da59ad33dccc22b5
I20260811 00:55:29.402397 21454 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5ec8d839095a4686955842c38eba469e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ec8d839095a4686955842c38eba469e" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 39869 } }
I20260811 00:55:29.402669 21454 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5ec8d839095a4686955842c38eba469e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:29.402727 21454 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5ec8d839095a4686955842c38eba469e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec8d839095a4686955842c38eba469e, State: Initialized, Role: FOLLOWER
I20260811 00:55:29.402885 21454 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5ec8d839095a4686955842c38eba469e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ec8d839095a4686955842c38eba469e" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 39869 } }
I20260811 00:55:29.403007 21454 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5ec8d839095a4686955842c38eba469e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:55:29.403081 21454 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5ec8d839095a4686955842c38eba469e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:55:29.403141 21454 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5ec8d839095a4686955842c38eba469e [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:29.403996 21454 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5ec8d839095a4686955842c38eba469e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ec8d839095a4686955842c38eba469e" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 39869 } }
I20260811 00:55:29.404141 21454 leader_election.cc:302] T 00000000000000000000000000000000 P 5ec8d839095a4686955842c38eba469e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5ec8d839095a4686955842c38eba469e; no voters:
I20260811 00:55:29.404359 21454 leader_election.cc:288] T 00000000000000000000000000000000 P 5ec8d839095a4686955842c38eba469e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:55:29.404433 21461 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5ec8d839095a4686955842c38eba469e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:55:29.404618 21461 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5ec8d839095a4686955842c38eba469e [term 1 LEADER]: Becoming Leader. State: Replica: 5ec8d839095a4686955842c38eba469e, State: Running, Role: LEADER
I20260811 00:55:29.404717 21461 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5ec8d839095a4686955842c38eba469e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ec8d839095a4686955842c38eba469e" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 39869 } }
I20260811 00:55:29.405172 21462 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ec8d839095a4686955842c38eba469e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5ec8d839095a4686955842c38eba469e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ec8d839095a4686955842c38eba469e" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 39869 } } }
I20260811 00:55:29.405260 21462 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ec8d839095a4686955842c38eba469e [sys.catalog]: This master's current role is: LEADER
I20260811 00:55:29.405146 21464 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ec8d839095a4686955842c38eba469e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5ec8d839095a4686955842c38eba469e. Latest consensus state: current_term: 1 leader_uuid: "5ec8d839095a4686955842c38eba469e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ec8d839095a4686955842c38eba469e" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 39869 } } }
I20260811 00:55:29.405426 21464 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ec8d839095a4686955842c38eba469e [sys.catalog]: This master's current role is: LEADER
I20260811 00:55:29.405520 21466 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:55:29.406122 21466 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:55:29.404744 21454 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5ec8d839095a4686955842c38eba469e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:55:29.408186 21466 catalog_manager.cc:1347] Generated new cluster ID: d998733224314a43b95f327e8e80d11a
I20260811 00:55:29.408242 21466 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 00:55:29 dist-test-slave-h3ft krb5kdc[21319](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409729, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:29.416556 21459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:29.402560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49524 (local address 127.15.70.62:39869)
0811 00:55:29.403386 (+ 826us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:29.403398 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:29.403432 (+ 34us) server_negotiation.cc:407] Connection header received
0811 00:55:29.403570 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:29.403577 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:29.403634 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:29.403772 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:29.404857 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:29.406394 (+ 1537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:29.407606 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:29.408301 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:29.408420 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:29.412023 (+ 3603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:29.412029 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:29.412029 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:29.412052 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:29.414350 (+ 2298us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:29.414861 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:29.414865 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:29.414865 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:29.415039 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:29.415315 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:29.415316 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:29.415317 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:29.415748 (+ 431us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:29.415923 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:29.416088 (+ 165us) server_negotiation.cc:299] Negotiation successful
0811 00:55:29.416259 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":754,"thread_start_us":715,"threads_started":1}
I20260811 00:55:29.419413 21466 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:55:29.420028 21466 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:55:29.429023 21466 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5ec8d839095a4686955842c38eba469e: Generated new TSK 0
I20260811 00:55:29.429302 21466 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.70.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab.
Entry for principal kudu/127.15.70.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab.
I20260811 00:55:29.467557 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.1:0
--local_ip_for_outbound_sockets=127.15.70.1
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:39869
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:38373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:29.572798 21494 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:29.573099 21494 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:29.573130 21494 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:29.574401 21494 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:29.574453 21494 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:29.574484 21494 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.1
I20260811 00:55:29.576333 21494 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:38373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:39869
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21494
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.1
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:29.576625 21494 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:29.576864 21494 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:29.583635 21503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:29.583621 21507 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:29.583621 21500 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:29.583997 21494 server_base.cc:1034] running on GCE node
I20260811 00:55:29.584275 21494 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:29.584604 21494 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:29.585817 21494 hybrid_clock.cc:648] HybridClock initialized: now 1786409729585799 us; error 48 us; skew 500 ppm
Aug 11 00:55:29 dist-test-slave-h3ft krb5kdc[21319](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409729, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:29.589372 21494 init.cc:377] Logged in from keytab as kudu/127.15.70.1@KRBTEST.COM (short username kudu)
I20260811 00:55:29.590060 21494 webserver.cc:460] Webserver started at http://127.15.70.1:46283/ using document root <none> and password file <none>
I20260811 00:55:29.590368 21494 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:29.590678 21494 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:29.590919 21494 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:29.592332 21494 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-0/data/instance:
uuid: "0f807e8c03234448babc0debe1ec528a"
format_stamp: "Formatted at 2026-08-11 00:55:29 on dist-test-slave-h3ft"
server_key: "b612d42f9a01a52251ff4cdf6f1c9dce"
server_key_iv: "932b927fb4fa26617e2056c8af94973b"
server_key_version: "encryptionkey@0"
I20260811 00:55:29.592811 21494 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance:
uuid: "0f807e8c03234448babc0debe1ec528a"
format_stamp: "Formatted at 2026-08-11 00:55:29 on dist-test-slave-h3ft"
server_key: "b612d42f9a01a52251ff4cdf6f1c9dce"
server_key_iv: "932b927fb4fa26617e2056c8af94973b"
server_key_version: "encryptionkey@0"
I20260811 00:55:29.594834 21494 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 00:55:29.595991 21518 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:29.596299 21494 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:29.596452 21494 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-0/wal
uuid: "0f807e8c03234448babc0debe1ec528a"
format_stamp: "Formatted at 2026-08-11 00:55:29 on dist-test-slave-h3ft"
server_key: "b612d42f9a01a52251ff4cdf6f1c9dce"
server_key_iv: "932b927fb4fa26617e2056c8af94973b"
server_key_version: "encryptionkey@0"
I20260811 00:55:29.596560 21494 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:29.632246 21494 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:29.635097 21494 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:29.635313 21494 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:29.635658 21494 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:55:29.636116 21494 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:55:29.636194 21494 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:29.636246 21494 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:55:29.636281 21494 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:29.644235 21494 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.1:44015
I20260811 00:55:29.644289 21689 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.1:44015 every 8 connection(s)
I20260811 00:55:29.644726 21494 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
I20260811 00:55:29.646101 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 21494
I20260811 00:55:29.646245 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance
I20260811 00:55:29.646452 15640 external_mini_cluster.cc:1428] Setting key 9c38fe05b02b8f087bd566f54536b7e4
Aug 11 00:55:29 dist-test-slave-h3ft krb5kdc[21319](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409729, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:29.657981 21459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:29.645733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:48155 (local address 127.15.70.62:39869)
0811 00:55:29.645825 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:29.645827 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:29.646138 (+ 311us) server_negotiation.cc:407] Connection header received
0811 00:55:29.647668 (+ 1530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:29.647669 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:29.647686 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:29.647753 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:29.648627 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:29.649248 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:29.650546 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:29.650801 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:29.650906 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:29.654249 (+ 3343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:29.654251 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:29.654251 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:29.654264 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:29.656042 (+ 1778us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:29.656644 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:29.656645 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:29.656645 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:29.656714 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:29.657039 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:29.657040 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:29.657041 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:29.657199 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:29.657260 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:29.657711 (+ 451us) server_negotiation.cc:299] Negotiation successful
0811 00:55:29.657840 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 00:55:29.658210 21694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:29.645696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39869 (local address 127.15.70.1:48155)
0811 00:55:29.645931 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:29.645985 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:29.647522 (+ 1537us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:29.647853 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:29.647858 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:29.648241 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:29.648503 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:29.648508 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:29.649372 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:29.649373 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:29.650427 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:29.650431 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:29.650964 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:29.650965 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:29.651186 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:29.651892 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:29.651904 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:29.654094 (+ 2190us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:29.656167 (+ 2073us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:29.656176 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:29.656179 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:29.656550 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:29.656792 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:29.656792 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:29.656793 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:29.656961 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:29.657275 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:29.657283 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:29.657502 (+ 219us) client_negotiation.cc:769] Sending connection context
0811 00:55:29.657650 (+ 148us) client_negotiation.cc:240] Negotiation successful
0811 00:55:29.657888 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":113,"threads_started":1}
WARNING: no policy specified for kudu/127.15.70.2@KRBTEST.COM; defaulting to no policy
I20260811 00:55:29.659238 21690 heartbeater.cc:347] Connected to a master server at 127.15.70.62:39869
I20260811 00:55:29.659402 21690 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:29.659721 21690 heartbeater.cc:511] Master 127.15.70.62:39869 requested a full tablet report, sending...
I20260811 00:55:29.660478 21398 ts_manager.cc:194] Registered new tserver with Master: 0f807e8c03234448babc0debe1ec528a (127.15.70.1:44015)
I20260811 00:55:29.661298 21398 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.1@KRBTEST.COM'} at 127.15.70.1:48155
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab.
Entry for principal kudu/127.15.70.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab.
I20260811 00:55:29.683746 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.2:0
--local_ip_for_outbound_sockets=127.15.70.2
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:39869
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:38373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:29.788995 21701 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:29.789361 21701 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:29.789408 21701 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:29.790848 21701 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:29.790969 21701 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:29.791049 21701 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.2
I20260811 00:55:29.792989 21701 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:38373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:39869
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21701
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.2
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:29.793344 21701 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:29.793651 21701 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:29.800349 21710 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:29.800621 21701 server_base.cc:1034] running on GCE node
W20260811 00:55:29.800340 21715 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:29.800330 21711 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:29.801192 21701 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:29.801596 21701 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:29.802794 21701 hybrid_clock.cc:648] HybridClock initialized: now 1786409729802754 us; error 65 us; skew 500 ppm
Aug 11 00:55:29 dist-test-slave-h3ft krb5kdc[21319](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409729, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:29.806664 21701 init.cc:377] Logged in from keytab as kudu/127.15.70.2@KRBTEST.COM (short username kudu)
I20260811 00:55:29.807530 21701 webserver.cc:460] Webserver started at http://127.15.70.2:40293/ using document root <none> and password file <none>
I20260811 00:55:29.807868 21701 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:29.807952 21701 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:29.808135 21701 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:29.809509 21701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-1/data/instance:
uuid: "b9e9afffec114181a339f19b3298fe73"
format_stamp: "Formatted at 2026-08-11 00:55:29 on dist-test-slave-h3ft"
server_key: "4ba649882d1db96072e67c64faa38cf8"
server_key_iv: "a6379fabd159e82c0a5c9f7dd794e40a"
server_key_version: "encryptionkey@0"
I20260811 00:55:29.809981 21701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance:
uuid: "b9e9afffec114181a339f19b3298fe73"
format_stamp: "Formatted at 2026-08-11 00:55:29 on dist-test-slave-h3ft"
server_key: "4ba649882d1db96072e67c64faa38cf8"
server_key_iv: "a6379fabd159e82c0a5c9f7dd794e40a"
server_key_version: "encryptionkey@0"
I20260811 00:55:29.811937 21701 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260811 00:55:29.813004 21723 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:29.813321 21701 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:29.813580 21701 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-1/wal
uuid: "b9e9afffec114181a339f19b3298fe73"
format_stamp: "Formatted at 2026-08-11 00:55:29 on dist-test-slave-h3ft"
server_key: "4ba649882d1db96072e67c64faa38cf8"
server_key_iv: "a6379fabd159e82c0a5c9f7dd794e40a"
server_key_version: "encryptionkey@0"
I20260811 00:55:29.813694 21701 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:29.832994 21701 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:29.836302 21701 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:29.836540 21701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:29.836865 21701 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:55:29.837353 21701 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:55:29.837394 21701 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:29.837422 21701 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:55:29.837435 21701 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:29.845305 21701 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.2:41357
I20260811 00:55:29.845440 21897 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.2:41357 every 8 connection(s)
I20260811 00:55:29.845810 21701 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
I20260811 00:55:29.852573 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 21701
I20260811 00:55:29.852756 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance
I20260811 00:55:29.853034 15640 external_mini_cluster.cc:1428] Setting key 618c63a20737934a58cc564ed089a6d2
Aug 11 00:55:29 dist-test-slave-h3ft krb5kdc[21319](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409729, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:29.858218 21459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:29.846833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:56841 (local address 127.15.70.62:39869)
0811 00:55:29.847062 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:29.847065 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:29.847286 (+ 221us) server_negotiation.cc:407] Connection header received
0811 00:55:29.848611 (+ 1325us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:29.848612 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:29.848628 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:29.848699 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:29.849508 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:29.850086 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:29.851249 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:29.851470 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:29.851565 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:29.854567 (+ 3002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:29.854568 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:29.854569 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:29.854585 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:29.856368 (+ 1783us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:29.856950 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:29.856952 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:29.856952 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:29.857036 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:29.857328 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:29.857329 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:29.857329 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:29.857518 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:29.857596 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:29.857928 (+ 332us) server_negotiation.cc:299] Negotiation successful
0811 00:55:29.858054 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154}
I20260811 00:55:29.858315 21904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:29.846775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39869 (local address 127.15.70.2:56841)
0811 00:55:29.847121 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:29.847178 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:29.848474 (+ 1296us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:29.848795 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:29.848800 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:29.849135 (+ 335us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:29.849382 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:29.849386 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:29.850193 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:29.850195 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:29.851144 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:29.851147 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:29.851573 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:29.851574 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:29.851721 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:29.852391 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:29.852401 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:29.854427 (+ 2026us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:29.856475 (+ 2048us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:29.856487 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:29.856491 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:29.856867 (+ 376us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:29.857113 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:29.857115 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:29.857115 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:29.857259 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:29.857589 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:29.857595 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:29.857760 (+ 165us) client_negotiation.cc:769] Sending connection context
0811 00:55:29.857870 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 00:55:29.858054 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":163,"threads_started":1}
I20260811 00:55:29.859076 21899 heartbeater.cc:347] Connected to a master server at 127.15.70.62:39869
I20260811 00:55:29.859226 21899 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:29.859491 21899 heartbeater.cc:511] Master 127.15.70.62:39869 requested a full tablet report, sending...
I20260811 00:55:29.860133 21398 ts_manager.cc:194] Registered new tserver with Master: b9e9afffec114181a339f19b3298fe73 (127.15.70.2:41357)
I20260811 00:55:29.860690 21398 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.2@KRBTEST.COM'} at 127.15.70.2:56841
WARNING: no policy specified for kudu/127.15.70.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab.
Entry for principal kudu/127.15.70.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab.
I20260811 00:55:29.892343 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.3:0
--local_ip_for_outbound_sockets=127.15.70.3
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:39869
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:38373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:29.994107 21907 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:29.994406 21907 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:29.994436 21907 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:29.995961 21907 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:29.996027 21907 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:29.996062 21907 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.3
I20260811 00:55:29.997982 21907 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:38373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:39869
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21907
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.3
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:29.998348 21907 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:29.998688 21907 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:30.005975 21912 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:30.005992 21918 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:30.006264 21907 server_base.cc:1034] running on GCE node
W20260811 00:55:30.005992 21913 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:30.006701 21907 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:30.007155 21907 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:30.008407 21907 hybrid_clock.cc:648] HybridClock initialized: now 1786409730008383 us; error 51 us; skew 500 ppm
Aug 11 00:55:30 dist-test-slave-h3ft krb5kdc[21319](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409730, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:30.012218 21907 init.cc:377] Logged in from keytab as kudu/127.15.70.3@KRBTEST.COM (short username kudu)
I20260811 00:55:30.012897 21907 webserver.cc:460] Webserver started at http://127.15.70.3:39615/ using document root <none> and password file <none>
I20260811 00:55:30.013244 21907 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:30.013329 21907 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:30.013520 21907 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:30.014914 21907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-2/data/instance:
uuid: "3e05f47b830946138d874ec969a30b71"
format_stamp: "Formatted at 2026-08-11 00:55:30 on dist-test-slave-h3ft"
server_key: "51f54d12145c0b6c5acd9c1eebbbaabb"
server_key_iv: "3e35f9c203f789de07f7fe0bce4a0e41"
server_key_version: "encryptionkey@0"
I20260811 00:55:30.015470 21907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance:
uuid: "3e05f47b830946138d874ec969a30b71"
format_stamp: "Formatted at 2026-08-11 00:55:30 on dist-test-slave-h3ft"
server_key: "51f54d12145c0b6c5acd9c1eebbbaabb"
server_key_iv: "3e35f9c203f789de07f7fe0bce4a0e41"
server_key_version: "encryptionkey@0"
I20260811 00:55:30.017423 21907 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260811 00:55:30.018522 21940 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:30.018800 21907 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:30.019038 21907 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-2/wal
uuid: "3e05f47b830946138d874ec969a30b71"
format_stamp: "Formatted at 2026-08-11 00:55:30 on dist-test-slave-h3ft"
server_key: "51f54d12145c0b6c5acd9c1eebbbaabb"
server_key_iv: "3e35f9c203f789de07f7fe0bce4a0e41"
server_key_version: "encryptionkey@0"
I20260811 00:55:30.019171 21907 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:30.034235 21907 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:30.037572 21907 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:30.037845 21907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:30.038177 21907 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:55:30.038676 21907 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:55:30.038743 21907 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:30.038795 21907 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:55:30.038825 21907 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:30.046329 21907 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.3:43131
I20260811 00:55:30.046384 22111 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.3:43131 every 8 connection(s)
I20260811 00:55:30.046816 21907 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
I20260811 00:55:30.050899 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 21907
I20260811 00:55:30.051054 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance
I20260811 00:55:30.051302 15640 external_mini_cluster.cc:1428] Setting key 7bdf67383e76214670e7b634c1918091
Aug 11 00:55:30 dist-test-slave-h3ft krb5kdc[21319](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409730, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:30.059621 21459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:30.047906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:47417 (local address 127.15.70.62:39869)
0811 00:55:30.048047 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:30.048050 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:30.048320 (+ 270us) server_negotiation.cc:407] Connection header received
0811 00:55:30.049441 (+ 1121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:30.049443 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:30.049460 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:30.049522 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:30.050370 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:30.051308 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:30.052839 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:30.053081 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:30.053155 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:30.055950 (+ 2795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:30.055951 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:30.055952 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:30.055961 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:30.057678 (+ 1717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:30.058207 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:30.058209 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:30.058209 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:30.058321 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:30.058745 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:30.058746 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:30.058746 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:30.058902 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:30.059084 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:30.059420 (+ 336us) server_negotiation.cc:299] Negotiation successful
0811 00:55:30.059531 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260811 00:55:30.059826 22115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:30.047897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39869 (local address 127.15.70.3:47417)
0811 00:55:30.048161 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:30.048211 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:30.049304 (+ 1093us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:30.049624 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:30.049628 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:30.049971 (+ 343us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:30.050255 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:30.050260 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:30.051538 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:30.051539 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:30.052745 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:30.052749 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:30.053176 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:30.053177 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:30.053309 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:30.053927 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:30.053937 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:30.055828 (+ 1891us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:30.057782 (+ 1954us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:30.057793 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:30.057796 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:30.058091 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:30.058464 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:30.058465 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:30.058465 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:30.058616 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:30.058977 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:30.058982 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:30.059240 (+ 258us) client_negotiation.cc:769] Sending connection context
0811 00:55:30.059348 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 00:55:30.059524 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":133,"threads_started":1}
I20260811 00:55:30.060832 22112 heartbeater.cc:347] Connected to a master server at 127.15.70.62:39869
I20260811 00:55:30.060981 22112 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:30.061430 22112 heartbeater.cc:511] Master 127.15.70.62:39869 requested a full tablet report, sending...
I20260811 00:55:30.062119 21398 ts_manager.cc:194] Registered new tserver with Master: 3e05f47b830946138d874ec969a30b71 (127.15.70.3:43131)
I20260811 00:55:30.062582 21398 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.3@KRBTEST.COM'} at 127.15.70.3:47417
I20260811 00:55:30.063866 15640 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 00:55:30 dist-test-slave-h3ft krb5kdc[21319](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409730, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 00:55:30 dist-test-slave-h3ft krb5kdc[21319](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409730, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.70.1@KRBTEST.COM
I20260811 00:55:30.099764 22120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:30.087917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32962 (local address 127.15.70.1:44015)
0811 00:55:30.088201 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:30.088208 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:30.088222 (+ 14us) server_negotiation.cc:407] Connection header received
0811 00:55:30.088259 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:30.088261 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:30.088285 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:30.088376 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:30.089214 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:30.090123 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:30.091179 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:30.091603 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:30.091678 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:30.094811 (+ 3133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:30.094833 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:30.094834 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:30.094845 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:30.097403 (+ 2558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:30.097914 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:30.097918 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:30.097918 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:30.097997 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:30.098505 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:30.098509 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:30.098510 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:30.099136 (+ 626us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:30.099332 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:30.099540 (+ 208us) server_negotiation.cc:299] Negotiation successful
0811 00:55:30.099648 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":239,"thread_start_us":143,"threads_started":1}
Aug 11 00:55:30 dist-test-slave-h3ft krb5kdc[21319](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409730, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:30.110566 21459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:30.101712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49540 (local address 127.15.70.62:39869)
0811 00:55:30.101778 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:30.101780 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:30.101791 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:55:30.101861 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:30.101861 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:30.101883 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:30.101971 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:30.102574 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:30.103319 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:30.104242 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:30.104501 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:30.104569 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:30.107509 (+ 2940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:30.107511 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:30.107512 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:30.107530 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:30.109168 (+ 1638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:30.109574 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:30.109575 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:30.109576 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:30.109644 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:30.109862 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:30.109863 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:30.109863 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:30.110069 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:30.110195 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:30.110311 (+ 116us) server_negotiation.cc:299] Negotiation successful
0811 00:55:30.110426 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
W20260811 00:55:30.110869 21398 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49540
I20260811 00:55:30.111339 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 21494
I20260811 00:55:30.133944 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 21701
I20260811 00:55:30.155193 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 21907
I20260811 00:55:30.173290 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 21340
2026-08-11T00:55:30Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (3251 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:55:30 dist-test-slave-h3ft krb5kdc[22129](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:55:30 dist-test-slave-h3ft krb5kdc[22129](info): set up 2 sockets
Aug 11 00:55:30 dist-test-slave-h3ft krb5kdc[22129](info): commencing operation
krb5kdc: starting...
W20260811 00:55:31.530187 15640 mini_kdc.cc:121] Time spent starting KDC: real 1.327s user 0.004s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Aug 11 00:55:31 dist-test-slave-h3ft krb5kdc[22129](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409731, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:55:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:55:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.70.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
I20260811 00:55:31.683533 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:45895
--webserver_interface=127.15.70.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:43807
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:45895
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:31.782754 22159 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:31.783087 22159 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:31.783129 22159 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:31.784443 22159 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:55:31.784497 22159 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:31.784512 22159 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:31.784526 22159 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:55:31.784538 22159 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:55:31.786365 22159 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:43807
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:45895
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:45895
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22159
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:31.786707 22159 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:31.787083 22159 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:31.792972 22170 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:31.793061 22172 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:31.793134 22159 server_base.cc:1034] running on GCE node
W20260811 00:55:31.793049 22169 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:31.793558 22159 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:31.793926 22159 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:31.795087 22159 hybrid_clock.cc:648] HybridClock initialized: now 1786409731795062 us; error 43 us; skew 500 ppm
Aug 11 00:55:31 dist-test-slave-h3ft krb5kdc[22129](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409731, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:31.798236 22159 init.cc:377] Logged in from keytab as kudu/127.15.70.62@KRBTEST.COM (short username kudu)
I20260811 00:55:31.798692 22159 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:31.798748 22159 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:31.798873 22159 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:31.800194 22159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "4d6d5645bd814bfb8c25ad30dc773cfc"
format_stamp: "Formatted at 2026-08-11 00:55:31 on dist-test-slave-h3ft"
server_key: "e663d2a0c0a669c563ab11ad9e0631a4"
server_key_iv: "88f985905249b9274e687c851fb46214"
server_key_version: "encryptionkey@0"
I20260811 00:55:31.800541 22159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "4d6d5645bd814bfb8c25ad30dc773cfc"
format_stamp: "Formatted at 2026-08-11 00:55:31 on dist-test-slave-h3ft"
server_key: "e663d2a0c0a669c563ab11ad9e0631a4"
server_key_iv: "88f985905249b9274e687c851fb46214"
server_key_version: "encryptionkey@0"
I20260811 00:55:31.802054 22159 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 00:55:31.803164 22181 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:31.803489 22159 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:31.803622 22159 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "4d6d5645bd814bfb8c25ad30dc773cfc"
format_stamp: "Formatted at 2026-08-11 00:55:31 on dist-test-slave-h3ft"
server_key: "e663d2a0c0a669c563ab11ad9e0631a4"
server_key_iv: "88f985905249b9274e687c851fb46214"
server_key_version: "encryptionkey@0"
I20260811 00:55:31.803717 22159 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:31.823181 22159 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:31.826104 22159 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:31.826297 22159 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:31.831609 22159 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:45895
I20260811 00:55:31.831677 22270 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:45895 every 8 connection(s)
I20260811 00:55:31.832026 22159 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:55:31.833272 22271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:31.836408 22271 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d6d5645bd814bfb8c25ad30dc773cfc: Bootstrap starting.
I20260811 00:55:31.837182 22271 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4d6d5645bd814bfb8c25ad30dc773cfc: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:31.837549 22271 log.cc:824] T 00000000000000000000000000000000 P 4d6d5645bd814bfb8c25ad30dc773cfc: Log is configured to *not* fsync() on all Append() calls
I20260811 00:55:31.838366 22271 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d6d5645bd814bfb8c25ad30dc773cfc: No bootstrap required, opened a new log
I20260811 00:55:31.840246 22271 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4d6d5645bd814bfb8c25ad30dc773cfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d6d5645bd814bfb8c25ad30dc773cfc" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 45895 } }
I20260811 00:55:31.840433 22271 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4d6d5645bd814bfb8c25ad30dc773cfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:31.840478 22271 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4d6d5645bd814bfb8c25ad30dc773cfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d6d5645bd814bfb8c25ad30dc773cfc, State: Initialized, Role: FOLLOWER
I20260811 00:55:31.840662 22271 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4d6d5645bd814bfb8c25ad30dc773cfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d6d5645bd814bfb8c25ad30dc773cfc" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 45895 } }
I20260811 00:55:31.840756 22271 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4d6d5645bd814bfb8c25ad30dc773cfc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:55:31.840802 22271 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4d6d5645bd814bfb8c25ad30dc773cfc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:55:31.840860 22271 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4d6d5645bd814bfb8c25ad30dc773cfc [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:31.841782 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 22159
I20260811 00:55:31.841791 22271 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4d6d5645bd814bfb8c25ad30dc773cfc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d6d5645bd814bfb8c25ad30dc773cfc" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 45895 } }
I20260811 00:55:31.841935 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 00:55:31.841917 22271 leader_election.cc:302] T 00000000000000000000000000000000 P 4d6d5645bd814bfb8c25ad30dc773cfc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4d6d5645bd814bfb8c25ad30dc773cfc; no voters:
I20260811 00:55:31.842126 22271 leader_election.cc:288] T 00000000000000000000000000000000 P 4d6d5645bd814bfb8c25ad30dc773cfc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:55:31.842214 15640 external_mini_cluster.cc:1428] Setting key cc49f88aea8c43ef49813b87b42c1b8e
I20260811 00:55:31.842334 22275 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4d6d5645bd814bfb8c25ad30dc773cfc [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:55:31.842465 22271 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4d6d5645bd814bfb8c25ad30dc773cfc [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:55:31.842625 22275 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4d6d5645bd814bfb8c25ad30dc773cfc [term 1 LEADER]: Becoming Leader. State: Replica: 4d6d5645bd814bfb8c25ad30dc773cfc, State: Running, Role: LEADER
I20260811 00:55:31.842793 22275 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4d6d5645bd814bfb8c25ad30dc773cfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d6d5645bd814bfb8c25ad30dc773cfc" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 45895 } }
I20260811 00:55:31.843405 22279 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d6d5645bd814bfb8c25ad30dc773cfc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4d6d5645bd814bfb8c25ad30dc773cfc. Latest consensus state: current_term: 1 leader_uuid: "4d6d5645bd814bfb8c25ad30dc773cfc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d6d5645bd814bfb8c25ad30dc773cfc" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 45895 } } }
I20260811 00:55:31.843520 22279 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d6d5645bd814bfb8c25ad30dc773cfc [sys.catalog]: This master's current role is: LEADER
I20260811 00:55:31.843541 22277 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d6d5645bd814bfb8c25ad30dc773cfc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4d6d5645bd814bfb8c25ad30dc773cfc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d6d5645bd814bfb8c25ad30dc773cfc" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 45895 } } }
I20260811 00:55:31.843611 22277 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d6d5645bd814bfb8c25ad30dc773cfc [sys.catalog]: This master's current role is: LEADER
I20260811 00:55:31.844221 22291 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:55:31.844887 22291 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:55:31.847388 22291 catalog_manager.cc:1347] Generated new cluster ID: 7b82a847dbb54fc4975202ab2b1e0819
I20260811 00:55:31.847462 22291 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 00:55:31 dist-test-slave-h3ft krb5kdc[22129](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409731, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:31.856200 22291 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:55:31.856798 22291 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:55:31.857694 22286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:31.843104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56712 (local address 127.15.70.62:45895)
0811 00:55:31.843696 (+ 592us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:31.843707 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:31.843748 (+ 41us) server_negotiation.cc:407] Connection header received
0811 00:55:31.843905 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:31.843914 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:31.843984 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:31.845201 (+ 1217us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:31.845483 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:31.846785 (+ 1302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:31.848053 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:31.848773 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:31.848881 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:31.852330 (+ 3449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:31.852336 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:31.852336 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:31.852354 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:31.855603 (+ 3249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:31.856150 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:31.856153 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:31.856154 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:31.856287 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:31.856536 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:31.856537 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:31.856537 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:31.856906 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:31.857117 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:31.857213 (+ 96us) server_negotiation.cc:299] Negotiation successful
0811 00:55:31.857409 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":123,"threads_started":1}
I20260811 00:55:31.865119 22291 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4d6d5645bd814bfb8c25ad30dc773cfc: Generated new TSK 0
I20260811 00:55:31.865407 22291 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.70.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab.
Entry for principal kudu/127.15.70.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab.
I20260811 00:55:31.902789 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.1:0
--local_ip_for_outbound_sockets=127.15.70.1
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:45895
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:43807
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:32.000118 22308 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:32.000466 22308 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:32.000517 22308 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:32.001919 22308 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:32.001997 22308 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:32.002043 22308 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.1
I20260811 00:55:32.003952 22308 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:43807
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:45895
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22308
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.1
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:32.004238 22308 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:32.004514 22308 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:32.010690 22318 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:32.010739 22314 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:32.010690 22316 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:32.011147 22308 server_base.cc:1034] running on GCE node
I20260811 00:55:32.011436 22308 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:32.011776 22308 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:32.012991 22308 hybrid_clock.cc:648] HybridClock initialized: now 1786409732012962 us; error 48 us; skew 500 ppm
Aug 11 00:55:32 dist-test-slave-h3ft krb5kdc[22129](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409732, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:32.016458 22308 init.cc:377] Logged in from keytab as kudu/127.15.70.1@KRBTEST.COM (short username kudu)
I20260811 00:55:32.016916 22308 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:32.016970 22308 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:32.017150 22308 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:32.018446 22308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-0/data/instance:
uuid: "1a9c3a0a76624b0398067e0a4a1c751d"
format_stamp: "Formatted at 2026-08-11 00:55:32 on dist-test-slave-h3ft"
server_key: "779479f693d082cb9ca51c16383dcd44"
server_key_iv: "82905c7dae65bcc30f760a4aa8534192"
server_key_version: "encryptionkey@0"
I20260811 00:55:32.018877 22308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance:
uuid: "1a9c3a0a76624b0398067e0a4a1c751d"
format_stamp: "Formatted at 2026-08-11 00:55:32 on dist-test-slave-h3ft"
server_key: "779479f693d082cb9ca51c16383dcd44"
server_key_iv: "82905c7dae65bcc30f760a4aa8534192"
server_key_version: "encryptionkey@0"
I20260811 00:55:32.020447 22308 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 00:55:32.021423 22330 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:32.021622 22308 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:32.021735 22308 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-0/wal
uuid: "1a9c3a0a76624b0398067e0a4a1c751d"
format_stamp: "Formatted at 2026-08-11 00:55:32 on dist-test-slave-h3ft"
server_key: "779479f693d082cb9ca51c16383dcd44"
server_key_iv: "82905c7dae65bcc30f760a4aa8534192"
server_key_version: "encryptionkey@0"
I20260811 00:55:32.021827 22308 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:32.030965 22308 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:32.033591 22308 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:32.033772 22308 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:32.034051 22308 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:55:32.034431 22308 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:55:32.034489 22308 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:32.034538 22308 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:55:32.034569 22308 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:32.042054 22308 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.1:40483
I20260811 00:55:32.042165 22526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.1:40483 every 8 connection(s)
I20260811 00:55:32.042496 22308 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
Aug 11 00:55:32 dist-test-slave-h3ft krb5kdc[22129](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409732, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:32.051153 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 22308
I20260811 00:55:32.051291 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance
I20260811 00:55:32.051568 15640 external_mini_cluster.cc:1428] Setting key 5dbe53dcb9faa8e1b68f363c1217e76e
I20260811 00:55:32.054121 22286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:32.043413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:58431 (local address 127.15.70.62:45895)
0811 00:55:32.043495 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:32.043498 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:32.043752 (+ 254us) server_negotiation.cc:407] Connection header received
0811 00:55:32.044400 (+ 648us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:32.044403 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:32.044429 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:32.044493 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:32.045726 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:32.046316 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:32.047494 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:32.047811 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:32.047906 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:32.050386 (+ 2480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:32.050387 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:32.050388 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:32.050395 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:32.052192 (+ 1797us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:32.052794 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:32.052796 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:32.052796 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:32.052935 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:32.053232 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:32.053233 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:32.053233 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:32.053424 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:32.053517 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:32.053813 (+ 296us) server_negotiation.cc:299] Negotiation successful
0811 00:55:32.053957 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 00:55:32.054208 22530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:32.043390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:45895 (local address 127.15.70.1:58431)
0811 00:55:32.043593 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:32.043639 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:32.044274 (+ 635us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:32.044593 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:32.044598 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:32.044992 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:32.045604 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:32.045609 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:32.046433 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:32.046434 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:32.047375 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:32.047378 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:32.047918 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:32.047920 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:32.048083 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:32.048645 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:32.048655 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:32.050281 (+ 1626us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:32.052307 (+ 2026us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:32.052319 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:32.052322 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:32.052680 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:32.053034 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:32.053035 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:32.053036 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:32.053157 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:32.053508 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:32.053514 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:32.053661 (+ 147us) client_negotiation.cc:769] Sending connection context
0811 00:55:32.053759 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 00:55:32.053962 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":116,"threads_started":1}
I20260811 00:55:32.055042 22527 heartbeater.cc:347] Connected to a master server at 127.15.70.62:45895
I20260811 00:55:32.055195 22527 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:32.055398 22527 heartbeater.cc:511] Master 127.15.70.62:45895 requested a full tablet report, sending...
I20260811 00:55:32.056126 22209 ts_manager.cc:194] Registered new tserver with Master: 1a9c3a0a76624b0398067e0a4a1c751d (127.15.70.1:40483)
I20260811 00:55:32.056849 22209 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.1@KRBTEST.COM'} at 127.15.70.1:58431
WARNING: no policy specified for kudu/127.15.70.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab.
Entry for principal kudu/127.15.70.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab.
I20260811 00:55:32.087973 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.2:0
--local_ip_for_outbound_sockets=127.15.70.2
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:45895
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:43807
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:32.185001 22533 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:32.185410 22533 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:32.185464 22533 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:32.187709 22533 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:32.187814 22533 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:32.187878 22533 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.2
I20260811 00:55:32.191063 22533 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:43807
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:45895
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22533
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.2
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:32.191447 22533 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:32.191789 22533 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:32.199687 22539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:32.199668 22541 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:32.200368 22545 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:32.200739 22533 server_base.cc:1034] running on GCE node
I20260811 00:55:32.201092 22533 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:32.201440 22533 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:32.202641 22533 hybrid_clock.cc:648] HybridClock initialized: now 1786409732202619 us; error 35 us; skew 500 ppm
Aug 11 00:55:32 dist-test-slave-h3ft krb5kdc[22129](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409732, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:32.206014 22533 init.cc:377] Logged in from keytab as kudu/127.15.70.2@KRBTEST.COM (short username kudu)
I20260811 00:55:32.206492 22533 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:32.206593 22533 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:32.206774 22533 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:32.208205 22533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-1/data/instance:
uuid: "4e19823c6842460fbb7bcf9c6ab77ca5"
format_stamp: "Formatted at 2026-08-11 00:55:32 on dist-test-slave-h3ft"
server_key: "68d2c4a4bb0b0f4a5eb4c65397cd9cea"
server_key_iv: "8e6d896a311de87706328ef73983b9d3"
server_key_version: "encryptionkey@0"
I20260811 00:55:32.208635 22533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance:
uuid: "4e19823c6842460fbb7bcf9c6ab77ca5"
format_stamp: "Formatted at 2026-08-11 00:55:32 on dist-test-slave-h3ft"
server_key: "68d2c4a4bb0b0f4a5eb4c65397cd9cea"
server_key_iv: "8e6d896a311de87706328ef73983b9d3"
server_key_version: "encryptionkey@0"
I20260811 00:55:32.210312 22533 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 00:55:32.211520 22554 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:32.211745 22533 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 00:55:32.211874 22533 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-1/wal
uuid: "4e19823c6842460fbb7bcf9c6ab77ca5"
format_stamp: "Formatted at 2026-08-11 00:55:32 on dist-test-slave-h3ft"
server_key: "68d2c4a4bb0b0f4a5eb4c65397cd9cea"
server_key_iv: "8e6d896a311de87706328ef73983b9d3"
server_key_version: "encryptionkey@0"
I20260811 00:55:32.212010 22533 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:32.230602 22533 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:32.233481 22533 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:32.233685 22533 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:32.234011 22533 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:55:32.234408 22533 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:55:32.234467 22533 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:32.234537 22533 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:55:32.234568 22533 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:32.242036 22533 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.2:40703
I20260811 00:55:32.242077 22755 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.2:40703 every 8 connection(s)
I20260811 00:55:32.242509 22533 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
I20260811 00:55:32.246490 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 22533
I20260811 00:55:32.246639 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance
I20260811 00:55:32.246872 15640 external_mini_cluster.cc:1428] Setting key 42f8ee8e91212560749eec79bde7b6c0
Aug 11 00:55:32 dist-test-slave-h3ft krb5kdc[22129](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409732, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:32.254451 22286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:32.243608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:59323 (local address 127.15.70.62:45895)
0811 00:55:32.243696 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:32.243699 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:32.244054 (+ 355us) server_negotiation.cc:407] Connection header received
0811 00:55:32.244705 (+ 651us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:32.244707 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:32.244721 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:32.244781 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:32.245890 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:32.246656 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:32.248164 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:32.248487 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:32.248578 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:32.251287 (+ 2709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:32.251289 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:32.251289 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:32.251297 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:32.252880 (+ 1583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:32.253349 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:32.253350 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:32.253351 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:32.253421 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:32.253701 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:32.253702 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:32.253703 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:32.253838 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:32.253924 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:32.254229 (+ 305us) server_negotiation.cc:299] Negotiation successful
0811 00:55:32.254337 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 00:55:32.254700 22760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:32.243645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:45895 (local address 127.15.70.2:59323)
0811 00:55:32.243855 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:32.243901 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:32.244599 (+ 698us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:32.244848 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:32.244852 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:32.245178 (+ 326us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:32.245788 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:32.245794 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:32.246768 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:32.246769 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:32.248044 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:32.248048 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:32.248584 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:32.248585 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:32.248751 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:32.249413 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:32.249425 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:32.251162 (+ 1737us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:32.252991 (+ 1829us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:32.253000 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:32.253003 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:32.253264 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:32.253496 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:32.253497 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:32.253497 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:32.253626 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:32.253905 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:32.253913 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:32.254086 (+ 173us) client_negotiation.cc:769] Sending connection context
0811 00:55:32.254206 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 00:55:32.254403 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":124,"threads_started":1}
I20260811 00:55:32.255554 22756 heartbeater.cc:347] Connected to a master server at 127.15.70.62:45895
I20260811 00:55:32.255681 22756 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:32.255868 22756 heartbeater.cc:511] Master 127.15.70.62:45895 requested a full tablet report, sending...
I20260811 00:55:32.256461 22209 ts_manager.cc:194] Registered new tserver with Master: 4e19823c6842460fbb7bcf9c6ab77ca5 (127.15.70.2:40703)
I20260811 00:55:32.257071 22209 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.2@KRBTEST.COM'} at 127.15.70.2:59323
WARNING: no policy specified for kudu/127.15.70.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab.
Entry for principal kudu/127.15.70.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab.
I20260811 00:55:32.282821 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.3:0
--local_ip_for_outbound_sockets=127.15.70.3
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:45895
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:43807
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:32.381805 22765 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:32.382097 22765 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:32.382128 22765 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:32.383419 22765 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:32.383473 22765 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:32.383504 22765 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.3
I20260811 00:55:32.385214 22765 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:43807
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:45895
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22765
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.3
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:32.385469 22765 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:32.385710 22765 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:32.392155 22774 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:32.392182 22779 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:32.392158 22776 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:32.392511 22765 server_base.cc:1034] running on GCE node
I20260811 00:55:32.392748 22765 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:32.393004 22765 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:32.394178 22765 hybrid_clock.cc:648] HybridClock initialized: now 1786409732394162 us; error 32 us; skew 500 ppm
Aug 11 00:55:32 dist-test-slave-h3ft krb5kdc[22129](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409732, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:32.397541 22765 init.cc:377] Logged in from keytab as kudu/127.15.70.3@KRBTEST.COM (short username kudu)
I20260811 00:55:32.398031 22765 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:32.398126 22765 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:32.398313 22765 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:32.399909 22765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-2/data/instance:
uuid: "35c3e1fc58d046ed8de0b38dbccc69f9"
format_stamp: "Formatted at 2026-08-11 00:55:32 on dist-test-slave-h3ft"
server_key: "222ca71cc18057ee0daa8a538849a22c"
server_key_iv: "b0b57ff569985474635cc730fc2ec328"
server_key_version: "encryptionkey@0"
I20260811 00:55:32.400440 22765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance:
uuid: "35c3e1fc58d046ed8de0b38dbccc69f9"
format_stamp: "Formatted at 2026-08-11 00:55:32 on dist-test-slave-h3ft"
server_key: "222ca71cc18057ee0daa8a538849a22c"
server_key_iv: "b0b57ff569985474635cc730fc2ec328"
server_key_version: "encryptionkey@0"
I20260811 00:55:32.402307 22765 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 00:55:32.403541 22797 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:32.403821 22765 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:32.403962 22765 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-2/wal
uuid: "35c3e1fc58d046ed8de0b38dbccc69f9"
format_stamp: "Formatted at 2026-08-11 00:55:32 on dist-test-slave-h3ft"
server_key: "222ca71cc18057ee0daa8a538849a22c"
server_key_iv: "b0b57ff569985474635cc730fc2ec328"
server_key_version: "encryptionkey@0"
I20260811 00:55:32.404072 22765 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:32.422144 22765 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:32.425014 22765 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:32.425213 22765 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:32.425544 22765 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:55:32.425964 22765 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:55:32.426024 22765 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:32.426079 22765 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:55:32.426110 22765 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:32.433590 22765 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.3:35155
I20260811 00:55:32.433627 22984 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.3:35155 every 8 connection(s)
I20260811 00:55:32.434031 22765 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
I20260811 00:55:32.441222 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 22765
I20260811 00:55:32.441329 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance
I20260811 00:55:32.441568 15640 external_mini_cluster.cc:1428] Setting key 08068d36ebaa7dc42780a079a2638806
Aug 11 00:55:32 dist-test-slave-h3ft krb5kdc[22129](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409732, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:32.446125 22286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:32.435163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:44795 (local address 127.15.70.62:45895)
0811 00:55:32.435263 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:32.435267 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:32.435448 (+ 181us) server_negotiation.cc:407] Connection header received
0811 00:55:32.436093 (+ 645us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:32.436094 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:32.436108 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:32.436182 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:32.437395 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:32.437973 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:32.439194 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:32.439418 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:32.439492 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:32.442589 (+ 3097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:32.442591 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:32.442592 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:32.442600 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:32.444393 (+ 1793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:32.445001 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:32.445003 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:32.445004 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:32.445120 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:32.445391 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:32.445392 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:32.445392 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:32.445547 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:32.445607 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:32.445940 (+ 333us) server_negotiation.cc:299] Negotiation successful
0811 00:55:32.446039 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 00:55:32.446295 22993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:32.435083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:45895 (local address 127.15.70.3:44795)
0811 00:55:32.435292 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:32.435340 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:32.435937 (+ 597us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:32.436279 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:32.436283 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:32.436636 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:32.437275 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:32.437281 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:32.438080 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:32.438082 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:32.439078 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:32.439081 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:32.439520 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:32.439521 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:32.439652 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:32.440322 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:32.440333 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:32.442476 (+ 2143us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:32.444506 (+ 2030us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:32.444522 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:32.444525 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:32.444920 (+ 395us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:32.445206 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:32.445207 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:32.445207 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:32.445328 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:32.445609 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:32.445614 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:32.445767 (+ 153us) client_negotiation.cc:769] Sending connection context
0811 00:55:32.445864 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 00:55:32.446023 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":117,"threads_started":1}
I20260811 00:55:32.446926 22987 heartbeater.cc:347] Connected to a master server at 127.15.70.62:45895
I20260811 00:55:32.447137 22987 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:32.447348 22987 heartbeater.cc:511] Master 127.15.70.62:45895 requested a full tablet report, sending...
I20260811 00:55:32.447839 22209 ts_manager.cc:194] Registered new tserver with Master: 35c3e1fc58d046ed8de0b38dbccc69f9 (127.15.70.3:35155)
I20260811 00:55:32.448244 22209 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.3@KRBTEST.COM'} at 127.15.70.3:44795
I20260811 00:55:32.454144 15640 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 00:55:32.463188 22286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:32.455992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56728 (local address 127.15.70.62:45895)
0811 00:55:32.456065 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:32.456067 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:32.456166 (+ 99us) server_negotiation.cc:407] Connection header received
0811 00:55:32.456232 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:32.456233 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:32.456244 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:32.456300 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:32.457058 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:32.457714 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:32.458582 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:32.458824 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:32.458892 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:32.460414 (+ 1522us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:32.460415 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:32.460416 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:32.460423 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:32.461890 (+ 1467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:32.462255 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:32.462256 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:32.462257 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:32.462320 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:32.462490 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:32.462490 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:32.462491 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:32.462685 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:32.462777 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:32.462951 (+ 174us) server_negotiation.cc:299] Negotiation successful
0811 00:55:32.463102 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 00:55:32.465618 22209 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56728:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:55:32.468168 22209 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:55:32.476982 23011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:32.471961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60664 (local address 127.15.70.2:40703)
0811 00:55:32.472492 (+ 531us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:32.472497 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:32.472510 (+ 13us) server_negotiation.cc:407] Connection header received
0811 00:55:32.472556 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:32.472558 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:32.472576 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:32.472710 (+ 134us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:32.472968 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:32.474112 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:32.475811 (+ 1699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:32.476421 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:32.476524 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:32.476610 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:32.476789 (+ 179us) server_negotiation.cc:299] Negotiation successful
0811 00:55:32.476842 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":488,"thread_start_us":114,"threads_started":1}
I20260811 00:55:32.476982 23010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:32.471771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:35155 (local address 127.0.0.1:33520)
0811 00:55:32.471967 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:32.472025 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:32.472113 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:32.472547 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:32.472551 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:32.472554 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:32.472686 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:32.472689 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:32.474230 (+ 1541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:32.474231 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:32.475666 (+ 1435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:32.475669 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:32.476622 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:32.476623 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:32.476715 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:32.476718 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:55:32.476747 (+ 29us) client_negotiation.cc:240] Negotiation successful
0811 00:55:32.476848 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"mutex_wait_us":7,"thread_start_us":124,"threads_started":1}
I20260811 00:55:32.476986 23008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:32.471775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.2:40703 (local address 127.0.0.1:60664)
0811 00:55:32.472253 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:32.472265 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:32.472330 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:32.472789 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:32.472790 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:32.472793 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:32.472862 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:32.472864 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:32.474350 (+ 1486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:32.474350 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:32.475666 (+ 1316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:32.475669 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:32.476535 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:32.476537 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:32.476637 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:32.476656 (+ 19us) client_negotiation.cc:769] Sending connection context
0811 00:55:32.476764 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 00:55:32.476903 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":460,"mutex_wait_us":147,"thread_start_us":164,"threads_started":1}
I20260811 00:55:32.477085 23017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:32.472366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49970 (local address 127.15.70.1:40483)
0811 00:55:32.472844 (+ 478us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:32.472850 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:32.472861 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:55:32.472907 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:32.472909 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:32.472926 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:32.473149 (+ 223us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:32.473228 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:32.473928 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:32.475664 (+ 1736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:32.476500 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:32.476806 (+ 306us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:32.476889 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:32.476920 (+ 31us) server_negotiation.cc:299] Negotiation successful
0811 00:55:32.476975 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":436,"thread_start_us":122,"threads_started":1}
I20260811 00:55:32.477308 23016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:32.472101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:40483 (local address 127.0.0.1:49970)
0811 00:55:32.472317 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:32.472327 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:32.472400 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:32.473034 (+ 634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:32.473035 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:32.473037 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:32.473090 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:32.473091 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:32.474052 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:32.474053 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:32.475553 (+ 1500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:32.475556 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:32.476621 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:32.476622 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:32.476706 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:32.476713 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 00:55:32.476747 (+ 34us) client_negotiation.cc:240] Negotiation successful
0811 00:55:32.476855 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195,"mutex_wait_us":150,"thread_start_us":92,"threads_started":1}
I20260811 00:55:32.477749 23013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:32.472065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33520 (local address 127.15.70.3:35155)
0811 00:55:32.472315 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:32.472322 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:32.472335 (+ 13us) server_negotiation.cc:407] Connection header received
0811 00:55:32.472390 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:32.472393 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:32.472413 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:32.472532 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:32.472750 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:32.474114 (+ 1364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:32.475751 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:32.476521 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:32.477438 (+ 917us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:32.477541 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:32.477573 (+ 32us) server_negotiation.cc:299] Negotiation successful
0811 00:55:32.477639 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":103,"threads_started":1}
I20260811 00:55:32.478346 22410 tablet_service.cc:1467] Processing CreateTablet for tablet a6662fb3d8ca4f3f840b798ad5af0630 (DEFAULT_TABLE table=test-table [id=c5caeaaeb7b64b219d862acfbaf92fa2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:55:32.478832 22410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6662fb3d8ca4f3f840b798ad5af0630. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:32.478716 22648 tablet_service.cc:1467] Processing CreateTablet for tablet a6662fb3d8ca4f3f840b798ad5af0630 (DEFAULT_TABLE table=test-table [id=c5caeaaeb7b64b219d862acfbaf92fa2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:55:32.478722 22884 tablet_service.cc:1467] Processing CreateTablet for tablet a6662fb3d8ca4f3f840b798ad5af0630 (DEFAULT_TABLE table=test-table [id=c5caeaaeb7b64b219d862acfbaf92fa2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:55:32.479151 22648 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6662fb3d8ca4f3f840b798ad5af0630. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:32.479151 22884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6662fb3d8ca4f3f840b798ad5af0630. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:32.482594 23019 tablet_bootstrap.cc:492] T a6662fb3d8ca4f3f840b798ad5af0630 P 1a9c3a0a76624b0398067e0a4a1c751d: Bootstrap starting.
I20260811 00:55:32.483078 23020 tablet_bootstrap.cc:492] T a6662fb3d8ca4f3f840b798ad5af0630 P 4e19823c6842460fbb7bcf9c6ab77ca5: Bootstrap starting.
I20260811 00:55:32.483534 23019 tablet_bootstrap.cc:654] T a6662fb3d8ca4f3f840b798ad5af0630 P 1a9c3a0a76624b0398067e0a4a1c751d: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:32.483650 23023 tablet_bootstrap.cc:492] T a6662fb3d8ca4f3f840b798ad5af0630 P 35c3e1fc58d046ed8de0b38dbccc69f9: Bootstrap starting.
I20260811 00:55:32.483863 23020 tablet_bootstrap.cc:654] T a6662fb3d8ca4f3f840b798ad5af0630 P 4e19823c6842460fbb7bcf9c6ab77ca5: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:32.484441 23023 tablet_bootstrap.cc:654] T a6662fb3d8ca4f3f840b798ad5af0630 P 35c3e1fc58d046ed8de0b38dbccc69f9: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:32.484601 23019 log.cc:824] T a6662fb3d8ca4f3f840b798ad5af0630 P 1a9c3a0a76624b0398067e0a4a1c751d: Log is configured to *not* fsync() on all Append() calls
I20260811 00:55:32.484658 23020 log.cc:824] T a6662fb3d8ca4f3f840b798ad5af0630 P 4e19823c6842460fbb7bcf9c6ab77ca5: Log is configured to *not* fsync() on all Append() calls
I20260811 00:55:32.485102 23023 log.cc:824] T a6662fb3d8ca4f3f840b798ad5af0630 P 35c3e1fc58d046ed8de0b38dbccc69f9: Log is configured to *not* fsync() on all Append() calls
I20260811 00:55:32.485577 23019 tablet_bootstrap.cc:492] T a6662fb3d8ca4f3f840b798ad5af0630 P 1a9c3a0a76624b0398067e0a4a1c751d: No bootstrap required, opened a new log
I20260811 00:55:32.485673 23019 ts_tablet_manager.cc:1397] T a6662fb3d8ca4f3f840b798ad5af0630 P 1a9c3a0a76624b0398067e0a4a1c751d: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260811 00:55:32.485895 23023 tablet_bootstrap.cc:492] T a6662fb3d8ca4f3f840b798ad5af0630 P 35c3e1fc58d046ed8de0b38dbccc69f9: No bootstrap required, opened a new log
I20260811 00:55:32.485954 23023 ts_tablet_manager.cc:1397] T a6662fb3d8ca4f3f840b798ad5af0630 P 35c3e1fc58d046ed8de0b38dbccc69f9: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 00:55:32.487522 23020 tablet_bootstrap.cc:492] T a6662fb3d8ca4f3f840b798ad5af0630 P 4e19823c6842460fbb7bcf9c6ab77ca5: No bootstrap required, opened a new log
I20260811 00:55:32.487620 23020 ts_tablet_manager.cc:1397] T a6662fb3d8ca4f3f840b798ad5af0630 P 4e19823c6842460fbb7bcf9c6ab77ca5: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260811 00:55:32.487553 23019 raft_consensus.cc:348] T a6662fb3d8ca4f3f840b798ad5af0630 P 1a9c3a0a76624b0398067e0a4a1c751d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e19823c6842460fbb7bcf9c6ab77ca5" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 40703 } } peers { permanent_uuid: "35c3e1fc58d046ed8de0b38dbccc69f9" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35155 } } peers { permanent_uuid: "1a9c3a0a76624b0398067e0a4a1c751d" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 40483 } }
I20260811 00:55:32.487818 23019 raft_consensus.cc:374] T a6662fb3d8ca4f3f840b798ad5af0630 P 1a9c3a0a76624b0398067e0a4a1c751d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:32.487867 23019 raft_consensus.cc:729] T a6662fb3d8ca4f3f840b798ad5af0630 P 1a9c3a0a76624b0398067e0a4a1c751d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a9c3a0a76624b0398067e0a4a1c751d, State: Initialized, Role: FOLLOWER
I20260811 00:55:32.487927 23023 raft_consensus.cc:348] T a6662fb3d8ca4f3f840b798ad5af0630 P 35c3e1fc58d046ed8de0b38dbccc69f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e19823c6842460fbb7bcf9c6ab77ca5" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 40703 } } peers { permanent_uuid: "35c3e1fc58d046ed8de0b38dbccc69f9" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35155 } } peers { permanent_uuid: "1a9c3a0a76624b0398067e0a4a1c751d" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 40483 } }
I20260811 00:55:32.488019 23019 consensus_queue.cc:260] T a6662fb3d8ca4f3f840b798ad5af0630 P 1a9c3a0a76624b0398067e0a4a1c751d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e19823c6842460fbb7bcf9c6ab77ca5" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 40703 } } peers { permanent_uuid: "35c3e1fc58d046ed8de0b38dbccc69f9" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35155 } } peers { permanent_uuid: "1a9c3a0a76624b0398067e0a4a1c751d" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 40483 } }
I20260811 00:55:32.488104 23023 raft_consensus.cc:374] T a6662fb3d8ca4f3f840b798ad5af0630 P 35c3e1fc58d046ed8de0b38dbccc69f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:32.488149 23023 raft_consensus.cc:729] T a6662fb3d8ca4f3f840b798ad5af0630 P 35c3e1fc58d046ed8de0b38dbccc69f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35c3e1fc58d046ed8de0b38dbccc69f9, State: Initialized, Role: FOLLOWER
I20260811 00:55:32.488293 23023 consensus_queue.cc:260] T a6662fb3d8ca4f3f840b798ad5af0630 P 35c3e1fc58d046ed8de0b38dbccc69f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e19823c6842460fbb7bcf9c6ab77ca5" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 40703 } } peers { permanent_uuid: "35c3e1fc58d046ed8de0b38dbccc69f9" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35155 } } peers { permanent_uuid: "1a9c3a0a76624b0398067e0a4a1c751d" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 40483 } }
I20260811 00:55:32.488392 22527 heartbeater.cc:503] Master 127.15.70.62:45895 was elected leader, sending a full tablet report...
I20260811 00:55:32.488616 23023 ts_tablet_manager.cc:1428] T a6662fb3d8ca4f3f840b798ad5af0630 P 35c3e1fc58d046ed8de0b38dbccc69f9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 00:55:32.488902 22987 heartbeater.cc:503] Master 127.15.70.62:45895 was elected leader, sending a full tablet report...
I20260811 00:55:32.489580 23019 ts_tablet_manager.cc:1428] T a6662fb3d8ca4f3f840b798ad5af0630 P 1a9c3a0a76624b0398067e0a4a1c751d: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260811 00:55:32.490056 23020 raft_consensus.cc:348] T a6662fb3d8ca4f3f840b798ad5af0630 P 4e19823c6842460fbb7bcf9c6ab77ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e19823c6842460fbb7bcf9c6ab77ca5" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 40703 } } peers { permanent_uuid: "35c3e1fc58d046ed8de0b38dbccc69f9" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35155 } } peers { permanent_uuid: "1a9c3a0a76624b0398067e0a4a1c751d" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 40483 } }
I20260811 00:55:32.490231 23020 raft_consensus.cc:374] T a6662fb3d8ca4f3f840b798ad5af0630 P 4e19823c6842460fbb7bcf9c6ab77ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:32.490281 23020 raft_consensus.cc:729] T a6662fb3d8ca4f3f840b798ad5af0630 P 4e19823c6842460fbb7bcf9c6ab77ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e19823c6842460fbb7bcf9c6ab77ca5, State: Initialized, Role: FOLLOWER
I20260811 00:55:32.490401 23020 consensus_queue.cc:260] T a6662fb3d8ca4f3f840b798ad5af0630 P 4e19823c6842460fbb7bcf9c6ab77ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e19823c6842460fbb7bcf9c6ab77ca5" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 40703 } } peers { permanent_uuid: "35c3e1fc58d046ed8de0b38dbccc69f9" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35155 } } peers { permanent_uuid: "1a9c3a0a76624b0398067e0a4a1c751d" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 40483 } }
I20260811 00:55:32.490738 23020 ts_tablet_manager.cc:1428] T a6662fb3d8ca4f3f840b798ad5af0630 P 4e19823c6842460fbb7bcf9c6ab77ca5: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 00:55:32.490772 22756 heartbeater.cc:503] Master 127.15.70.62:45895 was elected leader, sending a full tablet report...
W20260811 00:55:32.493108 22758 tablet.cc:2369] T a6662fb3d8ca4f3f840b798ad5af0630 P 4e19823c6842460fbb7bcf9c6ab77ca5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 00:55:32.543483 22528 tablet.cc:2369] T a6662fb3d8ca4f3f840b798ad5af0630 P 1a9c3a0a76624b0398067e0a4a1c751d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 00:55:32.684793 22988 tablet.cc:2369] T a6662fb3d8ca4f3f840b798ad5af0630 P 35c3e1fc58d046ed8de0b38dbccc69f9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 00:55:32.751668 23031 raft_consensus.cc:482] T a6662fb3d8ca4f3f840b798ad5af0630 P 4e19823c6842460fbb7bcf9c6ab77ca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:55:32.751883 23031 raft_consensus.cc:504] T a6662fb3d8ca4f3f840b798ad5af0630 P 4e19823c6842460fbb7bcf9c6ab77ca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e19823c6842460fbb7bcf9c6ab77ca5" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 40703 } } peers { permanent_uuid: "35c3e1fc58d046ed8de0b38dbccc69f9" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35155 } } peers { permanent_uuid: "1a9c3a0a76624b0398067e0a4a1c751d" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 40483 } }
I20260811 00:55:32.752498 23031 leader_election.cc:288] T a6662fb3d8ca4f3f840b798ad5af0630 P 4e19823c6842460fbb7bcf9c6ab77ca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35c3e1fc58d046ed8de0b38dbccc69f9 (127.15.70.3:35155), 1a9c3a0a76624b0398067e0a4a1c751d (127.15.70.1:40483)
I20260811 00:55:32.757519 23013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:32.752944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:33871 (local address 127.15.70.3:35155)
0811 00:55:32.753006 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:32.753009 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:32.753172 (+ 163us) server_negotiation.cc:407] Connection header received
0811 00:55:32.753205 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:32.753207 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:32.753221 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:32.753283 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:32.753459 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:32.754230 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:32.756237 (+ 2007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:32.756955 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:32.757043 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:32.757062 (+ 19us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:32.757366 (+ 304us) server_negotiation.cc:299] Negotiation successful
0811 00:55:32.757432 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 00:55:32.757519 23017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:32.752970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:58175 (local address 127.15.70.1:40483)
0811 00:55:32.753032 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:32.753034 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:32.753045 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:55:32.753087 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:32.753088 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:32.753099 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:32.753202 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:32.753431 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:32.754230 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:32.756237 (+ 2007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:32.756934 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:32.757044 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:32.757065 (+ 21us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:32.757366 (+ 301us) server_negotiation.cc:299] Negotiation successful
0811 00:55:32.757431 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 00:55:32.757489 22760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:32.752796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:40483 (local address 127.15.70.2:58175)
0811 00:55:32.752877 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:32.752893 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:32.752948 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:32.753220 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:32.753220 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:32.753222 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:32.753323 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:32.753327 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:32.754371 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:32.754373 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:32.756066 (+ 1693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:32.756071 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:32.757077 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:32.757078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:32.757181 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:32.757188 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 00:55:32.757263 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 00:55:32.757345 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52,"mutex_wait_us":100}
I20260811 00:55:32.757496 23032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:32.752796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:35155 (local address 127.15.70.2:33871)
0811 00:55:32.753064 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:32.753072 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:32.753126 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:32.753300 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:32.753300 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:32.753302 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:32.753380 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:32.753382 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:32.754371 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:32.754373 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:32.756081 (+ 1708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:32.756083 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:32.757085 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:32.757086 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:32.757181 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:32.757188 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 00:55:32.757269 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 00:55:32.757345 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"mutex_wait_us":94,"thread_start_us":99,"threads_started":1}
I20260811 00:55:32.758101 22914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6662fb3d8ca4f3f840b798ad5af0630" candidate_uuid: "4e19823c6842460fbb7bcf9c6ab77ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35c3e1fc58d046ed8de0b38dbccc69f9" is_pre_election: true
I20260811 00:55:32.758102 22447 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6662fb3d8ca4f3f840b798ad5af0630" candidate_uuid: "4e19823c6842460fbb7bcf9c6ab77ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a9c3a0a76624b0398067e0a4a1c751d" is_pre_election: true
I20260811 00:55:32.758339 22914 raft_consensus.cc:2454] T a6662fb3d8ca4f3f840b798ad5af0630 P 35c3e1fc58d046ed8de0b38dbccc69f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e19823c6842460fbb7bcf9c6ab77ca5 in term 0.
I20260811 00:55:32.758339 22447 raft_consensus.cc:2454] T a6662fb3d8ca4f3f840b798ad5af0630 P 1a9c3a0a76624b0398067e0a4a1c751d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e19823c6842460fbb7bcf9c6ab77ca5 in term 0.
I20260811 00:55:32.758667 22565 leader_election.cc:302] T a6662fb3d8ca4f3f840b798ad5af0630 P 4e19823c6842460fbb7bcf9c6ab77ca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a9c3a0a76624b0398067e0a4a1c751d, 4e19823c6842460fbb7bcf9c6ab77ca5; no voters:
I20260811 00:55:32.758911 23031 raft_consensus.cc:2781] T a6662fb3d8ca4f3f840b798ad5af0630 P 4e19823c6842460fbb7bcf9c6ab77ca5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:55:32.759042 23031 raft_consensus.cc:482] T a6662fb3d8ca4f3f840b798ad5af0630 P 4e19823c6842460fbb7bcf9c6ab77ca5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:55:32.759091 23031 raft_consensus.cc:3037] T a6662fb3d8ca4f3f840b798ad5af0630 P 4e19823c6842460fbb7bcf9c6ab77ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:32.760054 23031 raft_consensus.cc:504] T a6662fb3d8ca4f3f840b798ad5af0630 P 4e19823c6842460fbb7bcf9c6ab77ca5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e19823c6842460fbb7bcf9c6ab77ca5" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 40703 } } peers { permanent_uuid: "35c3e1fc58d046ed8de0b38dbccc69f9" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35155 } } peers { permanent_uuid: "1a9c3a0a76624b0398067e0a4a1c751d" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 40483 } }
I20260811 00:55:32.760264 23031 leader_election.cc:288] T a6662fb3d8ca4f3f840b798ad5af0630 P 4e19823c6842460fbb7bcf9c6ab77ca5 [CANDIDATE]: Term 1 election: Requested vote from peers 35c3e1fc58d046ed8de0b38dbccc69f9 (127.15.70.3:35155), 1a9c3a0a76624b0398067e0a4a1c751d (127.15.70.1:40483)
I20260811 00:55:32.760484 22914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6662fb3d8ca4f3f840b798ad5af0630" candidate_uuid: "4e19823c6842460fbb7bcf9c6ab77ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35c3e1fc58d046ed8de0b38dbccc69f9"
I20260811 00:55:32.760495 22447 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6662fb3d8ca4f3f840b798ad5af0630" candidate_uuid: "4e19823c6842460fbb7bcf9c6ab77ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a9c3a0a76624b0398067e0a4a1c751d"
I20260811 00:55:32.760603 22447 raft_consensus.cc:3037] T a6662fb3d8ca4f3f840b798ad5af0630 P 1a9c3a0a76624b0398067e0a4a1c751d [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:32.760603 22914 raft_consensus.cc:3037] T a6662fb3d8ca4f3f840b798ad5af0630 P 35c3e1fc58d046ed8de0b38dbccc69f9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:32.761822 22447 raft_consensus.cc:2454] T a6662fb3d8ca4f3f840b798ad5af0630 P 1a9c3a0a76624b0398067e0a4a1c751d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e19823c6842460fbb7bcf9c6ab77ca5 in term 1.
I20260811 00:55:32.761823 22914 raft_consensus.cc:2454] T a6662fb3d8ca4f3f840b798ad5af0630 P 35c3e1fc58d046ed8de0b38dbccc69f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e19823c6842460fbb7bcf9c6ab77ca5 in term 1.
I20260811 00:55:32.762108 22565 leader_election.cc:302] T a6662fb3d8ca4f3f840b798ad5af0630 P 4e19823c6842460fbb7bcf9c6ab77ca5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a9c3a0a76624b0398067e0a4a1c751d, 4e19823c6842460fbb7bcf9c6ab77ca5; no voters:
I20260811 00:55:32.762231 23031 raft_consensus.cc:2781] T a6662fb3d8ca4f3f840b798ad5af0630 P 4e19823c6842460fbb7bcf9c6ab77ca5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:55:32.762476 23031 raft_consensus.cc:686] T a6662fb3d8ca4f3f840b798ad5af0630 P 4e19823c6842460fbb7bcf9c6ab77ca5 [term 1 LEADER]: Becoming Leader. State: Replica: 4e19823c6842460fbb7bcf9c6ab77ca5, State: Running, Role: LEADER
I20260811 00:55:32.762645 23031 consensus_queue.cc:237] T a6662fb3d8ca4f3f840b798ad5af0630 P 4e19823c6842460fbb7bcf9c6ab77ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e19823c6842460fbb7bcf9c6ab77ca5" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 40703 } } peers { permanent_uuid: "35c3e1fc58d046ed8de0b38dbccc69f9" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35155 } } peers { permanent_uuid: "1a9c3a0a76624b0398067e0a4a1c751d" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 40483 } }
I20260811 00:55:32.763980 22208 catalog_manager.cc:5495] T a6662fb3d8ca4f3f840b798ad5af0630 P 4e19823c6842460fbb7bcf9c6ab77ca5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e19823c6842460fbb7bcf9c6ab77ca5 (127.15.70.2). New cstate: current_term: 1 leader_uuid: "4e19823c6842460fbb7bcf9c6ab77ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e19823c6842460fbb7bcf9c6ab77ca5" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 40703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35c3e1fc58d046ed8de0b38dbccc69f9" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a9c3a0a76624b0398067e0a4a1c751d" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 40483 } health_report { overall_health: UNKNOWN } } }
I20260811 00:55:32.835554 23011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:32.832216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60680 (local address 127.15.70.2:40703)
0811 00:55:32.832304 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:32.832307 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:32.832319 (+ 12us) server_negotiation.cc:407] Connection header received
0811 00:55:32.832397 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:32.832398 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:32.832432 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:32.832523 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:55:32.832733 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:32.833565 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:32.834425 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:32.834700 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:32.834762 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:32.835079 (+ 317us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:55:32.835240 (+ 161us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:55:32.835332 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:32.835406 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 00:55:32.835440 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 00:55:32.838060 22914 raft_consensus.cc:1261] T a6662fb3d8ca4f3f840b798ad5af0630 P 35c3e1fc58d046ed8de0b38dbccc69f9 [term 1 FOLLOWER]: Refusing update from remote peer 4e19823c6842460fbb7bcf9c6ab77ca5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:55:32.838060 22447 raft_consensus.cc:1261] T a6662fb3d8ca4f3f840b798ad5af0630 P 1a9c3a0a76624b0398067e0a4a1c751d [term 1 FOLLOWER]: Refusing update from remote peer 4e19823c6842460fbb7bcf9c6ab77ca5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:55:32.838555 23035 consensus_queue.cc:1035] T a6662fb3d8ca4f3f840b798ad5af0630 P 4e19823c6842460fbb7bcf9c6ab77ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35c3e1fc58d046ed8de0b38dbccc69f9" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:55:32.838743 23031 consensus_queue.cc:1035] T a6662fb3d8ca4f3f840b798ad5af0630 P 4e19823c6842460fbb7bcf9c6ab77ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a9c3a0a76624b0398067e0a4a1c751d" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 40483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:55:32.842442 23043 mvcc.cc:205] Tried to move back new op lower bound from 7317134265700745216 to 7317134265396695040. Current Snapshot: MvccSnapshot[applied={T|T < 7317134265700745216}]
I20260811 00:55:32.842751 23046 mvcc.cc:205] Tried to move back new op lower bound from 7317134265700745216 to 7317134265396695040. Current Snapshot: MvccSnapshot[applied={T|T < 7317134265700745216}]
I20260811 00:55:32.845048 23048 mvcc.cc:205] Tried to move back new op lower bound from 7317134265700745216 to 7317134265396695040. Current Snapshot: MvccSnapshot[applied={T|T < 7317134265700745216 or (T in {7317134265700745216})}]
I20260811 00:55:32.846787 22209 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56728:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:55:32.846912 22209 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56728:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:55:32.848117 22209 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4d6d5645bd814bfb8c25ad30dc773cfc: Sending DeleteTablet for 3 replicas of tablet a6662fb3d8ca4f3f840b798ad5af0630
I20260811 00:55:32.849943 22648 tablet_service.cc:1514] Processing DeleteTablet for tablet a6662fb3d8ca4f3f840b798ad5af0630 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:55:32 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:60664
I20260811 00:55:32.850200 22410 tablet_service.cc:1514] Processing DeleteTablet for tablet a6662fb3d8ca4f3f840b798ad5af0630 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:55:32 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:49970
I20260811 00:55:32.850502 23061 tablet_replica.cc:330] T a6662fb3d8ca4f3f840b798ad5af0630 P 1a9c3a0a76624b0398067e0a4a1c751d: stopping tablet replica
I20260811 00:55:32.850665 23061 raft_consensus.cc:2229] T a6662fb3d8ca4f3f840b798ad5af0630 P 1a9c3a0a76624b0398067e0a4a1c751d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:55:32.850579 22884 tablet_service.cc:1514] Processing DeleteTablet for tablet a6662fb3d8ca4f3f840b798ad5af0630 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:55:32 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:33520
I20260811 00:55:32.850798 23061 raft_consensus.cc:2258] T a6662fb3d8ca4f3f840b798ad5af0630 P 1a9c3a0a76624b0398067e0a4a1c751d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:55:32.851406 23061 ts_tablet_manager.cc:1905] T a6662fb3d8ca4f3f840b798ad5af0630 P 1a9c3a0a76624b0398067e0a4a1c751d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:55:32.852337 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 22308
I20260811 00:55:32.853075 23064 tablet_replica.cc:330] T a6662fb3d8ca4f3f840b798ad5af0630 P 35c3e1fc58d046ed8de0b38dbccc69f9: stopping tablet replica
I20260811 00:55:32.853222 23064 raft_consensus.cc:2229] T a6662fb3d8ca4f3f840b798ad5af0630 P 35c3e1fc58d046ed8de0b38dbccc69f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:55:32.853356 23064 raft_consensus.cc:2258] T a6662fb3d8ca4f3f840b798ad5af0630 P 35c3e1fc58d046ed8de0b38dbccc69f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:55:32.856870 23064 ts_tablet_manager.cc:1905] T a6662fb3d8ca4f3f840b798ad5af0630 P 35c3e1fc58d046ed8de0b38dbccc69f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:55:32.859315 23064 ts_tablet_manager.cc:1918] T a6662fb3d8ca4f3f840b798ad5af0630 P 35c3e1fc58d046ed8de0b38dbccc69f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:55:32.859406 23064 log.cc:1196] T a6662fb3d8ca4f3f840b798ad5af0630 P 35c3e1fc58d046ed8de0b38dbccc69f9: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-2/wal/wals/a6662fb3d8ca4f3f840b798ad5af0630
I20260811 00:55:32.859715 23064 ts_tablet_manager.cc:1939] T a6662fb3d8ca4f3f840b798ad5af0630 P 35c3e1fc58d046ed8de0b38dbccc69f9: Deleting consensus metadata
I20260811 00:55:32.860334 22187 catalog_manager.cc:4841] TS 35c3e1fc58d046ed8de0b38dbccc69f9 (127.15.70.3:35155): tablet a6662fb3d8ca4f3f840b798ad5af0630 (table test-table [id=c5caeaaeb7b64b219d862acfbaf92fa2]) successfully deleted
I20260811 00:55:32.863644 23059 tablet_replica.cc:330] T a6662fb3d8ca4f3f840b798ad5af0630 P 4e19823c6842460fbb7bcf9c6ab77ca5: stopping tablet replica
I20260811 00:55:32.863854 23059 raft_consensus.cc:2229] T a6662fb3d8ca4f3f840b798ad5af0630 P 4e19823c6842460fbb7bcf9c6ab77ca5 [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:55:32.864056 23059 raft_consensus.cc:2258] T a6662fb3d8ca4f3f840b798ad5af0630 P 4e19823c6842460fbb7bcf9c6ab77ca5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:55:32.864715 23059 ts_tablet_manager.cc:1905] T a6662fb3d8ca4f3f840b798ad5af0630 P 4e19823c6842460fbb7bcf9c6ab77ca5: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 00:55:32.865104 22188 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.70.1:40483 (error 108)
W20260811 00:55:32.866024 23016 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:55:32.865675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:40483 (local address 127.0.0.1:49976)
0811 00:55:32.865742 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:32.865755 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:32.865802 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:32.865945 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.1:40483: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":40}
W20260811 00:55:32.866191 22188 catalog_manager.cc:4584] TS 1a9c3a0a76624b0398067e0a4a1c751d (127.15.70.1:40483): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a6662fb3d8ca4f3f840b798ad5af0630: Network error: Client connection negotiation failed: client connection to 127.15.70.1:40483: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 00:55:32.866827 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 22533
I20260811 00:55:32.867028 23059 ts_tablet_manager.cc:1918] T a6662fb3d8ca4f3f840b798ad5af0630 P 4e19823c6842460fbb7bcf9c6ab77ca5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:55:32.867115 23059 log.cc:1196] T a6662fb3d8ca4f3f840b798ad5af0630 P 4e19823c6842460fbb7bcf9c6ab77ca5: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409704606556-15640-0/minicluster-data/ts-1/wal/wals/a6662fb3d8ca4f3f840b798ad5af0630
I20260811 00:55:32.867395 23059 ts_tablet_manager.cc:1939] T a6662fb3d8ca4f3f840b798ad5af0630 P 4e19823c6842460fbb7bcf9c6ab77ca5: Deleting consensus metadata
I20260811 00:55:32.884433 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 22765
I20260811 00:55:32.884543 23016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:32.884295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.2:40703 (local address 127.0.0.1:60688)
0811 00:55:32.884389 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:32.884480 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.2:40703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260811 00:55:32.915639 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 22159
2026-08-11T00:55:32Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2750 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-11T00:55:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:55:32Z Disabled control of system clock
I20260811 00:55:32.964470 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:36351
--webserver_interface=127.15.70.62
--webserver_port=0
--builtin_ntp_servers=127.15.70.20:41003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:36351
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 00:55:33.084100 23078 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:33.084417 23078 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:33.084445 23078 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:33.085889 23078 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:55:33.085947 23078 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:33.085960 23078 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:33.085974 23078 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:55:33.085987 23078 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:55:33.087710 23078 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:41003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:36351
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:36351
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23078
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:33.088083 23078 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:33.088498 23078 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:33.094559 23089 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:33.094560 23088 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:33.094961 23091 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:33.095341 23078 server_base.cc:1034] running on GCE node
I20260811 00:55:33.095698 23078 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:33.096086 23078 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:33.097295 23078 hybrid_clock.cc:648] HybridClock initialized: now 1786409733097267 us; error 50 us; skew 500 ppm
I20260811 00:55:33.099081 23078 webserver.cc:460] Webserver started at http://127.15.70.62:37935/ using document root <none> and password file <none>
I20260811 00:55:33.099392 23078 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:33.099483 23078 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:33.099668 23078 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:33.101073 23078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "01285a636374410994f6672cd852c474"
format_stamp: "Formatted at 2026-08-11 00:55:33 on dist-test-slave-h3ft"
server_key: "5da1967943f62863bf7098f75e240ac0"
server_key_iv: "a1abab57ec6d2317ab4cace8a1c38c61"
server_key_version: "encryptionkey@0"
I20260811 00:55:33.101548 23078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "01285a636374410994f6672cd852c474"
format_stamp: "Formatted at 2026-08-11 00:55:33 on dist-test-slave-h3ft"
server_key: "5da1967943f62863bf7098f75e240ac0"
server_key_iv: "a1abab57ec6d2317ab4cace8a1c38c61"
server_key_version: "encryptionkey@0"
I20260811 00:55:33.103444 23078 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260811 00:55:33.104547 23107 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:33.104804 23078 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:33.104949 23078 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "01285a636374410994f6672cd852c474"
format_stamp: "Formatted at 2026-08-11 00:55:33 on dist-test-slave-h3ft"
server_key: "5da1967943f62863bf7098f75e240ac0"
server_key_iv: "a1abab57ec6d2317ab4cace8a1c38c61"
server_key_version: "encryptionkey@0"
I20260811 00:55:33.105051 23078 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:33.109299 23078 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:33.109683 23078 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:33.109848 23078 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:33.115720 23078 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:36351
I20260811 00:55:33.115746 23199 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:36351 every 8 connection(s)
I20260811 00:55:33.116220 23078 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:55:33.116735 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 23078
I20260811 00:55:33.116858 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 00:55:33.117130 15640 external_mini_cluster.cc:1428] Setting key 778bbc5369dc0249955ab2dd740e20ea
I20260811 00:55:33.117190 23201 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:33.121044 23205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:33.118115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53798 (local address 127.15.70.62:36351)
0811 00:55:33.118412 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:33.118424 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:33.118482 (+ 58us) server_negotiation.cc:407] Connection header received
0811 00:55:33.119344 (+ 862us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:33.119354 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:33.119420 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:33.119569 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:33.120480 (+ 911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:33.120484 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:33.120484 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:55:33.120488 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:33.120538 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:55:33.120550 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:33.120608 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:33.120711 (+ 103us) server_negotiation.cc:299] Negotiation successful
0811 00:55:33.120799 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":115,"threads_started":1}
I20260811 00:55:33.122227 23201 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 01285a636374410994f6672cd852c474: Bootstrap starting.
I20260811 00:55:33.122974 23201 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 01285a636374410994f6672cd852c474: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:33.123376 23201 log.cc:824] T 00000000000000000000000000000000 P 01285a636374410994f6672cd852c474: Log is configured to *not* fsync() on all Append() calls
I20260811 00:55:33.124235 23201 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 01285a636374410994f6672cd852c474: No bootstrap required, opened a new log
I20260811 00:55:33.125814 23201 raft_consensus.cc:348] T 00000000000000000000000000000000 P 01285a636374410994f6672cd852c474 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01285a636374410994f6672cd852c474" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 36351 } }
I20260811 00:55:33.126004 23201 raft_consensus.cc:374] T 00000000000000000000000000000000 P 01285a636374410994f6672cd852c474 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:33.126048 23201 raft_consensus.cc:729] T 00000000000000000000000000000000 P 01285a636374410994f6672cd852c474 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01285a636374410994f6672cd852c474, State: Initialized, Role: FOLLOWER
I20260811 00:55:33.126215 23201 consensus_queue.cc:260] T 00000000000000000000000000000000 P 01285a636374410994f6672cd852c474 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01285a636374410994f6672cd852c474" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 36351 } }
I20260811 00:55:33.126319 23201 raft_consensus.cc:388] T 00000000000000000000000000000000 P 01285a636374410994f6672cd852c474 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:55:33.126367 23201 raft_consensus.cc:482] T 00000000000000000000000000000000 P 01285a636374410994f6672cd852c474 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:55:33.126425 23201 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 01285a636374410994f6672cd852c474 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:33.127122 23201 raft_consensus.cc:504] T 00000000000000000000000000000000 P 01285a636374410994f6672cd852c474 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01285a636374410994f6672cd852c474" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 36351 } }
I20260811 00:55:33.127251 23201 leader_election.cc:302] T 00000000000000000000000000000000 P 01285a636374410994f6672cd852c474 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 01285a636374410994f6672cd852c474; no voters:
I20260811 00:55:33.127476 23201 leader_election.cc:288] T 00000000000000000000000000000000 P 01285a636374410994f6672cd852c474 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:55:33.127835 23201 sys_catalog.cc:564] T 00000000000000000000000000000000 P 01285a636374410994f6672cd852c474 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:55:33.127887 23208 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 01285a636374410994f6672cd852c474 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:55:33.128090 23208 raft_consensus.cc:686] T 00000000000000000000000000000000 P 01285a636374410994f6672cd852c474 [term 1 LEADER]: Becoming Leader. State: Replica: 01285a636374410994f6672cd852c474, State: Running, Role: LEADER
I20260811 00:55:33.128198 23208 consensus_queue.cc:237] T 00000000000000000000000000000000 P 01285a636374410994f6672cd852c474 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01285a636374410994f6672cd852c474" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 36351 } }
I20260811 00:55:33.128685 23212 sys_catalog.cc:455] T 00000000000000000000000000000000 P 01285a636374410994f6672cd852c474 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 01285a636374410994f6672cd852c474. Latest consensus state: current_term: 1 leader_uuid: "01285a636374410994f6672cd852c474" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01285a636374410994f6672cd852c474" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 36351 } } }
I20260811 00:55:33.128818 23212 sys_catalog.cc:458] T 00000000000000000000000000000000 P 01285a636374410994f6672cd852c474 [sys.catalog]: This master's current role is: LEADER
I20260811 00:55:33.129043 23223 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:55:33.129161 23209 sys_catalog.cc:455] T 00000000000000000000000000000000 P 01285a636374410994f6672cd852c474 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "01285a636374410994f6672cd852c474" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01285a636374410994f6672cd852c474" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 36351 } } }
I20260811 00:55:33.129230 23209 sys_catalog.cc:458] T 00000000000000000000000000000000 P 01285a636374410994f6672cd852c474 [sys.catalog]: This master's current role is: LEADER
I20260811 00:55:33.129796 23223 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:55:33.131593 23223 catalog_manager.cc:1347] Generated new cluster ID: ed8d637bcfb04362baad10b6bc6943c3
I20260811 00:55:33.131649 23223 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:55:33.147778 23223 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:55:33.148041 23223 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:55:33.158066 23223 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 01285a636374410994f6672cd852c474: Generated new TSK 0
I20260811 00:55:33.158360 23223 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:55:33.161543 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.1:0
--local_ip_for_outbound_sockets=127.15.70.1
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:36351
--builtin_ntp_servers=127.15.70.20:41003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 00:55:33.268980 23241 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:33.269279 23241 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:33.269321 23241 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:33.270614 23241 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:33.270692 23241 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:33.270741 23241 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.1
I20260811 00:55:33.272317 23241 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:41003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:36351
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23241
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.1
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:33.272665 23241 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:33.273061 23241 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:33.280018 23254 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:33.280072 23255 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:33.280339 23257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:33.280422 23241 server_base.cc:1034] running on GCE node
I20260811 00:55:33.280664 23241 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:33.281055 23241 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:33.282264 23241 hybrid_clock.cc:648] HybridClock initialized: now 1786409733282241 us; error 51 us; skew 500 ppm
I20260811 00:55:33.284185 23241 webserver.cc:460] Webserver started at http://127.15.70.1:39459/ using document root <none> and password file <none>
I20260811 00:55:33.284523 23241 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:33.284581 23241 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:33.284744 23241 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:33.286092 23241 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-0/data/instance:
uuid: "a9d90ce0071e40138b8395daba55486c"
format_stamp: "Formatted at 2026-08-11 00:55:33 on dist-test-slave-h3ft"
server_key: "82f781de2a00b9087799ef7d800bd47a"
server_key_iv: "f970864a1621350252ee16a38bf35ee6"
server_key_version: "encryptionkey@0"
I20260811 00:55:33.286521 23241 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance:
uuid: "a9d90ce0071e40138b8395daba55486c"
format_stamp: "Formatted at 2026-08-11 00:55:33 on dist-test-slave-h3ft"
server_key: "82f781de2a00b9087799ef7d800bd47a"
server_key_iv: "f970864a1621350252ee16a38bf35ee6"
server_key_version: "encryptionkey@0"
I20260811 00:55:33.288250 23241 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260811 00:55:33.289273 23265 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:33.289515 23241 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 00:55:33.289656 23241 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-0/wal
uuid: "a9d90ce0071e40138b8395daba55486c"
format_stamp: "Formatted at 2026-08-11 00:55:33 on dist-test-slave-h3ft"
server_key: "82f781de2a00b9087799ef7d800bd47a"
server_key_iv: "f970864a1621350252ee16a38bf35ee6"
server_key_version: "encryptionkey@0"
I20260811 00:55:33.289752 23241 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:33.293774 23241 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:33.294119 23241 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:33.294286 23241 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:33.294538 23241 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:55:33.294921 23241 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:55:33.295017 23241 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:33.295085 23241 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:55:33.295117 23241 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:33.302565 23241 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.1:37011
I20260811 00:55:33.302620 23462 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.1:37011 every 8 connection(s)
I20260811 00:55:33.303146 23241 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
I20260811 00:55:33.307417 23205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:33.304140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:41667 (local address 127.15.70.62:36351)
0811 00:55:33.304221 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:33.304224 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:33.304552 (+ 328us) server_negotiation.cc:407] Connection header received
0811 00:55:33.305311 (+ 759us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:33.305313 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:33.305323 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:33.305410 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:33.307031 (+ 1621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:33.307035 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:33.307035 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:55:33.307043 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:33.307068 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:55:33.307074 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:33.307167 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:33.307282 (+ 115us) server_negotiation.cc:299] Negotiation successful
0811 00:55:33.307306 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 00:55:33.307713 23467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:33.304124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:36351 (local address 127.15.70.1:41667)
0811 00:55:33.304364 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:33.304417 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:33.305155 (+ 738us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:33.305522 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:33.305527 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:33.305537 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:33.306783 (+ 1246us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:55:33.306784 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:33.306824 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:55:33.306865 (+ 41us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:33.307166 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:33.307176 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:33.307180 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:55:33.307298 (+ 118us) client_negotiation.cc:240] Negotiation successful
0811 00:55:33.307387 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":88,"threads_started":1}
I20260811 00:55:33.308416 23465 heartbeater.cc:347] Connected to a master server at 127.15.70.62:36351
I20260811 00:55:33.308559 23465 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:33.308836 23465 heartbeater.cc:511] Master 127.15.70.62:36351 requested a full tablet report, sending...
I20260811 00:55:33.309566 23132 ts_manager.cc:194] Registered new tserver with Master: a9d90ce0071e40138b8395daba55486c (127.15.70.1:37011)
I20260811 00:55:33.310245 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 23241
I20260811 00:55:33.310338 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance
I20260811 00:55:33.310582 15640 external_mini_cluster.cc:1428] Setting key a8ddabf4002a93225db3c557aa21fe50
I20260811 00:55:33.311685 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.2:0
--local_ip_for_outbound_sockets=127.15.70.2
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:36351
--builtin_ntp_servers=127.15.70.20:41003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 00:55:33.409593 23468 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:33.409917 23468 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:33.409960 23468 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:33.411437 23468 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:33.411504 23468 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:33.411553 23468 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.2
I20260811 00:55:33.413084 23468 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:41003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:36351
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23468
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.2
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:33.413401 23468 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:33.413774 23468 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:33.419785 23474 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:33.419749 23481 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:33.419741 23478 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:33.420121 23468 server_base.cc:1034] running on GCE node
I20260811 00:55:33.420361 23468 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:33.420612 23468 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:33.421783 23468 hybrid_clock.cc:648] HybridClock initialized: now 1786409733421767 us; error 29 us; skew 500 ppm
I20260811 00:55:33.423311 23468 webserver.cc:460] Webserver started at http://127.15.70.2:44271/ using document root <none> and password file <none>
I20260811 00:55:33.423588 23468 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:33.423663 23468 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:33.423836 23468 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:33.425128 23468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-1/data/instance:
uuid: "45617e6d1a94461db26ba8a4a5a1508e"
format_stamp: "Formatted at 2026-08-11 00:55:33 on dist-test-slave-h3ft"
server_key: "04d6b430663c2d0c04285f1b137db85b"
server_key_iv: "d2bce6a720cf069477ea7513a52e857e"
server_key_version: "encryptionkey@0"
I20260811 00:55:33.425549 23468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance:
uuid: "45617e6d1a94461db26ba8a4a5a1508e"
format_stamp: "Formatted at 2026-08-11 00:55:33 on dist-test-slave-h3ft"
server_key: "04d6b430663c2d0c04285f1b137db85b"
server_key_iv: "d2bce6a720cf069477ea7513a52e857e"
server_key_version: "encryptionkey@0"
I20260811 00:55:33.427191 23468 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 00:55:33.428144 23490 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:33.428486 23468 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:33.428610 23468 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-1/wal
uuid: "45617e6d1a94461db26ba8a4a5a1508e"
format_stamp: "Formatted at 2026-08-11 00:55:33 on dist-test-slave-h3ft"
server_key: "04d6b430663c2d0c04285f1b137db85b"
server_key_iv: "d2bce6a720cf069477ea7513a52e857e"
server_key_version: "encryptionkey@0"
I20260811 00:55:33.428709 23468 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:33.432732 23468 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:33.433099 23468 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:33.433255 23468 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:33.433496 23468 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:55:33.433845 23468 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:55:33.433900 23468 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:33.433943 23468 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:55:33.433967 23468 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:33.442296 23468 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.2:41115
I20260811 00:55:33.442339 23691 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.2:41115 every 8 connection(s)
I20260811 00:55:33.442780 23468 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
I20260811 00:55:33.446750 23205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:33.443779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:52715 (local address 127.15.70.62:36351)
0811 00:55:33.443851 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:33.443856 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:33.444140 (+ 284us) server_negotiation.cc:407] Connection header received
0811 00:55:33.444776 (+ 636us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:33.444778 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:33.444788 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:33.444861 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:33.446417 (+ 1556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:33.446419 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:33.446419 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:55:33.446423 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:33.446442 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:55:33.446446 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:33.446503 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:33.446647 (+ 144us) server_negotiation.cc:299] Negotiation successful
0811 00:55:33.446668 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 00:55:33.446897 23695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:33.443761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:36351 (local address 127.15.70.2:52715)
0811 00:55:33.443980 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:33.444023 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:33.444652 (+ 629us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:33.444977 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:33.444982 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:33.444992 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:33.446240 (+ 1248us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:55:33.446240 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:33.446276 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:55:33.446310 (+ 34us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:33.446515 (+ 205us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:33.446520 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:33.446523 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:55:33.446594 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 00:55:33.446658 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":106,"threads_started":1}
I20260811 00:55:33.447583 23692 heartbeater.cc:347] Connected to a master server at 127.15.70.62:36351
I20260811 00:55:33.447701 23692 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:33.447881 23692 heartbeater.cc:511] Master 127.15.70.62:36351 requested a full tablet report, sending...
I20260811 00:55:33.448378 23132 ts_manager.cc:194] Registered new tserver with Master: 45617e6d1a94461db26ba8a4a5a1508e (127.15.70.2:41115)
I20260811 00:55:33.449119 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 23468
I20260811 00:55:33.449244 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance
I20260811 00:55:33.449427 15640 external_mini_cluster.cc:1428] Setting key 2efc9e1a4c1607262e02753139579271
I20260811 00:55:33.450546 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.3:0
--local_ip_for_outbound_sockets=127.15.70.3
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:36351
--builtin_ntp_servers=127.15.70.20:41003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 00:55:33.548893 23696 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:33.549152 23696 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:33.549180 23696 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:33.550400 23696 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:33.550439 23696 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:33.550467 23696 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.3
I20260811 00:55:33.552065 23696 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:41003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:36351
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23696
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.3
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:33.552320 23696 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:33.552675 23696 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:33.558558 23704 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:33.558559 23706 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:33.558558 23702 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:33.558977 23696 server_base.cc:1034] running on GCE node
I20260811 00:55:33.559270 23696 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:33.559561 23696 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:33.560731 23696 hybrid_clock.cc:648] HybridClock initialized: now 1786409733560692 us; error 66 us; skew 500 ppm
I20260811 00:55:33.562513 23696 webserver.cc:460] Webserver started at http://127.15.70.3:40771/ using document root <none> and password file <none>
I20260811 00:55:33.562839 23696 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:33.562894 23696 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:33.563061 23696 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:33.564348 23696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-2/data/instance:
uuid: "cd097eae8e3a40e18f7679a996b242c3"
format_stamp: "Formatted at 2026-08-11 00:55:33 on dist-test-slave-h3ft"
server_key: "9a58af97e0c97ab58100e1592367c5c6"
server_key_iv: "6bbc45ec1c65fe0df305d8a8ea472290"
server_key_version: "encryptionkey@0"
I20260811 00:55:33.564769 23696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance:
uuid: "cd097eae8e3a40e18f7679a996b242c3"
format_stamp: "Formatted at 2026-08-11 00:55:33 on dist-test-slave-h3ft"
server_key: "9a58af97e0c97ab58100e1592367c5c6"
server_key_iv: "6bbc45ec1c65fe0df305d8a8ea472290"
server_key_version: "encryptionkey@0"
I20260811 00:55:33.566241 23696 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 00:55:33.567224 23715 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:33.567487 23696 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:33.567607 23696 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-2/wal
uuid: "cd097eae8e3a40e18f7679a996b242c3"
format_stamp: "Formatted at 2026-08-11 00:55:33 on dist-test-slave-h3ft"
server_key: "9a58af97e0c97ab58100e1592367c5c6"
server_key_iv: "6bbc45ec1c65fe0df305d8a8ea472290"
server_key_version: "encryptionkey@0"
I20260811 00:55:33.567693 23696 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:33.572459 23696 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:33.572813 23696 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:33.572973 23696 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:33.573216 23696 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:55:33.573596 23696 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:55:33.573655 23696 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:33.573700 23696 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:55:33.573729 23696 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:33.581257 23696 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.3:41427
I20260811 00:55:33.581310 23930 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.3:41427 every 8 connection(s)
I20260811 00:55:33.581733 23696 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
I20260811 00:55:33.585458 23205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:33.582694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:50345 (local address 127.15.70.62:36351)
0811 00:55:33.582808 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:33.582810 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:33.583072 (+ 262us) server_negotiation.cc:407] Connection header received
0811 00:55:33.583713 (+ 641us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:33.583714 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:33.583723 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:33.583800 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:33.585191 (+ 1391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:33.585193 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:33.585193 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:55:33.585199 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:33.585220 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:55:33.585225 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:33.585290 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:33.585368 (+ 78us) server_negotiation.cc:299] Negotiation successful
0811 00:55:33.585384 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 00:55:33.585736 23933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:33.582655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:36351 (local address 127.15.70.3:50345)
0811 00:55:33.582874 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:33.582925 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:33.583589 (+ 664us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:33.583885 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:33.583889 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:33.583899 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:33.585002 (+ 1103us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:55:33.585003 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:33.585037 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:55:33.585072 (+ 35us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:33.585299 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:33.585304 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:33.585307 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:55:33.585370 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 00:55:33.585438 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":109,"threads_started":1}
I20260811 00:55:33.586519 23931 heartbeater.cc:347] Connected to a master server at 127.15.70.62:36351
I20260811 00:55:33.586651 23931 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:33.586860 23931 heartbeater.cc:511] Master 127.15.70.62:36351 requested a full tablet report, sending...
I20260811 00:55:33.587471 23132 ts_manager.cc:194] Registered new tserver with Master: cd097eae8e3a40e18f7679a996b242c3 (127.15.70.3:41427)
I20260811 00:55:33.588395 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 23696
I20260811 00:55:33.588526 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance
I20260811 00:55:33.588768 15640 external_mini_cluster.cc:1428] Setting key b07285bdcae3509fab2acb73094defec
I20260811 00:55:33.589946 15640 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 00:55:33.593072 23205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:33.591774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53810 (local address 127.15.70.62:36351)
0811 00:55:33.591840 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:33.591842 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:33.591954 (+ 112us) server_negotiation.cc:407] Connection header received
0811 00:55:33.592017 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:33.592018 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:33.592025 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:33.592082 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:33.592805 (+ 723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:33.592806 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:33.592807 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:55:33.592811 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:33.592828 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:55:33.592833 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:33.592881 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:33.592943 (+ 62us) server_negotiation.cc:299] Negotiation successful
0811 00:55:33.592960 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 00:55:33.595306 23132 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53810:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:55:33.597251 23132 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:55:33.602617 23942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:33.600378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:41427 (local address 127.0.0.1:58096)
0811 00:55:33.600566 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:33.600619 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:33.600685 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:33.601451 (+ 766us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:33.601452 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:33.601457 (+ 5us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:33.602082 (+ 625us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:55:33.602083 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:33.602091 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:55:33.602105 (+ 14us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:33.602396 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:33.602405 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:33.602409 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:55:33.602497 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 00:55:33.602514 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":90,"threads_started":1}
I20260811 00:55:33.602648 23943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:33.600542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58096 (local address 127.15.70.3:41427)
0811 00:55:33.600985 (+ 443us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:33.600991 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:33.601004 (+ 13us) server_negotiation.cc:407] Connection header received
0811 00:55:33.601050 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:33.601053 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:33.601066 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:33.601198 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:33.602212 (+ 1014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:33.602226 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:33.602227 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:55:33.602232 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:33.602279 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:55:33.602313 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:33.602382 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:33.602505 (+ 123us) server_negotiation.cc:299] Negotiation successful
0811 00:55:33.602521 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":150,"threads_started":1}
I20260811 00:55:33.603066 23950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:33.600895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.2:41115 (local address 127.0.0.1:50032)
0811 00:55:33.601410 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:33.601421 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:33.601471 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:33.602067 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:33.602068 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:33.602071 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:33.602590 (+ 519us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:55:33.602590 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:33.602598 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:55:33.602609 (+ 11us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:33.602894 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:33.602895 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:33.602895 (+ 0us) client_negotiation.cc:769] Sending connection context
0811 00:55:33.602926 (+ 31us) client_negotiation.cc:240] Negotiation successful
0811 00:55:33.602936 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":89,"threads_started":1}
I20260811 00:55:33.603341 23945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:33.600683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:37011 (local address 127.0.0.1:35138)
0811 00:55:33.600834 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:33.600844 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:33.600883 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:33.601268 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:33.601275 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:33.601283 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:33.601911 (+ 628us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:55:33.601912 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:33.601933 (+ 21us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:55:33.601966 (+ 33us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:33.603202 (+ 1236us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:33.603203 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:33.603204 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 00:55:33.603263 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 00:55:33.603275 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":104,"threads_started":1}
I20260811 00:55:33.603385 23953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:33.601228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50032 (local address 127.15.70.2:41115)
0811 00:55:33.601689 (+ 461us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:33.601693 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:33.601702 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:55:33.601728 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:33.601730 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:33.601758 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:33.601851 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:33.602710 (+ 859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:33.602719 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:33.602720 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:55:33.602725 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:33.602780 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:55:33.602821 (+ 41us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:33.602931 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:33.602955 (+ 24us) server_negotiation.cc:299] Negotiation successful
0811 00:55:33.602973 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":107,"threads_started":1}
I20260811 00:55:33.603390 23946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:33.600849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35138 (local address 127.15.70.1:37011)
0811 00:55:33.601070 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:33.601075 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:33.601089 (+ 14us) server_negotiation.cc:407] Connection header received
0811 00:55:33.601125 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:33.601127 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:33.601138 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:33.601578 (+ 440us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:33.602222 (+ 644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:33.602231 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:33.602231 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:55:33.602237 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:33.602279 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:55:33.602313 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:33.602382 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:33.603277 (+ 895us) server_negotiation.cc:299] Negotiation successful
0811 00:55:33.603297 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":124,"threads_started":1}
I20260811 00:55:33.603570 23807 tablet_service.cc:1467] Processing CreateTablet for tablet fa428bc22a4a44c68f919aedbc88e11c (DEFAULT_TABLE table=test-table [id=a31e532fcf6747c998f3fc0b6ace1865]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:55:33.604048 23807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa428bc22a4a44c68f919aedbc88e11c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:33.604019 23576 tablet_service.cc:1467] Processing CreateTablet for tablet fa428bc22a4a44c68f919aedbc88e11c (DEFAULT_TABLE table=test-table [id=a31e532fcf6747c998f3fc0b6ace1865]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:55:33.604422 23576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa428bc22a4a44c68f919aedbc88e11c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:33.607291 23954 tablet_bootstrap.cc:492] T fa428bc22a4a44c68f919aedbc88e11c P 45617e6d1a94461db26ba8a4a5a1508e: Bootstrap starting.
I20260811 00:55:33.607797 23354 tablet_service.cc:1467] Processing CreateTablet for tablet fa428bc22a4a44c68f919aedbc88e11c (DEFAULT_TABLE table=test-table [id=a31e532fcf6747c998f3fc0b6ace1865]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:55:33.608175 23954 tablet_bootstrap.cc:654] T fa428bc22a4a44c68f919aedbc88e11c P 45617e6d1a94461db26ba8a4a5a1508e: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:33.608218 23354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa428bc22a4a44c68f919aedbc88e11c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:33.608609 23954 log.cc:824] T fa428bc22a4a44c68f919aedbc88e11c P 45617e6d1a94461db26ba8a4a5a1508e: Log is configured to *not* fsync() on all Append() calls
I20260811 00:55:33.609558 23954 tablet_bootstrap.cc:492] T fa428bc22a4a44c68f919aedbc88e11c P 45617e6d1a94461db26ba8a4a5a1508e: No bootstrap required, opened a new log
I20260811 00:55:33.609642 23954 ts_tablet_manager.cc:1397] T fa428bc22a4a44c68f919aedbc88e11c P 45617e6d1a94461db26ba8a4a5a1508e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 00:55:33.611277 23955 tablet_bootstrap.cc:492] T fa428bc22a4a44c68f919aedbc88e11c P cd097eae8e3a40e18f7679a996b242c3: Bootstrap starting.
I20260811 00:55:33.611991 23955 tablet_bootstrap.cc:654] T fa428bc22a4a44c68f919aedbc88e11c P cd097eae8e3a40e18f7679a996b242c3: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:33.612355 23959 tablet_bootstrap.cc:492] T fa428bc22a4a44c68f919aedbc88e11c P a9d90ce0071e40138b8395daba55486c: Bootstrap starting.
I20260811 00:55:33.612443 23955 log.cc:824] T fa428bc22a4a44c68f919aedbc88e11c P cd097eae8e3a40e18f7679a996b242c3: Log is configured to *not* fsync() on all Append() calls
I20260811 00:55:33.612803 23954 raft_consensus.cc:348] T fa428bc22a4a44c68f919aedbc88e11c P 45617e6d1a94461db26ba8a4a5a1508e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd097eae8e3a40e18f7679a996b242c3" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 41427 } } peers { permanent_uuid: "a9d90ce0071e40138b8395daba55486c" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37011 } } peers { permanent_uuid: "45617e6d1a94461db26ba8a4a5a1508e" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 41115 } }
I20260811 00:55:33.613034 23954 raft_consensus.cc:374] T fa428bc22a4a44c68f919aedbc88e11c P 45617e6d1a94461db26ba8a4a5a1508e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:33.613090 23954 raft_consensus.cc:729] T fa428bc22a4a44c68f919aedbc88e11c P 45617e6d1a94461db26ba8a4a5a1508e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45617e6d1a94461db26ba8a4a5a1508e, State: Initialized, Role: FOLLOWER
I20260811 00:55:33.613224 23954 consensus_queue.cc:260] T fa428bc22a4a44c68f919aedbc88e11c P 45617e6d1a94461db26ba8a4a5a1508e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd097eae8e3a40e18f7679a996b242c3" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 41427 } } peers { permanent_uuid: "a9d90ce0071e40138b8395daba55486c" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37011 } } peers { permanent_uuid: "45617e6d1a94461db26ba8a4a5a1508e" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 41115 } }
I20260811 00:55:33.613293 23959 tablet_bootstrap.cc:654] T fa428bc22a4a44c68f919aedbc88e11c P a9d90ce0071e40138b8395daba55486c: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:33.613548 23954 ts_tablet_manager.cc:1428] T fa428bc22a4a44c68f919aedbc88e11c P 45617e6d1a94461db26ba8a4a5a1508e: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260811 00:55:33.613627 23692 heartbeater.cc:503] Master 127.15.70.62:36351 was elected leader, sending a full tablet report...
I20260811 00:55:33.613688 23959 log.cc:824] T fa428bc22a4a44c68f919aedbc88e11c P a9d90ce0071e40138b8395daba55486c: Log is configured to *not* fsync() on all Append() calls
I20260811 00:55:33.614315 23955 tablet_bootstrap.cc:492] T fa428bc22a4a44c68f919aedbc88e11c P cd097eae8e3a40e18f7679a996b242c3: No bootstrap required, opened a new log
I20260811 00:55:33.614413 23955 ts_tablet_manager.cc:1397] T fa428bc22a4a44c68f919aedbc88e11c P cd097eae8e3a40e18f7679a996b242c3: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 00:55:33.614539 23959 tablet_bootstrap.cc:492] T fa428bc22a4a44c68f919aedbc88e11c P a9d90ce0071e40138b8395daba55486c: No bootstrap required, opened a new log
I20260811 00:55:33.614637 23959 ts_tablet_manager.cc:1397] T fa428bc22a4a44c68f919aedbc88e11c P a9d90ce0071e40138b8395daba55486c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 00:55:33.617040 23955 raft_consensus.cc:348] T fa428bc22a4a44c68f919aedbc88e11c P cd097eae8e3a40e18f7679a996b242c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd097eae8e3a40e18f7679a996b242c3" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 41427 } } peers { permanent_uuid: "a9d90ce0071e40138b8395daba55486c" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37011 } } peers { permanent_uuid: "45617e6d1a94461db26ba8a4a5a1508e" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 41115 } }
I20260811 00:55:33.617195 23955 raft_consensus.cc:374] T fa428bc22a4a44c68f919aedbc88e11c P cd097eae8e3a40e18f7679a996b242c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:33.617228 23955 raft_consensus.cc:729] T fa428bc22a4a44c68f919aedbc88e11c P cd097eae8e3a40e18f7679a996b242c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd097eae8e3a40e18f7679a996b242c3, State: Initialized, Role: FOLLOWER
I20260811 00:55:33.617225 23959 raft_consensus.cc:348] T fa428bc22a4a44c68f919aedbc88e11c P a9d90ce0071e40138b8395daba55486c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd097eae8e3a40e18f7679a996b242c3" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 41427 } } peers { permanent_uuid: "a9d90ce0071e40138b8395daba55486c" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37011 } } peers { permanent_uuid: "45617e6d1a94461db26ba8a4a5a1508e" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 41115 } }
I20260811 00:55:33.617398 23959 raft_consensus.cc:374] T fa428bc22a4a44c68f919aedbc88e11c P a9d90ce0071e40138b8395daba55486c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:33.617441 23959 raft_consensus.cc:729] T fa428bc22a4a44c68f919aedbc88e11c P a9d90ce0071e40138b8395daba55486c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d90ce0071e40138b8395daba55486c, State: Initialized, Role: FOLLOWER
I20260811 00:55:33.617377 23955 consensus_queue.cc:260] T fa428bc22a4a44c68f919aedbc88e11c P cd097eae8e3a40e18f7679a996b242c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd097eae8e3a40e18f7679a996b242c3" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 41427 } } peers { permanent_uuid: "a9d90ce0071e40138b8395daba55486c" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37011 } } peers { permanent_uuid: "45617e6d1a94461db26ba8a4a5a1508e" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 41115 } }
I20260811 00:55:33.617555 23959 consensus_queue.cc:260] T fa428bc22a4a44c68f919aedbc88e11c P a9d90ce0071e40138b8395daba55486c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd097eae8e3a40e18f7679a996b242c3" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 41427 } } peers { permanent_uuid: "a9d90ce0071e40138b8395daba55486c" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37011 } } peers { permanent_uuid: "45617e6d1a94461db26ba8a4a5a1508e" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 41115 } }
I20260811 00:55:33.617746 23955 ts_tablet_manager.cc:1428] T fa428bc22a4a44c68f919aedbc88e11c P cd097eae8e3a40e18f7679a996b242c3: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 00:55:33.617769 23931 heartbeater.cc:503] Master 127.15.70.62:36351 was elected leader, sending a full tablet report...
I20260811 00:55:33.617851 23959 ts_tablet_manager.cc:1428] T fa428bc22a4a44c68f919aedbc88e11c P a9d90ce0071e40138b8395daba55486c: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
I20260811 00:55:33.617862 23465 heartbeater.cc:503] Master 127.15.70.62:36351 was elected leader, sending a full tablet report...
I20260811 00:55:33.682842 23961 raft_consensus.cc:482] T fa428bc22a4a44c68f919aedbc88e11c P 45617e6d1a94461db26ba8a4a5a1508e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:55:33.683112 23961 raft_consensus.cc:504] T fa428bc22a4a44c68f919aedbc88e11c P 45617e6d1a94461db26ba8a4a5a1508e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd097eae8e3a40e18f7679a996b242c3" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 41427 } } peers { permanent_uuid: "a9d90ce0071e40138b8395daba55486c" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37011 } } peers { permanent_uuid: "45617e6d1a94461db26ba8a4a5a1508e" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 41115 } }
I20260811 00:55:33.683660 23961 leader_election.cc:288] T fa428bc22a4a44c68f919aedbc88e11c P 45617e6d1a94461db26ba8a4a5a1508e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd097eae8e3a40e18f7679a996b242c3 (127.15.70.3:41427), a9d90ce0071e40138b8395daba55486c (127.15.70.1:37011)
I20260811 00:55:33.685761 23695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:33.683897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:41427 (local address 127.15.70.2:54067)
0811 00:55:33.683970 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:33.683987 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:33.684041 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:33.684371 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:33.684373 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:33.684377 (+ 4us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:33.685072 (+ 695us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:55:33.685072 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:33.685085 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:55:33.685106 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:33.685587 (+ 481us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:33.685588 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:33.685588 (+ 0us) client_negotiation.cc:769] Sending connection context
0811 00:55:33.685629 (+ 41us) client_negotiation.cc:240] Negotiation successful
0811 00:55:33.685643 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 00:55:33.685797 23943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:33.684024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:54067 (local address 127.15.70.3:41427)
0811 00:55:33.684140 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:33.684142 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:33.684168 (+ 26us) server_negotiation.cc:407] Connection header received
0811 00:55:33.684211 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:33.684211 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:33.684218 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:33.684310 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:33.685341 (+ 1031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:33.685344 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:33.685344 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:55:33.685350 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:33.685373 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:55:33.685379 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:33.685453 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:33.685683 (+ 230us) server_negotiation.cc:299] Negotiation successful
0811 00:55:33.685703 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 00:55:33.685848 23946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:33.684225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:51259 (local address 127.15.70.1:37011)
0811 00:55:33.684305 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:33.684308 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:33.684418 (+ 110us) server_negotiation.cc:407] Connection header received
0811 00:55:33.684479 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:33.684480 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:33.684487 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:33.684564 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:33.685473 (+ 909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:33.685475 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:33.685475 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:55:33.685480 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:33.685500 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:55:33.685505 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:33.685561 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:33.685740 (+ 179us) server_negotiation.cc:299] Negotiation successful
0811 00:55:33.685759 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 00:55:33.685868 23965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:33.684055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:37011 (local address 127.15.70.2:51259)
0811 00:55:33.684316 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:33.684326 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:33.684417 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:33.684569 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:33.684571 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:33.684574 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:33.685358 (+ 784us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:55:33.685359 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:33.685368 (+ 9us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:55:33.685381 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:33.685601 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:33.685602 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:33.685603 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 00:55:33.685716 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 00:55:33.685731 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":180,"threads_started":1}
I20260811 00:55:33.686326 23389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa428bc22a4a44c68f919aedbc88e11c" candidate_uuid: "45617e6d1a94461db26ba8a4a5a1508e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d90ce0071e40138b8395daba55486c" is_pre_election: true
I20260811 00:55:33.686326 23843 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa428bc22a4a44c68f919aedbc88e11c" candidate_uuid: "45617e6d1a94461db26ba8a4a5a1508e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd097eae8e3a40e18f7679a996b242c3" is_pre_election: true
I20260811 00:55:33.686547 23389 raft_consensus.cc:2454] T fa428bc22a4a44c68f919aedbc88e11c P a9d90ce0071e40138b8395daba55486c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45617e6d1a94461db26ba8a4a5a1508e in term 0.
I20260811 00:55:33.686563 23843 raft_consensus.cc:2454] T fa428bc22a4a44c68f919aedbc88e11c P cd097eae8e3a40e18f7679a996b242c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45617e6d1a94461db26ba8a4a5a1508e in term 0.
I20260811 00:55:33.686849 23491 leader_election.cc:302] T fa428bc22a4a44c68f919aedbc88e11c P 45617e6d1a94461db26ba8a4a5a1508e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45617e6d1a94461db26ba8a4a5a1508e, a9d90ce0071e40138b8395daba55486c; no voters:
I20260811 00:55:33.687037 23961 raft_consensus.cc:2781] T fa428bc22a4a44c68f919aedbc88e11c P 45617e6d1a94461db26ba8a4a5a1508e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:55:33.687140 23961 raft_consensus.cc:482] T fa428bc22a4a44c68f919aedbc88e11c P 45617e6d1a94461db26ba8a4a5a1508e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:55:33.687181 23961 raft_consensus.cc:3037] T fa428bc22a4a44c68f919aedbc88e11c P 45617e6d1a94461db26ba8a4a5a1508e [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:33.688131 23961 raft_consensus.cc:504] T fa428bc22a4a44c68f919aedbc88e11c P 45617e6d1a94461db26ba8a4a5a1508e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd097eae8e3a40e18f7679a996b242c3" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 41427 } } peers { permanent_uuid: "a9d90ce0071e40138b8395daba55486c" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37011 } } peers { permanent_uuid: "45617e6d1a94461db26ba8a4a5a1508e" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 41115 } }
I20260811 00:55:33.688313 23961 leader_election.cc:288] T fa428bc22a4a44c68f919aedbc88e11c P 45617e6d1a94461db26ba8a4a5a1508e [CANDIDATE]: Term 1 election: Requested vote from peers cd097eae8e3a40e18f7679a996b242c3 (127.15.70.3:41427), a9d90ce0071e40138b8395daba55486c (127.15.70.1:37011)
I20260811 00:55:33.688625 23389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa428bc22a4a44c68f919aedbc88e11c" candidate_uuid: "45617e6d1a94461db26ba8a4a5a1508e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d90ce0071e40138b8395daba55486c"
I20260811 00:55:33.688627 23843 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa428bc22a4a44c68f919aedbc88e11c" candidate_uuid: "45617e6d1a94461db26ba8a4a5a1508e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd097eae8e3a40e18f7679a996b242c3"
I20260811 00:55:33.688723 23389 raft_consensus.cc:3037] T fa428bc22a4a44c68f919aedbc88e11c P a9d90ce0071e40138b8395daba55486c [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:33.688748 23843 raft_consensus.cc:3037] T fa428bc22a4a44c68f919aedbc88e11c P cd097eae8e3a40e18f7679a996b242c3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:33.689690 23389 raft_consensus.cc:2454] T fa428bc22a4a44c68f919aedbc88e11c P a9d90ce0071e40138b8395daba55486c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45617e6d1a94461db26ba8a4a5a1508e in term 1.
I20260811 00:55:33.689699 23843 raft_consensus.cc:2454] T fa428bc22a4a44c68f919aedbc88e11c P cd097eae8e3a40e18f7679a996b242c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45617e6d1a94461db26ba8a4a5a1508e in term 1.
I20260811 00:55:33.689888 23491 leader_election.cc:302] T fa428bc22a4a44c68f919aedbc88e11c P 45617e6d1a94461db26ba8a4a5a1508e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45617e6d1a94461db26ba8a4a5a1508e, a9d90ce0071e40138b8395daba55486c; no voters:
I20260811 00:55:33.690007 23961 raft_consensus.cc:2781] T fa428bc22a4a44c68f919aedbc88e11c P 45617e6d1a94461db26ba8a4a5a1508e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:55:33.690194 23961 raft_consensus.cc:686] T fa428bc22a4a44c68f919aedbc88e11c P 45617e6d1a94461db26ba8a4a5a1508e [term 1 LEADER]: Becoming Leader. State: Replica: 45617e6d1a94461db26ba8a4a5a1508e, State: Running, Role: LEADER
I20260811 00:55:33.690325 23961 consensus_queue.cc:237] T fa428bc22a4a44c68f919aedbc88e11c P 45617e6d1a94461db26ba8a4a5a1508e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd097eae8e3a40e18f7679a996b242c3" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 41427 } } peers { permanent_uuid: "a9d90ce0071e40138b8395daba55486c" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37011 } } peers { permanent_uuid: "45617e6d1a94461db26ba8a4a5a1508e" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 41115 } }
I20260811 00:55:33.691571 23131 catalog_manager.cc:5495] T fa428bc22a4a44c68f919aedbc88e11c P 45617e6d1a94461db26ba8a4a5a1508e reported cstate change: term changed from 0 to 1, leader changed from <none> to 45617e6d1a94461db26ba8a4a5a1508e (127.15.70.2). New cstate: current_term: 1 leader_uuid: "45617e6d1a94461db26ba8a4a5a1508e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd097eae8e3a40e18f7679a996b242c3" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 41427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9d90ce0071e40138b8395daba55486c" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45617e6d1a94461db26ba8a4a5a1508e" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 41115 } health_report { overall_health: HEALTHY } } }
W20260811 00:55:33.694628 23694 tablet.cc:2369] T fa428bc22a4a44c68f919aedbc88e11c P 45617e6d1a94461db26ba8a4a5a1508e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 00:55:33.702102 23953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:33.700505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50048 (local address 127.15.70.2:41115)
0811 00:55:33.700583 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:33.700585 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:33.700594 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:55:33.700636 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:33.700637 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:33.700654 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:33.700714 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:33.701744 (+ 1030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:33.701745 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:33.701746 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:55:33.701752 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:33.701773 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:55:33.701779 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:33.701839 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:33.701914 (+ 75us) server_negotiation.cc:299] Negotiation successful
0811 00:55:33.701930 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 00:55:33.704761 23389 raft_consensus.cc:1261] T fa428bc22a4a44c68f919aedbc88e11c P a9d90ce0071e40138b8395daba55486c [term 1 FOLLOWER]: Refusing update from remote peer 45617e6d1a94461db26ba8a4a5a1508e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:55:33.704761 23843 raft_consensus.cc:1261] T fa428bc22a4a44c68f919aedbc88e11c P cd097eae8e3a40e18f7679a996b242c3 [term 1 FOLLOWER]: Refusing update from remote peer 45617e6d1a94461db26ba8a4a5a1508e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:55:33.705214 23961 consensus_queue.cc:1035] T fa428bc22a4a44c68f919aedbc88e11c P 45617e6d1a94461db26ba8a4a5a1508e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d90ce0071e40138b8395daba55486c" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:55:33.705400 23967 consensus_queue.cc:1035] T fa428bc22a4a44c68f919aedbc88e11c P 45617e6d1a94461db26ba8a4a5a1508e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd097eae8e3a40e18f7679a996b242c3" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 41427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:55:33.708725 23976 mvcc.cc:205] Tried to move back new op lower bound from 7317134269251129344 to 7317134269196640256. Current Snapshot: MvccSnapshot[applied={T|T < 7317134269251129344}]
I20260811 00:55:33.709257 23977 mvcc.cc:205] Tried to move back new op lower bound from 7317134269251129344 to 7317134269196640256. Current Snapshot: MvccSnapshot[applied={T|T < 7317134269251129344 or (T in {7317134269251129344})}]
I20260811 00:55:33.711529 23131 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53810:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:55:33.711659 23131 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53810:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:55:33.712656 23131 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 01285a636374410994f6672cd852c474: Sending DeleteTablet for 3 replicas of tablet fa428bc22a4a44c68f919aedbc88e11c
I20260811 00:55:33.713133 23807 tablet_service.cc:1514] Processing DeleteTablet for tablet fa428bc22a4a44c68f919aedbc88e11c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:55:33 UTC) from {username='slave'} at 127.0.0.1:58096
I20260811 00:55:33.713133 23354 tablet_service.cc:1514] Processing DeleteTablet for tablet fa428bc22a4a44c68f919aedbc88e11c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:55:33 UTC) from {username='slave'} at 127.0.0.1:35138
I20260811 00:55:33.713423 23576 tablet_service.cc:1514] Processing DeleteTablet for tablet fa428bc22a4a44c68f919aedbc88e11c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:55:33 UTC) from {username='slave'} at 127.0.0.1:50032
I20260811 00:55:33.713675 23992 tablet_replica.cc:330] T fa428bc22a4a44c68f919aedbc88e11c P 45617e6d1a94461db26ba8a4a5a1508e: stopping tablet replica
I20260811 00:55:33.713691 23989 tablet_replica.cc:330] T fa428bc22a4a44c68f919aedbc88e11c P a9d90ce0071e40138b8395daba55486c: stopping tablet replica
I20260811 00:55:33.713792 23989 raft_consensus.cc:2229] T fa428bc22a4a44c68f919aedbc88e11c P a9d90ce0071e40138b8395daba55486c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:55:33.713792 23992 raft_consensus.cc:2229] T fa428bc22a4a44c68f919aedbc88e11c P 45617e6d1a94461db26ba8a4a5a1508e [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:55:33.713900 23992 raft_consensus.cc:2258] T fa428bc22a4a44c68f919aedbc88e11c P 45617e6d1a94461db26ba8a4a5a1508e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:55:33.713909 23989 raft_consensus.cc:2258] T fa428bc22a4a44c68f919aedbc88e11c P a9d90ce0071e40138b8395daba55486c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:55:33.713888 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 23241
I20260811 00:55:33.714859 23986 tablet_replica.cc:330] T fa428bc22a4a44c68f919aedbc88e11c P cd097eae8e3a40e18f7679a996b242c3: stopping tablet replica
I20260811 00:55:33.714968 23986 raft_consensus.cc:2229] T fa428bc22a4a44c68f919aedbc88e11c P cd097eae8e3a40e18f7679a996b242c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:55:33.715121 23986 raft_consensus.cc:2258] T fa428bc22a4a44c68f919aedbc88e11c P cd097eae8e3a40e18f7679a996b242c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:55:33.718393 23986 ts_tablet_manager.cc:1905] T fa428bc22a4a44c68f919aedbc88e11c P cd097eae8e3a40e18f7679a996b242c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:55:33.718393 23992 ts_tablet_manager.cc:1905] T fa428bc22a4a44c68f919aedbc88e11c P 45617e6d1a94461db26ba8a4a5a1508e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:55:33.720625 23986 ts_tablet_manager.cc:1918] T fa428bc22a4a44c68f919aedbc88e11c P cd097eae8e3a40e18f7679a996b242c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:55:33.720613 23992 ts_tablet_manager.cc:1918] T fa428bc22a4a44c68f919aedbc88e11c P 45617e6d1a94461db26ba8a4a5a1508e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:55:33.720705 23986 log.cc:1196] T fa428bc22a4a44c68f919aedbc88e11c P cd097eae8e3a40e18f7679a996b242c3: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-2/wal/wals/fa428bc22a4a44c68f919aedbc88e11c
I20260811 00:55:33.720705 23992 log.cc:1196] T fa428bc22a4a44c68f919aedbc88e11c P 45617e6d1a94461db26ba8a4a5a1508e: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409704606556-15640-0/minicluster-data/ts-1/wal/wals/fa428bc22a4a44c68f919aedbc88e11c
I20260811 00:55:33.721014 23986 ts_tablet_manager.cc:1939] T fa428bc22a4a44c68f919aedbc88e11c P cd097eae8e3a40e18f7679a996b242c3: Deleting consensus metadata
I20260811 00:55:33.721015 23992 ts_tablet_manager.cc:1939] T fa428bc22a4a44c68f919aedbc88e11c P 45617e6d1a94461db26ba8a4a5a1508e: Deleting consensus metadata
I20260811 00:55:33.721547 23108 catalog_manager.cc:4841] TS 45617e6d1a94461db26ba8a4a5a1508e (127.15.70.2:41115): tablet fa428bc22a4a44c68f919aedbc88e11c (table test-table [id=a31e532fcf6747c998f3fc0b6ace1865]) successfully deleted
I20260811 00:55:33.721662 23108 catalog_manager.cc:4841] TS cd097eae8e3a40e18f7679a996b242c3 (127.15.70.3:41427): tablet fa428bc22a4a44c68f919aedbc88e11c (table test-table [id=a31e532fcf6747c998f3fc0b6ace1865]) successfully deleted
W20260811 00:55:33.730106 23108 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.70.1:37011 (error 108)
I20260811 00:55:33.731101 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 23468
I20260811 00:55:33.735106 23945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:33.734862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:37011 (local address 127.0.0.1:35144)
0811 00:55:33.734948 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:33.735043 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.1:37011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260811 00:55:33.735328 23108 catalog_manager.cc:4584] TS a9d90ce0071e40138b8395daba55486c (127.15.70.1:37011): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet fa428bc22a4a44c68f919aedbc88e11c: Network error: Client connection negotiation failed: client connection to 127.15.70.1:37011: connect: Connection refused (error 111)
I20260811 00:55:33.744976 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 23696
I20260811 00:55:33.762081 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 23078
2026-08-11T00:55:33Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (839 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260811 00:55:33.793211 15640 mini_oidc.cc:152] Starting JWKS server
I20260811 00:55:33.795106 15640 webserver.cc:460] Webserver started at https://127.0.0.1:39311/ using document root <none> and password file <none>
I20260811 00:55:33.795230 15640 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 00:55:33.795436 15640 webserver.cc:460] Webserver started at http://127.0.0.1:42371/ using document root <none> and password file <none>
2026-08-11T00:55:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:55:33Z Disabled control of system clock
I20260811 00:55:33.807443 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:36259
--webserver_interface=127.15.70.62
--webserver_port=0
--builtin_ntp_servers=127.15.70.20:46447
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:36259
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39311/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786409704606556-15640-0/testchainca.cert with env {}
W20260811 00:55:33.902415 24002 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:33.902755 24002 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:33.902799 24002 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:33.904139 24002 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:55:33.904229 24002 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:33.904255 24002 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:33.904275 24002 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:55:33.904297 24002 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 00:55:33.904327 24002 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 00:55:33.904347 24002 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39311/jwks.json
I20260811 00:55:33.906172 24002 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:46447
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:36259
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:36259
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39311/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786409704606556-15640-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24002
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:33.906567 24002 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:33.906849 24002 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:33.913090 24012 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:33.913064 24007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:33.913276 24002 server_base.cc:1034] running on GCE node
W20260811 00:55:33.913069 24010 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:33.913837 24002 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:33.914237 24002 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:33.915421 24002 hybrid_clock.cc:648] HybridClock initialized: now 1786409733915431 us; error 59 us; skew 500 ppm
I20260811 00:55:33.917047 24002 webserver.cc:460] Webserver started at http://127.15.70.62:37985/ using document root <none> and password file <none>
I20260811 00:55:33.917356 24002 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:33.917446 24002 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:33.917608 24002 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:33.918919 24002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "f7bef5a3c57241e3bcb8767d2cf3cc62"
format_stamp: "Formatted at 2026-08-11 00:55:33 on dist-test-slave-h3ft"
server_key: "1f7be3d800b0d22414901904d41cb1a4"
server_key_iv: "bb5ee911de412895bdeecd4c44f83d79"
server_key_version: "encryptionkey@0"
I20260811 00:55:33.919413 24002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "f7bef5a3c57241e3bcb8767d2cf3cc62"
format_stamp: "Formatted at 2026-08-11 00:55:33 on dist-test-slave-h3ft"
server_key: "1f7be3d800b0d22414901904d41cb1a4"
server_key_iv: "bb5ee911de412895bdeecd4c44f83d79"
server_key_version: "encryptionkey@0"
I20260811 00:55:33.921054 24002 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:55:33.921944 24019 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:33.922181 24002 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:33.922304 24002 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "f7bef5a3c57241e3bcb8767d2cf3cc62"
format_stamp: "Formatted at 2026-08-11 00:55:33 on dist-test-slave-h3ft"
server_key: "1f7be3d800b0d22414901904d41cb1a4"
server_key_iv: "bb5ee911de412895bdeecd4c44f83d79"
server_key_version: "encryptionkey@0"
I20260811 00:55:33.922390 24002 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:33.941370 24002 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:33.941821 24002 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:33.942034 24002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:33.947438 24002 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:36259
I20260811 00:55:33.947525 24103 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:36259 every 8 connection(s)
I20260811 00:55:33.947949 24002 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:55:33.949208 24104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:33.952207 24104 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7bef5a3c57241e3bcb8767d2cf3cc62: Bootstrap starting.
I20260811 00:55:33.953138 24104 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f7bef5a3c57241e3bcb8767d2cf3cc62: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:33.953508 24104 log.cc:824] T 00000000000000000000000000000000 P f7bef5a3c57241e3bcb8767d2cf3cc62: Log is configured to *not* fsync() on all Append() calls
I20260811 00:55:33.953794 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 24002
I20260811 00:55:33.953938 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 00:55:33.954201 15640 external_mini_cluster.cc:1428] Setting key 3551c9f22a9af80e3eba332efe369b8e
I20260811 00:55:33.954550 24104 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7bef5a3c57241e3bcb8767d2cf3cc62: No bootstrap required, opened a new log
I20260811 00:55:33.956650 24104 raft_consensus.cc:348] T 00000000000000000000000000000000 P f7bef5a3c57241e3bcb8767d2cf3cc62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7bef5a3c57241e3bcb8767d2cf3cc62" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 36259 } }
I20260811 00:55:33.956880 24104 raft_consensus.cc:374] T 00000000000000000000000000000000 P f7bef5a3c57241e3bcb8767d2cf3cc62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:33.956938 24104 raft_consensus.cc:729] T 00000000000000000000000000000000 P f7bef5a3c57241e3bcb8767d2cf3cc62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7bef5a3c57241e3bcb8767d2cf3cc62, State: Initialized, Role: FOLLOWER
I20260811 00:55:33.957104 24104 consensus_queue.cc:260] T 00000000000000000000000000000000 P f7bef5a3c57241e3bcb8767d2cf3cc62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7bef5a3c57241e3bcb8767d2cf3cc62" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 36259 } }
I20260811 00:55:33.957202 24104 raft_consensus.cc:388] T 00000000000000000000000000000000 P f7bef5a3c57241e3bcb8767d2cf3cc62 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:55:33.957257 24104 raft_consensus.cc:482] T 00000000000000000000000000000000 P f7bef5a3c57241e3bcb8767d2cf3cc62 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:55:33.957320 24104 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f7bef5a3c57241e3bcb8767d2cf3cc62 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:33.958392 24104 raft_consensus.cc:504] T 00000000000000000000000000000000 P f7bef5a3c57241e3bcb8767d2cf3cc62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7bef5a3c57241e3bcb8767d2cf3cc62" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 36259 } }
I20260811 00:55:33.958527 24104 leader_election.cc:302] T 00000000000000000000000000000000 P f7bef5a3c57241e3bcb8767d2cf3cc62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f7bef5a3c57241e3bcb8767d2cf3cc62; no voters:
I20260811 00:55:33.958715 24104 leader_election.cc:288] T 00000000000000000000000000000000 P f7bef5a3c57241e3bcb8767d2cf3cc62 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:55:33.958786 24115 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f7bef5a3c57241e3bcb8767d2cf3cc62 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:55:33.959040 24104 sys_catalog.cc:564] T 00000000000000000000000000000000 P f7bef5a3c57241e3bcb8767d2cf3cc62 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:55:33.959071 24115 raft_consensus.cc:686] T 00000000000000000000000000000000 P f7bef5a3c57241e3bcb8767d2cf3cc62 [term 1 LEADER]: Becoming Leader. State: Replica: f7bef5a3c57241e3bcb8767d2cf3cc62, State: Running, Role: LEADER
I20260811 00:55:33.959317 24115 consensus_queue.cc:237] T 00000000000000000000000000000000 P f7bef5a3c57241e3bcb8767d2cf3cc62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7bef5a3c57241e3bcb8767d2cf3cc62" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 36259 } }
I20260811 00:55:33.959801 24117 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7bef5a3c57241e3bcb8767d2cf3cc62 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f7bef5a3c57241e3bcb8767d2cf3cc62" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7bef5a3c57241e3bcb8767d2cf3cc62" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 36259 } } }
I20260811 00:55:33.959908 24117 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7bef5a3c57241e3bcb8767d2cf3cc62 [sys.catalog]: This master's current role is: LEADER
I20260811 00:55:33.960163 24129 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:55:33.960798 24129 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:55:33.961570 24120 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7bef5a3c57241e3bcb8767d2cf3cc62 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f7bef5a3c57241e3bcb8767d2cf3cc62. Latest consensus state: current_term: 1 leader_uuid: "f7bef5a3c57241e3bcb8767d2cf3cc62" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7bef5a3c57241e3bcb8767d2cf3cc62" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 36259 } } }
I20260811 00:55:33.961688 24120 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7bef5a3c57241e3bcb8767d2cf3cc62 [sys.catalog]: This master's current role is: LEADER
I20260811 00:55:33.963723 24114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:33.954839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55388 (local address 127.15.70.62:36259)
0811 00:55:33.955108 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:33.955121 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:33.955162 (+ 41us) server_negotiation.cc:407] Connection header received
0811 00:55:33.956642 (+ 1480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:33.956652 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:33.956736 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:33.957029 (+ 293us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:33.957342 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:33.959465 (+ 2123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:33.960776 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:33.961430 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:33.961560 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:33.962813 (+ 1253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:33.962817 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:33.962817 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:55:33.963118 (+ 301us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:33.963158 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:55:33.963172 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:33.963251 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:33.963376 (+ 125us) server_negotiation.cc:299] Negotiation successful
0811 00:55:33.963472 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":99,"threads_started":1}
I20260811 00:55:33.963871 24129 catalog_manager.cc:1347] Generated new cluster ID: 2ca7f524c307402a8a8fcaed383e63e0
I20260811 00:55:33.963929 24129 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:55:33.964895 15640 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 00:55:33.985639 24129 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:55:33.986337 24129 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:55:33.989136 24129 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f7bef5a3c57241e3bcb8767d2cf3cc62: Generated new TSK 0
I20260811 00:55:33.989403 24129 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 00:55:34.021790 24154 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260811 00:55:34.021988 24154 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 00:55:34.022157 24114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:33.997378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55396 (local address 127.15.70.62:36259)
0811 00:55:33.997460 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:33.997463 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:33.997663 (+ 200us) server_negotiation.cc:407] Connection header received
0811 00:55:33.997783 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:33.997784 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:33.997796 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:33.997858 (+ 62us) server_negotiation.cc:226] Negotiated authn=JWT
0811 00:55:33.998101 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:33.998646 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:33.999939 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:34.000183 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:34.000254 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:34.000515 (+ 261us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 00:55:34.021752 (+ 21237us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39311/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 00:55:34.022038 (+ 286us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:55396: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39311/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":45}
W20260811 00:55:34.022233 24114 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:55396: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39311/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260811 00:55:34.022701 24153 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:55:33.997311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:36259 (local address 127.0.0.1:55396)
0811 00:55:33.997570 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:33.997583 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:33.997677 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:33.997893 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:33.997894 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:33.997896 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 00:55:33.997992 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:33.997995 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:33.998744 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:33.998745 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:33.999783 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:33.999786 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:34.000288 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:34.000289 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:34.000361 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:34.000389 (+ 28us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 00:55:34.021969 (+ 21580us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39311/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 00:55:34.022156 (+ 187us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.15.70.62:36259: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39311/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":126,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.15.70.62:36259: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39311/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260811 00:55:34.023422 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 24002
2026-08-11T00:55:34Z chronyd exiting
I20260811 00:55:34.077318 15640 test_util.cc:175] -----------------------------------------------
I20260811 00:55:34.077486 15640 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786409704606556-15640-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (286 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260811 00:55:34.078680 15640 mini_oidc.cc:152] Starting JWKS server
I20260811 00:55:34.079675 15640 webserver.cc:460] Webserver started at https://127.0.0.1:38337/ using document root <none> and password file <none>
I20260811 00:55:34.079761 15640 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 00:55:34.079952 15640 webserver.cc:460] Webserver started at http://127.0.0.1:45023/ using document root <none> and password file <none>
2026-08-11T00:55:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:55:34Z Disabled control of system clock
I20260811 00:55:34.092845 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:44659
--webserver_interface=127.15.70.62
--webserver_port=0
--builtin_ntp_servers=127.15.70.20:36117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:44659
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38337/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786409704606556-15640-0/testchainca.cert with env {}
W20260811 00:55:34.189376 24163 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:34.189651 24163 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:34.189682 24163 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:34.191116 24163 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:55:34.191165 24163 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:34.191179 24163 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:34.191191 24163 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:55:34.191205 24163 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 00:55:34.191217 24163 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 00:55:34.191263 24163 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:38337/jwks.json
I20260811 00:55:34.192992 24163 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:36117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:44659
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:44659
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38337/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786409704606556-15640-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24163
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:34.193318 24163 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:34.193584 24163 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:34.199258 24175 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:34.199271 24173 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:34.199265 24178 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:34.199681 24163 server_base.cc:1034] running on GCE node
I20260811 00:55:34.200011 24163 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:34.200346 24163 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:34.201506 24163 hybrid_clock.cc:648] HybridClock initialized: now 1786409734201478 us; error 42 us; skew 500 ppm
I20260811 00:55:34.203254 24163 webserver.cc:460] Webserver started at http://127.15.70.62:36179/ using document root <none> and password file <none>
I20260811 00:55:34.203537 24163 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:34.203616 24163 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:34.203784 24163 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:34.205164 24163 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "ed02783c54f0474f899b69eb1c956700"
format_stamp: "Formatted at 2026-08-11 00:55:34 on dist-test-slave-h3ft"
server_key: "9bc5944b6e0ca36a5854f874188685c5"
server_key_iv: "2a2f05d11c0ef670d56bfd33c31e45e0"
server_key_version: "encryptionkey@0"
I20260811 00:55:34.205628 24163 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "ed02783c54f0474f899b69eb1c956700"
format_stamp: "Formatted at 2026-08-11 00:55:34 on dist-test-slave-h3ft"
server_key: "9bc5944b6e0ca36a5854f874188685c5"
server_key_iv: "2a2f05d11c0ef670d56bfd33c31e45e0"
server_key_version: "encryptionkey@0"
I20260811 00:55:34.207350 24163 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260811 00:55:34.208242 24188 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:34.208437 24163 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:34.208556 24163 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "ed02783c54f0474f899b69eb1c956700"
format_stamp: "Formatted at 2026-08-11 00:55:34 on dist-test-slave-h3ft"
server_key: "9bc5944b6e0ca36a5854f874188685c5"
server_key_iv: "2a2f05d11c0ef670d56bfd33c31e45e0"
server_key_version: "encryptionkey@0"
I20260811 00:55:34.208640 24163 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:34.232430 24163 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:34.232898 24163 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:34.233093 24163 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:34.238242 24163 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:44659
I20260811 00:55:34.238291 24273 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:44659 every 8 connection(s)
I20260811 00:55:34.238729 24163 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:55:34.239398 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 24163
I20260811 00:55:34.239526 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 00:55:34.239754 15640 external_mini_cluster.cc:1428] Setting key b1efbe6144268940727ed25e32acafef
I20260811 00:55:34.239796 24276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:34.243881 24276 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed02783c54f0474f899b69eb1c956700: Bootstrap starting.
I20260811 00:55:34.244796 24276 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ed02783c54f0474f899b69eb1c956700: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:34.245138 24276 log.cc:824] T 00000000000000000000000000000000 P ed02783c54f0474f899b69eb1c956700: Log is configured to *not* fsync() on all Append() calls
I20260811 00:55:34.246078 24276 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed02783c54f0474f899b69eb1c956700: No bootstrap required, opened a new log
I20260811 00:55:34.247205 24284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:34.240693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54932 (local address 127.15.70.62:44659)
0811 00:55:34.240940 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:34.240951 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:34.240989 (+ 38us) server_negotiation.cc:407] Connection header received
0811 00:55:34.241699 (+ 710us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:34.241710 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:34.241807 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:34.241994 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:34.242212 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:34.243714 (+ 1502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:34.244581 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:34.245264 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:34.245410 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:34.246339 (+ 929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:34.246344 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:34.246345 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:55:34.246582 (+ 237us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:34.246632 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:55:34.246649 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:34.246723 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:34.246787 (+ 64us) server_negotiation.cc:299] Negotiation successful
0811 00:55:34.246875 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":77,"threads_started":1}
I20260811 00:55:34.248481 15640 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 00:55:34.249024 24276 raft_consensus.cc:348] T 00000000000000000000000000000000 P ed02783c54f0474f899b69eb1c956700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed02783c54f0474f899b69eb1c956700" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 44659 } }
I20260811 00:55:34.249218 24276 raft_consensus.cc:374] T 00000000000000000000000000000000 P ed02783c54f0474f899b69eb1c956700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:34.249255 24276 raft_consensus.cc:729] T 00000000000000000000000000000000 P ed02783c54f0474f899b69eb1c956700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed02783c54f0474f899b69eb1c956700, State: Initialized, Role: FOLLOWER
I20260811 00:55:34.249388 24276 consensus_queue.cc:260] T 00000000000000000000000000000000 P ed02783c54f0474f899b69eb1c956700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed02783c54f0474f899b69eb1c956700" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 44659 } }
I20260811 00:55:34.249496 24276 raft_consensus.cc:388] T 00000000000000000000000000000000 P ed02783c54f0474f899b69eb1c956700 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:55:34.249531 24276 raft_consensus.cc:482] T 00000000000000000000000000000000 P ed02783c54f0474f899b69eb1c956700 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:55:34.249588 24276 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ed02783c54f0474f899b69eb1c956700 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:34.250201 24276 raft_consensus.cc:504] T 00000000000000000000000000000000 P ed02783c54f0474f899b69eb1c956700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed02783c54f0474f899b69eb1c956700" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 44659 } }
I20260811 00:55:34.250334 24276 leader_election.cc:302] T 00000000000000000000000000000000 P ed02783c54f0474f899b69eb1c956700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ed02783c54f0474f899b69eb1c956700; no voters:
I20260811 00:55:34.250545 24276 leader_election.cc:288] T 00000000000000000000000000000000 P ed02783c54f0474f899b69eb1c956700 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:55:34.250586 24287 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ed02783c54f0474f899b69eb1c956700 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:55:34.250836 24287 raft_consensus.cc:686] T 00000000000000000000000000000000 P ed02783c54f0474f899b69eb1c956700 [term 1 LEADER]: Becoming Leader. State: Replica: ed02783c54f0474f899b69eb1c956700, State: Running, Role: LEADER
I20260811 00:55:34.250839 24276 sys_catalog.cc:564] T 00000000000000000000000000000000 P ed02783c54f0474f899b69eb1c956700 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:55:34.251073 24287 consensus_queue.cc:237] T 00000000000000000000000000000000 P ed02783c54f0474f899b69eb1c956700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed02783c54f0474f899b69eb1c956700" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 44659 } }
I20260811 00:55:34.251511 24289 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed02783c54f0474f899b69eb1c956700 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ed02783c54f0474f899b69eb1c956700" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed02783c54f0474f899b69eb1c956700" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 44659 } } }
I20260811 00:55:34.251524 24291 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed02783c54f0474f899b69eb1c956700 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ed02783c54f0474f899b69eb1c956700. Latest consensus state: current_term: 1 leader_uuid: "ed02783c54f0474f899b69eb1c956700" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed02783c54f0474f899b69eb1c956700" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 44659 } } }
I20260811 00:55:34.251636 24289 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed02783c54f0474f899b69eb1c956700 [sys.catalog]: This master's current role is: LEADER
I20260811 00:55:34.251641 24291 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed02783c54f0474f899b69eb1c956700 [sys.catalog]: This master's current role is: LEADER
I20260811 00:55:34.251940 24301 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:55:34.252650 24301 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:55:34.254432 24301 catalog_manager.cc:1347] Generated new cluster ID: 4ed774811a8a4e619e698c912d529840
I20260811 00:55:34.254492 24301 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:55:34.263418 24301 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:55:34.264160 24301 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:55:34.269572 24301 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ed02783c54f0474f899b69eb1c956700: Generated new TSK 0
I20260811 00:55:34.269791 24301 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 00:55:34.302747 24330 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260811 00:55:34.302889 24330 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 00:55:34.303488 24284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:34.281889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54934 (local address 127.15.70.62:44659)
0811 00:55:34.281970 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:34.281973 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:34.282199 (+ 226us) server_negotiation.cc:407] Connection header received
0811 00:55:34.282281 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:34.282282 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:34.282298 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:34.282379 (+ 81us) server_negotiation.cc:226] Negotiated authn=JWT
0811 00:55:34.282580 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:34.283263 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:34.284494 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:34.284733 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:34.284798 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:34.285054 (+ 256us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 00:55:34.303138 (+ 18084us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38337/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 00:55:34.303371 (+ 233us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:54934: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38337/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":43}
W20260811 00:55:34.303570 24284 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:54934: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38337/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260811 00:55:34.303589 24325 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:55:34.281817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:44659 (local address 127.0.0.1:54934)
0811 00:55:34.282080 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:34.282096 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:34.282192 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:34.282405 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:34.282407 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:34.282409 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 00:55:34.282507 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:34.282509 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:34.283353 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:34.283354 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:34.284376 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:34.284380 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:34.284822 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:34.284823 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:34.284903 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:34.284911 (+ 8us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 00:55:34.303307 (+ 18396us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38337/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 00:55:34.303470 (+ 163us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.15.70.62:44659: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38337/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":171,"threads_started":1}
I20260811 00:55:34.304081 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 24163
2026-08-11T00:55:34Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (278 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260811 00:55:34.356638 15640 mini_oidc.cc:152] Starting JWKS server
I20260811 00:55:34.357475 15640 webserver.cc:460] Webserver started at https://127.0.0.1:40159/ using document root <none> and password file <none>
I20260811 00:55:34.357528 15640 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 00:55:34.357712 15640 webserver.cc:460] Webserver started at http://127.0.0.1:38773/ using document root <none> and password file <none>
2026-08-11T00:55:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:55:34Z Disabled control of system clock
I20260811 00:55:34.368929 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:34497
--webserver_interface=127.15.70.62
--webserver_port=0
--builtin_ntp_servers=127.15.70.20:42673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:34497
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40159/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 00:55:34.465318 24341 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:34.465597 24341 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:34.465637 24341 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:34.466822 24341 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:55:34.466897 24341 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:34.466920 24341 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:34.466948 24341 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:55:34.466977 24341 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 00:55:34.467020 24341 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 00:55:34.467041 24341 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:40159/jwks.json
I20260811 00:55:34.468461 24341 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:42673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:34497
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:34497
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40159/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24341
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:34.468758 24341 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:34.469175 24341 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:34.475030 24360 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:34.474992 24354 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:34.475055 24357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:34.475488 24341 server_base.cc:1034] running on GCE node
I20260811 00:55:34.475777 24341 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:34.476089 24341 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:34.477252 24341 hybrid_clock.cc:648] HybridClock initialized: now 1786409734477235 us; error 37 us; skew 500 ppm
I20260811 00:55:34.483168 24341 webserver.cc:460] Webserver started at http://127.15.70.62:44905/ using document root <none> and password file <none>
I20260811 00:55:34.483525 24341 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:34.483583 24341 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:34.483740 24341 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:34.485051 24341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "00a04aeea3404c93b8a65e49f2654baf"
format_stamp: "Formatted at 2026-08-11 00:55:34 on dist-test-slave-h3ft"
server_key: "436320415ba023eb5180be0fef1b9133"
server_key_iv: "d1eeb94d09e159830a36d8de3bd9def9"
server_key_version: "encryptionkey@0"
I20260811 00:55:34.485527 24341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "00a04aeea3404c93b8a65e49f2654baf"
format_stamp: "Formatted at 2026-08-11 00:55:34 on dist-test-slave-h3ft"
server_key: "436320415ba023eb5180be0fef1b9133"
server_key_iv: "d1eeb94d09e159830a36d8de3bd9def9"
server_key_version: "encryptionkey@0"
I20260811 00:55:34.487433 24341 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260811 00:55:34.488374 24370 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:34.488642 24341 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:34.488765 24341 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "00a04aeea3404c93b8a65e49f2654baf"
format_stamp: "Formatted at 2026-08-11 00:55:34 on dist-test-slave-h3ft"
server_key: "436320415ba023eb5180be0fef1b9133"
server_key_iv: "d1eeb94d09e159830a36d8de3bd9def9"
server_key_version: "encryptionkey@0"
I20260811 00:55:34.488852 24341 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:34.510277 24341 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:34.510752 24341 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:34.510994 24341 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:34.516191 24341 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:34497
I20260811 00:55:34.516232 24455 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:34497 every 8 connection(s)
I20260811 00:55:34.516690 24341 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:55:34.517620 24458 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:34.521234 24458 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00a04aeea3404c93b8a65e49f2654baf: Bootstrap starting.
I20260811 00:55:34.522084 24458 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 00a04aeea3404c93b8a65e49f2654baf: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:34.522449 24458 log.cc:824] T 00000000000000000000000000000000 P 00a04aeea3404c93b8a65e49f2654baf: Log is configured to *not* fsync() on all Append() calls
I20260811 00:55:34.523545 24458 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00a04aeea3404c93b8a65e49f2654baf: No bootstrap required, opened a new log
I20260811 00:55:34.525389 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 24341
I20260811 00:55:34.525537 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 00:55:34.525766 15640 external_mini_cluster.cc:1428] Setting key 69490a6b718a09c17baa9425c531bb19
I20260811 00:55:34.526153 24458 raft_consensus.cc:348] T 00000000000000000000000000000000 P 00a04aeea3404c93b8a65e49f2654baf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00a04aeea3404c93b8a65e49f2654baf" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 34497 } }
I20260811 00:55:34.526365 24458 raft_consensus.cc:374] T 00000000000000000000000000000000 P 00a04aeea3404c93b8a65e49f2654baf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:34.526423 24458 raft_consensus.cc:729] T 00000000000000000000000000000000 P 00a04aeea3404c93b8a65e49f2654baf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00a04aeea3404c93b8a65e49f2654baf, State: Initialized, Role: FOLLOWER
I20260811 00:55:34.526573 24458 consensus_queue.cc:260] T 00000000000000000000000000000000 P 00a04aeea3404c93b8a65e49f2654baf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00a04aeea3404c93b8a65e49f2654baf" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 34497 } }
I20260811 00:55:34.526672 24458 raft_consensus.cc:388] T 00000000000000000000000000000000 P 00a04aeea3404c93b8a65e49f2654baf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:55:34.526717 24458 raft_consensus.cc:482] T 00000000000000000000000000000000 P 00a04aeea3404c93b8a65e49f2654baf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:55:34.526772 24458 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 00a04aeea3404c93b8a65e49f2654baf [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:34.527601 24458 raft_consensus.cc:504] T 00000000000000000000000000000000 P 00a04aeea3404c93b8a65e49f2654baf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00a04aeea3404c93b8a65e49f2654baf" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 34497 } }
I20260811 00:55:34.527748 24458 leader_election.cc:302] T 00000000000000000000000000000000 P 00a04aeea3404c93b8a65e49f2654baf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 00a04aeea3404c93b8a65e49f2654baf; no voters:
I20260811 00:55:34.527971 24458 leader_election.cc:288] T 00000000000000000000000000000000 P 00a04aeea3404c93b8a65e49f2654baf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:55:34.528296 24463 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 00a04aeea3404c93b8a65e49f2654baf [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:55:34.528343 24458 sys_catalog.cc:564] T 00000000000000000000000000000000 P 00a04aeea3404c93b8a65e49f2654baf [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:55:34.528481 24463 raft_consensus.cc:686] T 00000000000000000000000000000000 P 00a04aeea3404c93b8a65e49f2654baf [term 1 LEADER]: Becoming Leader. State: Replica: 00a04aeea3404c93b8a65e49f2654baf, State: Running, Role: LEADER
I20260811 00:55:34.528595 24463 consensus_queue.cc:237] T 00000000000000000000000000000000 P 00a04aeea3404c93b8a65e49f2654baf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00a04aeea3404c93b8a65e49f2654baf" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 34497 } }
I20260811 00:55:34.529021 24463 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00a04aeea3404c93b8a65e49f2654baf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 00a04aeea3404c93b8a65e49f2654baf. Latest consensus state: current_term: 1 leader_uuid: "00a04aeea3404c93b8a65e49f2654baf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00a04aeea3404c93b8a65e49f2654baf" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 34497 } } }
I20260811 00:55:34.529031 24464 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00a04aeea3404c93b8a65e49f2654baf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "00a04aeea3404c93b8a65e49f2654baf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00a04aeea3404c93b8a65e49f2654baf" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 34497 } } }
I20260811 00:55:34.529146 24463 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00a04aeea3404c93b8a65e49f2654baf [sys.catalog]: This master's current role is: LEADER
I20260811 00:55:34.529163 24464 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00a04aeea3404c93b8a65e49f2654baf [sys.catalog]: This master's current role is: LEADER
I20260811 00:55:34.529414 24481 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:55:34.530133 24481 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:55:34.532565 24481 catalog_manager.cc:1347] Generated new cluster ID: 432c6a0b2ce244f9aa5297cbfabefc1f
I20260811 00:55:34.532651 24481 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:55:34.533198 24462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:34.526591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43272 (local address 127.15.70.62:34497)
0811 00:55:34.526898 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:34.526908 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:34.526940 (+ 32us) server_negotiation.cc:407] Connection header received
0811 00:55:34.527128 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:34.527135 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:34.527201 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:34.527369 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:34.527634 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:34.529075 (+ 1441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:34.530302 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:34.531130 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:34.531260 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:34.532132 (+ 872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:34.532137 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:34.532137 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:55:34.532356 (+ 219us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:34.532404 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:55:34.532440 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:34.532835 (+ 395us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:34.532873 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 00:55:34.532970 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":132,"threads_started":1}
I20260811 00:55:34.534224 15640 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 00:55:34.543604 24481 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:55:34.544204 24481 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:55:34.551908 24481 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 00a04aeea3404c93b8a65e49f2654baf: Generated new TSK 0
I20260811 00:55:34.552165 24481 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:55:34.568462 24462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:34.564282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43274 (local address 127.15.70.62:34497)
0811 00:55:34.564343 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:34.564346 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:34.564477 (+ 131us) server_negotiation.cc:407] Connection header received
0811 00:55:34.564573 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:34.564574 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:34.564586 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:34.564648 (+ 62us) server_negotiation.cc:226] Negotiated authn=JWT
0811 00:55:34.564815 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:34.565376 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:34.566588 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:34.566803 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:34.566876 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:34.567124 (+ 248us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 00:55:34.568172 (+ 1048us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40159/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 00:55:34.568356 (+ 184us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:43274: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40159/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":31}
W20260811 00:55:34.568511 24507 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:55:34.564156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:34497 (local address 127.0.0.1:43274)
0811 00:55:34.564383 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:34.564396 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:34.564486 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:34.564666 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:34.564667 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:34.564669 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 00:55:34.564744 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:34.564747 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:34.565468 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:34.565469 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:34.566492 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:34.566495 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:34.566905 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:34.566906 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:34.566973 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:34.566980 (+ 7us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 00:55:34.568289 (+ 1309us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40159/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 00:55:34.568407 (+ 118us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.15.70.62:34497: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40159/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":139,"threads_started":1}
W20260811 00:55:34.568558 24462 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:43274: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40159/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
I20260811 00:55:34.568863 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 24341
E20260811 00:55:34.588269 24508 webserver.cc:533] Webserver: sslize failed:
E20260811 00:55:34.588441 24508 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-11T00:55:34Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (266 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-11T00:55:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:55:34Z Disabled control of system clock
I20260811 00:55:34.634140 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:40491
--webserver_interface=127.15.70.62
--webserver_port=0
--builtin_ntp_servers=127.15.70.20:45883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:40491
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786409704606556-15640-0/testchainca.cert with env {}
W20260811 00:55:34.732726 24514 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:34.733013 24514 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:34.733040 24514 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:34.734395 24514 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:55:34.734447 24514 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:34.734459 24514 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:34.734472 24514 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:55:34.734485 24514 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 00:55:34.734498 24514 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 00:55:34.734552 24514 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260811 00:55:34.736294 24514 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:45883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:40491
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:40491
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786409704606556-15640-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24514
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:34.736634 24514 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:34.736930 24514 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:34.742830 24523 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:34.742898 24527 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:34.742851 24530 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:34.743194 24514 server_base.cc:1034] running on GCE node
I20260811 00:55:34.743510 24514 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:34.743817 24514 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:34.744977 24514 hybrid_clock.cc:648] HybridClock initialized: now 1786409734744951 us; error 41 us; skew 500 ppm
I20260811 00:55:34.746579 24514 webserver.cc:460] Webserver started at http://127.15.70.62:42177/ using document root <none> and password file <none>
I20260811 00:55:34.746901 24514 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:34.746975 24514 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:34.747171 24514 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:34.748521 24514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "0c8137dfe5e940618e86e46a55e20484"
format_stamp: "Formatted at 2026-08-11 00:55:34 on dist-test-slave-h3ft"
server_key: "5dae4e43d30d3c72e26b1c7385db1351"
server_key_iv: "319d356deffcb178ae97bb72764ebc34"
server_key_version: "encryptionkey@0"
I20260811 00:55:34.748965 24514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "0c8137dfe5e940618e86e46a55e20484"
format_stamp: "Formatted at 2026-08-11 00:55:34 on dist-test-slave-h3ft"
server_key: "5dae4e43d30d3c72e26b1c7385db1351"
server_key_iv: "319d356deffcb178ae97bb72764ebc34"
server_key_version: "encryptionkey@0"
I20260811 00:55:34.750649 24514 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 00:55:34.751590 24541 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:34.751812 24514 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 00:55:34.751946 24514 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "0c8137dfe5e940618e86e46a55e20484"
format_stamp: "Formatted at 2026-08-11 00:55:34 on dist-test-slave-h3ft"
server_key: "5dae4e43d30d3c72e26b1c7385db1351"
server_key_iv: "319d356deffcb178ae97bb72764ebc34"
server_key_version: "encryptionkey@0"
I20260811 00:55:34.752045 24514 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:34.773815 24514 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:34.774245 24514 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:34.774441 24514 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:34.779634 24514 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:40491
I20260811 00:55:34.779675 24629 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:40491 every 8 connection(s)
I20260811 00:55:34.780108 24514 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:55:34.781388 24631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:34.784385 24631 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c8137dfe5e940618e86e46a55e20484: Bootstrap starting.
I20260811 00:55:34.785178 24631 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0c8137dfe5e940618e86e46a55e20484: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:34.785543 24631 log.cc:824] T 00000000000000000000000000000000 P 0c8137dfe5e940618e86e46a55e20484: Log is configured to *not* fsync() on all Append() calls
I20260811 00:55:34.786494 24631 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c8137dfe5e940618e86e46a55e20484: No bootstrap required, opened a new log
I20260811 00:55:34.788512 24631 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0c8137dfe5e940618e86e46a55e20484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c8137dfe5e940618e86e46a55e20484" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 40491 } }
I20260811 00:55:34.788697 24631 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0c8137dfe5e940618e86e46a55e20484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:34.788724 24631 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0c8137dfe5e940618e86e46a55e20484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8137dfe5e940618e86e46a55e20484, State: Initialized, Role: FOLLOWER
I20260811 00:55:34.788913 24631 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0c8137dfe5e940618e86e46a55e20484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c8137dfe5e940618e86e46a55e20484" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 40491 } }
I20260811 00:55:34.788980 24631 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0c8137dfe5e940618e86e46a55e20484 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:55:34.789036 24631 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0c8137dfe5e940618e86e46a55e20484 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:55:34.789098 24631 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0c8137dfe5e940618e86e46a55e20484 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:34.789830 24631 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0c8137dfe5e940618e86e46a55e20484 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c8137dfe5e940618e86e46a55e20484" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 40491 } }
I20260811 00:55:34.789930 24631 leader_election.cc:302] T 00000000000000000000000000000000 P 0c8137dfe5e940618e86e46a55e20484 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0c8137dfe5e940618e86e46a55e20484; no voters:
I20260811 00:55:34.790210 24631 leader_election.cc:288] T 00000000000000000000000000000000 P 0c8137dfe5e940618e86e46a55e20484 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:55:34.790242 24637 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0c8137dfe5e940618e86e46a55e20484 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:55:34.790380 24637 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0c8137dfe5e940618e86e46a55e20484 [term 1 LEADER]: Becoming Leader. State: Replica: 0c8137dfe5e940618e86e46a55e20484, State: Running, Role: LEADER
I20260811 00:55:34.790413 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 24514
I20260811 00:55:34.790486 24637 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0c8137dfe5e940618e86e46a55e20484 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c8137dfe5e940618e86e46a55e20484" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 40491 } }
I20260811 00:55:34.790551 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 00:55:34.790587 24631 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0c8137dfe5e940618e86e46a55e20484 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:55:34.790781 15640 external_mini_cluster.cc:1428] Setting key 77846469f9271658c8413659aff1397b
I20260811 00:55:34.791036 24639 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c8137dfe5e940618e86e46a55e20484 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0c8137dfe5e940618e86e46a55e20484" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c8137dfe5e940618e86e46a55e20484" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 40491 } } }
I20260811 00:55:34.791121 24639 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c8137dfe5e940618e86e46a55e20484 [sys.catalog]: This master's current role is: LEADER
I20260811 00:55:34.791833 24638 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c8137dfe5e940618e86e46a55e20484 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c8137dfe5e940618e86e46a55e20484. Latest consensus state: current_term: 1 leader_uuid: "0c8137dfe5e940618e86e46a55e20484" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c8137dfe5e940618e86e46a55e20484" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 40491 } } }
I20260811 00:55:34.791985 24638 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c8137dfe5e940618e86e46a55e20484 [sys.catalog]: This master's current role is: LEADER
I20260811 00:55:34.792101 24645 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:55:34.792789 24645 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:55:34.795603 24645 catalog_manager.cc:1347] Generated new cluster ID: c1b3aa9cb61c432386924402eaee38d6
I20260811 00:55:34.795683 24645 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:55:34.800616 24666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:34.792522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53738 (local address 127.15.70.62:40491)
0811 00:55:34.793718 (+ 1196us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:34.793728 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:34.793763 (+ 35us) server_negotiation.cc:407] Connection header received
0811 00:55:34.793902 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:34.793910 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:34.793991 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:34.794163 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:34.794734 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:34.796642 (+ 1908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:34.797864 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:34.798570 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:34.798696 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:34.799606 (+ 910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:34.799611 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:34.799611 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:55:34.799861 (+ 250us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:34.799905 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:55:34.799921 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:34.799986 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:34.800096 (+ 110us) server_negotiation.cc:299] Negotiation successful
0811 00:55:34.800186 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1113,"thread_start_us":96,"threads_started":1}
I20260811 00:55:34.801740 15640 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 00:55:34.806142 24645 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:55:34.806717 24645 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:55:34.812062 24645 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0c8137dfe5e940618e86e46a55e20484: Generated new TSK 0
I20260811 00:55:34.812291 24645 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:55:35.719504 24666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:34.820075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53754 (local address 127.15.70.62:40491)
0811 00:55:34.820132 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:34.820135 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:34.820261 (+ 126us) server_negotiation.cc:407] Connection header received
0811 00:55:34.820358 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:34.820359 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:34.820374 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:34.820482 (+ 108us) server_negotiation.cc:226] Negotiated authn=JWT
0811 00:55:34.820667 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:34.821251 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:34.822085 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:34.822347 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:34.822431 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:34.822638 (+ 207us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 00:55:35.719142 (+896504us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 00:55:35.719386 (+ 244us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:53754: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":24}
W20260811 00:55:35.719607 24666 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:53754: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260811 00:55:35.719606 24677 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:55:34.819969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:40491 (local address 127.0.0.1:53754)
0811 00:55:34.820181 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:34.820199 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:34.820285 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:34.820482 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:34.820484 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:34.820486 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 00:55:34.820583 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:34.820591 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:34.821343 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:34.821344 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:34.821989 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:34.821991 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:34.822434 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:34.822435 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:34.822506 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:34.822513 (+ 7us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 00:55:35.719328 (+896815us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 00:55:35.719479 (+ 151us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.15.70.62:40491: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":120,"threads_started":1}
I20260811 00:55:35.719965 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 24514
2026-08-11T00:55:35Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (1128 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (104 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (98 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:55:36 dist-test-slave-h3ft krb5kdc[24700](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:55:36 dist-test-slave-h3ft krb5kdc[24700](info): set up 2 sockets
Aug 11 00:55:36 dist-test-slave-h3ft krb5kdc[24700](info): commencing operation
krb5kdc: starting...
W20260811 00:55:37.288194 15640 mini_kdc.cc:121] Time spent starting KDC: real 1.332s user 0.003s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Aug 11 00:55:37 dist-test-slave-h3ft krb5kdc[24700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409737, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:55:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:55:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.70.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
I20260811 00:55:37.439791 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:32823
--webserver_interface=127.15.70.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:35005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:32823
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:37.540753 24725 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:37.541108 24725 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:37.541154 24725 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:37.542414 24725 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:55:37.542500 24725 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:37.542529 24725 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:37.542560 24725 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:55:37.542595 24725 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:55:37.544328 24725 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:35005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:32823
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:32823
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24725
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:37.544684 24725 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:37.545006 24725 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:37.551024 24738 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:37.551106 24733 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:37.551057 24734 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:37.551260 24725 server_base.cc:1034] running on GCE node
I20260811 00:55:37.551606 24725 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:37.551968 24725 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:37.553146 24725 hybrid_clock.cc:648] HybridClock initialized: now 1786409737553130 us; error 49 us; skew 500 ppm
Aug 11 00:55:37 dist-test-slave-h3ft krb5kdc[24700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409737, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:37.556527 24725 init.cc:377] Logged in from keytab as kudu/127.15.70.62@KRBTEST.COM (short username kudu)
I20260811 00:55:37.557193 24725 webserver.cc:460] Webserver started at http://127.15.70.62:33713/ using document root <none> and password file <none>
I20260811 00:55:37.557523 24725 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:37.557578 24725 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:37.557756 24725 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:37.559203 24725 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "506e59207209405ba2b836158f6193e3"
format_stamp: "Formatted at 2026-08-11 00:55:37 on dist-test-slave-h3ft"
server_key: "022d3e9daaa0982c51a595498ec3bdb3"
server_key_iv: "111ed73fd692d9e2f76dc621fb6d5058"
server_key_version: "encryptionkey@0"
I20260811 00:55:37.559635 24725 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "506e59207209405ba2b836158f6193e3"
format_stamp: "Formatted at 2026-08-11 00:55:37 on dist-test-slave-h3ft"
server_key: "022d3e9daaa0982c51a595498ec3bdb3"
server_key_iv: "111ed73fd692d9e2f76dc621fb6d5058"
server_key_version: "encryptionkey@0"
I20260811 00:55:37.561319 24725 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 00:55:37.562528 24753 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:37.562804 24725 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:37.562963 24725 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "506e59207209405ba2b836158f6193e3"
format_stamp: "Formatted at 2026-08-11 00:55:37 on dist-test-slave-h3ft"
server_key: "022d3e9daaa0982c51a595498ec3bdb3"
server_key_iv: "111ed73fd692d9e2f76dc621fb6d5058"
server_key_version: "encryptionkey@0"
I20260811 00:55:37.563092 24725 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:37.572572 24725 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:37.575052 24725 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:37.575253 24725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:37.580471 24725 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:32823
I20260811 00:55:37.580540 24850 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:32823 every 8 connection(s)
I20260811 00:55:37.580930 24725 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:55:37.582065 24852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:37.585143 24852 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 506e59207209405ba2b836158f6193e3: Bootstrap starting.
I20260811 00:55:37.585907 24852 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 506e59207209405ba2b836158f6193e3: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:37.586285 24852 log.cc:824] T 00000000000000000000000000000000 P 506e59207209405ba2b836158f6193e3: Log is configured to *not* fsync() on all Append() calls
I20260811 00:55:37.587280 24852 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 506e59207209405ba2b836158f6193e3: No bootstrap required, opened a new log
I20260811 00:55:37.587606 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 24725
I20260811 00:55:37.587735 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 00:55:37.587976 15640 external_mini_cluster.cc:1428] Setting key 280714b7808ab2067b8fbf63a4e99799
I20260811 00:55:37.590397 24852 raft_consensus.cc:348] T 00000000000000000000000000000000 P 506e59207209405ba2b836158f6193e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "506e59207209405ba2b836158f6193e3" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 32823 } }
I20260811 00:55:37.590646 24852 raft_consensus.cc:374] T 00000000000000000000000000000000 P 506e59207209405ba2b836158f6193e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:37.590691 24852 raft_consensus.cc:729] T 00000000000000000000000000000000 P 506e59207209405ba2b836158f6193e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 506e59207209405ba2b836158f6193e3, State: Initialized, Role: FOLLOWER
I20260811 00:55:37.590866 24852 consensus_queue.cc:260] T 00000000000000000000000000000000 P 506e59207209405ba2b836158f6193e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "506e59207209405ba2b836158f6193e3" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 32823 } }
I20260811 00:55:37.590961 24852 raft_consensus.cc:388] T 00000000000000000000000000000000 P 506e59207209405ba2b836158f6193e3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:55:37.590987 24852 raft_consensus.cc:482] T 00000000000000000000000000000000 P 506e59207209405ba2b836158f6193e3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:55:37.591094 24852 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 506e59207209405ba2b836158f6193e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:37.591895 24852 raft_consensus.cc:504] T 00000000000000000000000000000000 P 506e59207209405ba2b836158f6193e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "506e59207209405ba2b836158f6193e3" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 32823 } }
I20260811 00:55:37.592018 24852 leader_election.cc:302] T 00000000000000000000000000000000 P 506e59207209405ba2b836158f6193e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 506e59207209405ba2b836158f6193e3; no voters:
I20260811 00:55:37.592231 24852 leader_election.cc:288] T 00000000000000000000000000000000 P 506e59207209405ba2b836158f6193e3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:55:37.592351 24859 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 506e59207209405ba2b836158f6193e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:55:37.592604 24859 raft_consensus.cc:686] T 00000000000000000000000000000000 P 506e59207209405ba2b836158f6193e3 [term 1 LEADER]: Becoming Leader. State: Replica: 506e59207209405ba2b836158f6193e3, State: Running, Role: LEADER
I20260811 00:55:37.592618 24852 sys_catalog.cc:564] T 00000000000000000000000000000000 P 506e59207209405ba2b836158f6193e3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:55:37.592726 24859 consensus_queue.cc:237] T 00000000000000000000000000000000 P 506e59207209405ba2b836158f6193e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "506e59207209405ba2b836158f6193e3" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 32823 } }
I20260811 00:55:37.593331 24860 sys_catalog.cc:455] T 00000000000000000000000000000000 P 506e59207209405ba2b836158f6193e3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "506e59207209405ba2b836158f6193e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "506e59207209405ba2b836158f6193e3" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 32823 } } }
I20260811 00:55:37.593456 24860 sys_catalog.cc:458] T 00000000000000000000000000000000 P 506e59207209405ba2b836158f6193e3 [sys.catalog]: This master's current role is: LEADER
I20260811 00:55:37.593643 24861 sys_catalog.cc:455] T 00000000000000000000000000000000 P 506e59207209405ba2b836158f6193e3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 506e59207209405ba2b836158f6193e3. Latest consensus state: current_term: 1 leader_uuid: "506e59207209405ba2b836158f6193e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "506e59207209405ba2b836158f6193e3" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 32823 } } }
I20260811 00:55:37.593725 24861 sys_catalog.cc:458] T 00000000000000000000000000000000 P 506e59207209405ba2b836158f6193e3 [sys.catalog]: This master's current role is: LEADER
W20260811 00:55:37.595106 24884 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 506e59207209405ba2b836158f6193e3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 00:55:37.595323 24884 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 00:55:37.595419 24872 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:55:37.595656 24872 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:55:37.597558 24872 catalog_manager.cc:1347] Generated new cluster ID: a5cb15d78c254716a534bf90e9b88e23
I20260811 00:55:37.597617 24872 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 00:55:37 dist-test-slave-h3ft krb5kdc[24700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409737, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:37.602882 24858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:37.588697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46700 (local address 127.15.70.62:32823)
0811 00:55:37.588954 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:37.588966 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:37.589007 (+ 41us) server_negotiation.cc:407] Connection header received
0811 00:55:37.590312 (+ 1305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:37.590325 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:37.590419 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:37.590654 (+ 235us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:37.591667 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:37.593145 (+ 1478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:37.594300 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:37.594920 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:37.595077 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:37.598447 (+ 3370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:37.598452 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:37.598452 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:37.598467 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:37.600846 (+ 2379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:37.601299 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:37.601303 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:37.601303 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:37.601449 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:37.601672 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:37.601673 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:37.601673 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:37.602085 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:37.602331 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:37.602427 (+ 96us) server_negotiation.cc:299] Negotiation successful
0811 00:55:37.602596 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":129,"threads_started":1}
I20260811 00:55:37.610146 24872 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:55:37.610752 24872 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:55:37.621886 24872 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 506e59207209405ba2b836158f6193e3: Generated new TSK 0
I20260811 00:55:37.622237 24872 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.70.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab.
Entry for principal kudu/127.15.70.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab.
I20260811 00:55:37.660861 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.1:0
--local_ip_for_outbound_sockets=127.15.70.1
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:32823
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:35005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:37.759792 24897 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:37.760069 24897 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:37.760097 24897 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:37.761353 24897 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:37.761406 24897 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:37.761466 24897 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.1
I20260811 00:55:37.763367 24897 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:35005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:32823
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24897
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.1
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:37.763701 24897 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:37.764113 24897 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:37.770223 24907 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:37.770370 24909 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:37.770514 24905 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:37.770642 24897 server_base.cc:1034] running on GCE node
I20260811 00:55:37.770942 24897 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:37.771332 24897 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:37.772504 24897 hybrid_clock.cc:648] HybridClock initialized: now 1786409737772487 us; error 65 us; skew 500 ppm
Aug 11 00:55:37 dist-test-slave-h3ft krb5kdc[24700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409737, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:37.775674 24897 init.cc:377] Logged in from keytab as kudu/127.15.70.1@KRBTEST.COM (short username kudu)
I20260811 00:55:37.776204 24897 webserver.cc:460] Webserver started at http://127.15.70.1:36385/ using document root <none> and password file <none>
I20260811 00:55:37.776482 24897 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:37.776561 24897 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:37.776731 24897 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:37.778052 24897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-0/data/instance:
uuid: "ddf6393e7e164641bf80cbf05e6517e6"
format_stamp: "Formatted at 2026-08-11 00:55:37 on dist-test-slave-h3ft"
server_key: "673103ed4875e67a9f588857fa7fc85c"
server_key_iv: "51d7be71242709ed31ef2dc91c70020f"
server_key_version: "encryptionkey@0"
I20260811 00:55:37.778505 24897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance:
uuid: "ddf6393e7e164641bf80cbf05e6517e6"
format_stamp: "Formatted at 2026-08-11 00:55:37 on dist-test-slave-h3ft"
server_key: "673103ed4875e67a9f588857fa7fc85c"
server_key_iv: "51d7be71242709ed31ef2dc91c70020f"
server_key_version: "encryptionkey@0"
I20260811 00:55:37.780344 24897 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260811 00:55:37.781337 24922 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:37.781591 24897 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:37.781720 24897 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-0/wal
uuid: "ddf6393e7e164641bf80cbf05e6517e6"
format_stamp: "Formatted at 2026-08-11 00:55:37 on dist-test-slave-h3ft"
server_key: "673103ed4875e67a9f588857fa7fc85c"
server_key_iv: "51d7be71242709ed31ef2dc91c70020f"
server_key_version: "encryptionkey@0"
I20260811 00:55:37.781813 24897 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:37.801033 24897 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:37.803817 24897 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:37.804026 24897 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:37.804344 24897 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:55:37.804733 24897 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:55:37.804803 24897 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:37.804852 24897 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:55:37.804883 24897 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:37.813233 24897 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.1:45947
I20260811 00:55:37.813282 25111 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.1:45947 every 8 connection(s)
I20260811 00:55:37.813853 24897 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
I20260811 00:55:37.818943 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 24897
I20260811 00:55:37.819139 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance
I20260811 00:55:37.819407 15640 external_mini_cluster.cc:1428] Setting key 4d1b29c7625fcc50b572a27dd055e276
Aug 11 00:55:37 dist-test-slave-h3ft krb5kdc[24700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409737, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:37.825399 24858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:37.814918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:35335 (local address 127.15.70.62:32823)
0811 00:55:37.815058 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:37.815061 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:37.815209 (+ 148us) server_negotiation.cc:407] Connection header received
0811 00:55:37.816357 (+ 1148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:37.816359 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:37.816386 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:37.816464 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:37.817274 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:37.817935 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:37.819133 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:37.819467 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:37.819551 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:37.822178 (+ 2627us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:37.822180 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:37.822181 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:37.822190 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:37.823786 (+ 1596us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:37.824275 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:37.824277 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:37.824278 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:37.824347 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:37.824629 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:37.824630 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:37.824630 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:37.824767 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:37.824853 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:37.825168 (+ 315us) server_negotiation.cc:299] Negotiation successful
0811 00:55:37.825289 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 00:55:37.825636 25114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:37.814838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:32823 (local address 127.15.70.1:35335)
0811 00:55:37.815049 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:37.815102 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:37.816230 (+ 1128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:37.816573 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:37.816577 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:37.816905 (+ 328us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:37.817140 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:37.817144 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:37.818047 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:37.818048 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:37.818977 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:37.818980 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:37.819649 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:37.819650 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:37.819786 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:37.820462 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:37.820472 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:37.822067 (+ 1595us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:37.823904 (+ 1837us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:37.823913 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:37.823916 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:37.824178 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:37.824420 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:37.824421 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:37.824422 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:37.824549 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:37.824844 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:37.824853 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:37.825022 (+ 169us) client_negotiation.cc:769] Sending connection context
0811 00:55:37.825142 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 00:55:37.825336 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":98,"threads_started":1}
I20260811 00:55:37.826354 25112 heartbeater.cc:347] Connected to a master server at 127.15.70.62:32823
I20260811 00:55:37.826480 25112 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:37.826702 25112 heartbeater.cc:511] Master 127.15.70.62:32823 requested a full tablet report, sending...
I20260811 00:55:37.827380 24789 ts_manager.cc:194] Registered new tserver with Master: ddf6393e7e164641bf80cbf05e6517e6 (127.15.70.1:45947)
I20260811 00:55:37.828064 24789 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.1@KRBTEST.COM'} at 127.15.70.1:35335
WARNING: no policy specified for kudu/127.15.70.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab.
Entry for principal kudu/127.15.70.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab.
I20260811 00:55:37.856271 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.2:0
--local_ip_for_outbound_sockets=127.15.70.2
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:32823
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:35005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:37.953961 25120 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:37.954227 25120 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:37.954252 25120 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:37.955492 25120 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:37.955541 25120 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:37.955569 25120 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.2
I20260811 00:55:37.957836 25120 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:35005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:32823
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25120
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.2
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:37.958068 25120 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:37.958289 25120 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:37.964331 25127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:37.964331 25132 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:37.964335 25128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:37.964589 25120 server_base.cc:1034] running on GCE node
I20260811 00:55:37.964844 25120 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:37.965143 25120 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:37.966300 25120 hybrid_clock.cc:648] HybridClock initialized: now 1786409737966283 us; error 30 us; skew 500 ppm
Aug 11 00:55:37 dist-test-slave-h3ft krb5kdc[24700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409737, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:37.969503 25120 init.cc:377] Logged in from keytab as kudu/127.15.70.2@KRBTEST.COM (short username kudu)
I20260811 00:55:37.970041 25120 webserver.cc:460] Webserver started at http://127.15.70.2:44529/ using document root <none> and password file <none>
I20260811 00:55:37.970304 25120 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:37.970376 25120 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:37.970546 25120 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:37.971880 25120 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-1/data/instance:
uuid: "69269b2da80c4831a2afd76ae4c238b4"
format_stamp: "Formatted at 2026-08-11 00:55:37 on dist-test-slave-h3ft"
server_key: "8ddf58b1a6dbb76f5f0d0b3091f3ca1e"
server_key_iv: "940dda081ccdf511b2ab6385385904ab"
server_key_version: "encryptionkey@0"
I20260811 00:55:37.972307 25120 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance:
uuid: "69269b2da80c4831a2afd76ae4c238b4"
format_stamp: "Formatted at 2026-08-11 00:55:37 on dist-test-slave-h3ft"
server_key: "8ddf58b1a6dbb76f5f0d0b3091f3ca1e"
server_key_iv: "940dda081ccdf511b2ab6385385904ab"
server_key_version: "encryptionkey@0"
I20260811 00:55:37.973886 25120 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:55:37.974799 25143 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:37.975093 25120 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:37.975205 25120 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-1/wal
uuid: "69269b2da80c4831a2afd76ae4c238b4"
format_stamp: "Formatted at 2026-08-11 00:55:37 on dist-test-slave-h3ft"
server_key: "8ddf58b1a6dbb76f5f0d0b3091f3ca1e"
server_key_iv: "940dda081ccdf511b2ab6385385904ab"
server_key_version: "encryptionkey@0"
I20260811 00:55:37.975268 25120 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:37.995880 25120 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:37.998755 25120 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:37.998924 25120 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:37.999212 25120 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:55:37.999655 25120 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:55:37.999696 25120 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:37.999724 25120 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:55:37.999773 25120 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:38.007136 25120 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.2:41129
I20260811 00:55:38.007208 25346 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.2:41129 every 8 connection(s)
I20260811 00:55:38.007673 25120 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
I20260811 00:55:38.014710 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 25120
I20260811 00:55:38.014878 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance
I20260811 00:55:38.015216 15640 external_mini_cluster.cc:1428] Setting key a7f5729b8cf19d457527211abbd9e034
Aug 11 00:55:38 dist-test-slave-h3ft krb5kdc[24700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409737, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:38.020509 24858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:38.008722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:53203 (local address 127.15.70.62:32823)
0811 00:55:38.008851 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:38.008854 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:38.009136 (+ 282us) server_negotiation.cc:407] Connection header received
0811 00:55:38.010366 (+ 1230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:38.010369 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:38.010388 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:38.010459 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:38.011405 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:38.012008 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:38.013220 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:38.013468 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:38.013594 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:38.016758 (+ 3164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:38.016760 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:38.016760 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:38.016771 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:38.018609 (+ 1838us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:38.019245 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:38.019246 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:38.019247 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:38.019329 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:38.019661 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:38.019663 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:38.019663 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:38.019826 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:38.019922 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:38.020278 (+ 356us) server_negotiation.cc:299] Negotiation successful
0811 00:55:38.020390 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 00:55:38.020773 25355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:38.008616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:32823 (local address 127.15.70.2:53203)
0811 00:55:38.008970 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:38.009020 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:38.010183 (+ 1163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:38.010561 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:38.010568 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:38.010936 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:38.011277 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:38.011282 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:38.012140 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:38.012141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:38.013096 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:38.013099 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:38.013606 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:38.013608 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:38.013767 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:38.014531 (+ 764us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:38.014542 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:38.016631 (+ 2089us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:38.018737 (+ 2106us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:38.018748 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:38.018752 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:38.019143 (+ 391us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:38.019410 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:38.019411 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:38.019411 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:38.019562 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:38.019922 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:38.019932 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:38.020116 (+ 184us) client_negotiation.cc:769] Sending connection context
0811 00:55:38.020240 (+ 124us) client_negotiation.cc:240] Negotiation successful
0811 00:55:38.020467 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":129,"threads_started":1}
I20260811 00:55:38.021370 25349 heartbeater.cc:347] Connected to a master server at 127.15.70.62:32823
I20260811 00:55:38.021497 25349 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:38.021756 25349 heartbeater.cc:511] Master 127.15.70.62:32823 requested a full tablet report, sending...
I20260811 00:55:38.022310 24789 ts_manager.cc:194] Registered new tserver with Master: 69269b2da80c4831a2afd76ae4c238b4 (127.15.70.2:41129)
I20260811 00:55:38.022768 24789 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.2@KRBTEST.COM'} at 127.15.70.2:53203
WARNING: no policy specified for kudu/127.15.70.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab.
Entry for principal kudu/127.15.70.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab.
I20260811 00:55:38.046977 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.3:0
--local_ip_for_outbound_sockets=127.15.70.3
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:32823
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:35005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:38.146677 25360 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:38.146977 25360 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:38.147032 25360 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:38.148352 25360 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:38.148403 25360 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:38.148437 25360 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.3
I20260811 00:55:38.150702 25360 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:35005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:32823
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25360
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.3
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:38.150959 25360 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:38.151261 25360 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:38.157275 25365 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:38.157282 25368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:38.157495 25360 server_base.cc:1034] running on GCE node
W20260811 00:55:38.157503 25366 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:38.157840 25360 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:38.158149 25360 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:38.159319 25360 hybrid_clock.cc:648] HybridClock initialized: now 1786409738159299 us; error 34 us; skew 500 ppm
Aug 11 00:55:38 dist-test-slave-h3ft krb5kdc[24700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409738, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:38.162416 25360 init.cc:377] Logged in from keytab as kudu/127.15.70.3@KRBTEST.COM (short username kudu)
I20260811 00:55:38.163041 25360 webserver.cc:460] Webserver started at http://127.15.70.3:44431/ using document root <none> and password file <none>
I20260811 00:55:38.163317 25360 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:38.163391 25360 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:38.163564 25360 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:38.164963 25360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-2/data/instance:
uuid: "b2f7097523ec45c59467ae44c67845b1"
format_stamp: "Formatted at 2026-08-11 00:55:38 on dist-test-slave-h3ft"
server_key: "df5eeec215a8ad9e46e8e5438e04c468"
server_key_iv: "fce480de8dba88f5c81fba90d7ebd0e1"
server_key_version: "encryptionkey@0"
I20260811 00:55:38.165397 25360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance:
uuid: "b2f7097523ec45c59467ae44c67845b1"
format_stamp: "Formatted at 2026-08-11 00:55:38 on dist-test-slave-h3ft"
server_key: "df5eeec215a8ad9e46e8e5438e04c468"
server_key_iv: "fce480de8dba88f5c81fba90d7ebd0e1"
server_key_version: "encryptionkey@0"
I20260811 00:55:38.167167 25360 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260811 00:55:38.168035 25381 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:38.168239 25360 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:38.168359 25360 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-2/wal
uuid: "b2f7097523ec45c59467ae44c67845b1"
format_stamp: "Formatted at 2026-08-11 00:55:38 on dist-test-slave-h3ft"
server_key: "df5eeec215a8ad9e46e8e5438e04c468"
server_key_iv: "fce480de8dba88f5c81fba90d7ebd0e1"
server_key_version: "encryptionkey@0"
I20260811 00:55:38.168445 25360 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:38.187248 25360 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:38.190275 25360 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:38.190541 25360 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:38.190886 25360 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:55:38.191365 25360 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:55:38.191429 25360 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:38.191484 25360 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:55:38.191522 25360 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:38.199138 25360 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.3:39065
I20260811 00:55:38.199182 25585 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.3:39065 every 8 connection(s)
I20260811 00:55:38.199615 25360 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
I20260811 00:55:38.204942 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 25360
I20260811 00:55:38.205097 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance
I20260811 00:55:38.205333 15640 external_mini_cluster.cc:1428] Setting key f574c4e83f8287b46cc2cf69a42eee42
Aug 11 00:55:38 dist-test-slave-h3ft krb5kdc[24700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409738, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:38.211236 24858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:38.200633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:40313 (local address 127.15.70.62:32823)
0811 00:55:38.200725 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:38.200727 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:38.200921 (+ 194us) server_negotiation.cc:407] Connection header received
0811 00:55:38.202017 (+ 1096us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:38.202019 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:38.202033 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:38.202110 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:38.202915 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:38.203591 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:38.204707 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:38.205081 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:38.205165 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:38.208110 (+ 2945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:38.208112 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:38.208112 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:38.208121 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:38.209740 (+ 1619us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:38.210184 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:38.210185 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:38.210186 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:38.210244 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:38.210474 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:38.210475 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:38.210475 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:38.210617 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:38.210673 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:38.211059 (+ 386us) server_negotiation.cc:299] Negotiation successful
0811 00:55:38.211154 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 00:55:38.211404 25590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:38.200578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:32823 (local address 127.15.70.3:40313)
0811 00:55:38.200766 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:38.200816 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:38.201881 (+ 1065us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:38.202197 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:38.202201 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:38.202555 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:38.202799 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:38.202803 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:38.203680 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:38.203681 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:38.204582 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:38.204585 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:38.205217 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:38.205218 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:38.205361 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:38.206164 (+ 803us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:38.206176 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:38.208011 (+ 1835us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:38.209822 (+ 1811us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:38.209829 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:38.209831 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:38.210115 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:38.210305 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:38.210306 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:38.210306 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:38.210416 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:38.210674 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:38.210679 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:38.210819 (+ 140us) client_negotiation.cc:769] Sending connection context
0811 00:55:38.210910 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 00:55:38.211141 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":108,"threads_started":1}
I20260811 00:55:38.212002 25587 heartbeater.cc:347] Connected to a master server at 127.15.70.62:32823
I20260811 00:55:38.212141 25587 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:38.212376 25587 heartbeater.cc:511] Master 127.15.70.62:32823 requested a full tablet report, sending...
I20260811 00:55:38.212877 24789 ts_manager.cc:194] Registered new tserver with Master: b2f7097523ec45c59467ae44c67845b1 (127.15.70.3:39065)
I20260811 00:55:38.213304 24789 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.3@KRBTEST.COM'} at 127.15.70.3:40313
I20260811 00:55:38.217427 15640 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/krb5kdc/test-admin.keytab.
Aug 11 00:55:38 dist-test-slave-h3ft krb5kdc[24700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409738, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:38.237581 15640 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260811 00:55:38.239845 15640 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/krb5kdc/krb5cc' of type FILE
W20260811 00:55:38.239889 25600 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:55:38.238755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41276 (local address 127.15.70.1:45947)
0811 00:55:38.239090 (+ 335us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:38.239096 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:38.239110 (+ 14us) server_negotiation.cc:407] Connection header received
0811 00:55:38.239145 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:38.239147 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:38.239164 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:38.239255 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:38.239704 (+ 449us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41276: BlockingRecv error: recv got EOF from 127.0.0.1:41276 (error 108)
Metrics: {"server-negotiator.queue_time_us":228,"thread_start_us":127,"threads_started":1}
Aug 11 00:55:38 dist-test-slave-h3ft krb5kdc[24700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409738, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:38.241004 15640 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 00:55:38 dist-test-slave-h3ft krb5kdc[24700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409738, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:38.242051 15640 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 00:55:38 dist-test-slave-h3ft krb5kdc[24700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409738, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.70.1@KRBTEST.COM
I20260811 00:55:38.251437 25600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:38.242681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41292 (local address 127.15.70.1:45947)
0811 00:55:38.242748 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:38.242750 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:38.242783 (+ 33us) server_negotiation.cc:407] Connection header received
0811 00:55:38.242843 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:38.242844 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:38.242863 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:38.242918 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:38.243441 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:38.244334 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:38.245114 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:38.245544 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:38.245619 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:38.248217 (+ 2598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:38.248227 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:38.248227 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:38.248236 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:38.249950 (+ 1714us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:38.250402 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:38.250406 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:38.250406 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:38.250481 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:38.250711 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:38.250712 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:38.250712 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:38.250886 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:38.251183 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:38.251239 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 00:55:38.251337 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
W20260811 00:55:38.253607 25600 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:55:38.252899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41308 (local address 127.15.70.1:45947)
0811 00:55:38.252970 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:38.252971 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:38.252982 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:55:38.253043 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:38.253044 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:38.253055 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:38.253094 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:38.253530 (+ 436us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41308: BlockingRecv error: recv got EOF from 127.0.0.1:41308 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260811 00:55:38.253625 15640 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/krb5kdc/krb5cc' of type FILE
Aug 11 00:55:38 dist-test-slave-h3ft krb5kdc[24700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409738, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:38.254753 15640 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 00:55:38 dist-test-slave-h3ft krb5kdc[24700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409738, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:38.255688 15640 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 00:55:38 dist-test-slave-h3ft krb5kdc[24700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409738, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.70.1@KRBTEST.COM
I20260811 00:55:38.263381 25600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:38.256204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41324 (local address 127.15.70.1:45947)
0811 00:55:38.256267 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:38.256268 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:38.256354 (+ 86us) server_negotiation.cc:407] Connection header received
0811 00:55:38.256392 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:38.256393 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:38.256401 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:38.256446 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:38.256839 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:38.257371 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:38.258076 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:38.258280 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:38.258367 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:38.260784 (+ 2417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:38.260785 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:38.260786 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:38.260794 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:38.262102 (+ 1308us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:38.262479 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:38.262481 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:38.262481 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:38.262551 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:38.262768 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:38.262769 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:38.262769 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:38.262883 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:38.262998 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:38.263168 (+ 170us) server_negotiation.cc:299] Negotiation successful
0811 00:55:38.263264 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
W20260811 00:55:38.265290 25600 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:55:38.264739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41332 (local address 127.15.70.1:45947)
0811 00:55:38.264806 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:38.264808 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:38.264818 (+ 10us) server_negotiation.cc:407] Connection header received
0811 00:55:38.264872 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:38.264873 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:38.264884 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:38.264932 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:38.265219 (+ 287us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41332: BlockingRecv error: recv got EOF from 127.0.0.1:41332 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260811 00:55:38.265452 15640 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409704606556-15640-0/krb5kdc/krb5cc' of type FILE
Aug 11 00:55:38 dist-test-slave-h3ft krb5kdc[24700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409738, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:38.266638 15640 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 00:55:38 dist-test-slave-h3ft krb5kdc[24700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409738, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:38.267812 15640 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 00:55:38 dist-test-slave-h3ft krb5kdc[24700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409738, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.70.1@KRBTEST.COM
I20260811 00:55:38.275492 25600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:38.268479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41340 (local address 127.15.70.1:45947)
0811 00:55:38.268530 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:38.268531 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:38.268606 (+ 75us) server_negotiation.cc:407] Connection header received
0811 00:55:38.268645 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:38.268646 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:38.268654 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:38.268700 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:38.269058 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:38.269553 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:38.270237 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:38.270442 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:38.270505 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:38.272896 (+ 2391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:38.272898 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:38.272898 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:38.272904 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:38.274235 (+ 1331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:38.274586 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:38.274587 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:38.274587 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:38.274641 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:38.274859 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:38.274859 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:38.274860 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:38.274973 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:38.275156 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:38.275275 (+ 119us) server_negotiation.cc:299] Negotiation successful
0811 00:55:38.275341 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 00:55:38.276402 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 24897
I20260811 00:55:38.292119 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 25120
I20260811 00:55:38.313768 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 25360
I20260811 00:55:38.338478 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 24725
2026-08-11T00:55:38Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2419 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:55:38 dist-test-slave-h3ft krb5kdc[25620](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:55:38 dist-test-slave-h3ft krb5kdc[25620](info): set up 2 sockets
Aug 11 00:55:38 dist-test-slave-h3ft krb5kdc[25620](info): commencing operation
krb5kdc: starting...
W20260811 00:55:39.695946 15640 mini_kdc.cc:121] Time spent starting KDC: real 1.321s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Aug 11 00:55:39 dist-test-slave-h3ft krb5kdc[25620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409739, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:55:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:55:39Z Disabled control of system clock
WARNING: no policy specified for oryx/127.15.70.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.70.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.70.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.62.keytab.
Entry for principal oryx/127.15.70.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.62.keytab.
I20260811 00:55:39.847354 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:41971
--webserver_interface=127.15.70.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.62.keytab
--principal=oryx/127.15.70.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:44081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:41971
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:39.944545 25643 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:39.944805 25643 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:39.944830 25643 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:39.946062 25643 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:55:39.946110 25643 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:39.946125 25643 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:39.946137 25643 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:55:39.946151 25643 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:55:39.947876 25643 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:44081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:41971
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.62.keytab
--principal=oryx/127.15.70.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:41971
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25643
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:39.948189 25643 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:39.948499 25643 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:39.954449 25650 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:39.954413 25654 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:39.954478 25651 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:39.954766 25643 server_base.cc:1034] running on GCE node
I20260811 00:55:39.955160 25643 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:39.955571 25643 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:39.956739 25643 hybrid_clock.cc:648] HybridClock initialized: now 1786409739956716 us; error 42 us; skew 500 ppm
Aug 11 00:55:39 dist-test-slave-h3ft krb5kdc[25620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409739, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.70.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:39.963938 25643 init.cc:377] Logged in from keytab as oryx/127.15.70.62@KRBTEST.COM (short username oryx)
I20260811 00:55:39.964604 25643 webserver.cc:460] Webserver started at http://127.15.70.62:43449/ using document root <none> and password file <none>
I20260811 00:55:39.964915 25643 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:39.964991 25643 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:39.965162 25643 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:39.966424 25643 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "a918e7b423bf4b60b146f5b794596334"
format_stamp: "Formatted at 2026-08-11 00:55:39 on dist-test-slave-h3ft"
server_key: "cdefad9d6dd771cfb81fefc2dcfa4487"
server_key_iv: "76792d7ed28ace5c01624b62021b5d1f"
server_key_version: "encryptionkey@0"
I20260811 00:55:39.966857 25643 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "a918e7b423bf4b60b146f5b794596334"
format_stamp: "Formatted at 2026-08-11 00:55:39 on dist-test-slave-h3ft"
server_key: "cdefad9d6dd771cfb81fefc2dcfa4487"
server_key_iv: "76792d7ed28ace5c01624b62021b5d1f"
server_key_version: "encryptionkey@0"
I20260811 00:55:39.968461 25643 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:39.969465 25673 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:39.969755 25643 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:39.969890 25643 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "a918e7b423bf4b60b146f5b794596334"
format_stamp: "Formatted at 2026-08-11 00:55:39 on dist-test-slave-h3ft"
server_key: "cdefad9d6dd771cfb81fefc2dcfa4487"
server_key_iv: "76792d7ed28ace5c01624b62021b5d1f"
server_key_version: "encryptionkey@0"
I20260811 00:55:39.970001 25643 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:39.989878 25643 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:39.992607 25643 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:39.992822 25643 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:39.998209 25643 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:41971
I20260811 00:55:39.998255 25754 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:41971 every 8 connection(s)
I20260811 00:55:39.998742 25643 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:55:40.000016 25756 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:40.003114 25756 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334: Bootstrap starting.
I20260811 00:55:40.004243 25756 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:40.004650 25756 log.cc:824] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334: Log is configured to *not* fsync() on all Append() calls
I20260811 00:55:40.005277 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 25643
I20260811 00:55:40.005452 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 00:55:40.005709 15640 external_mini_cluster.cc:1428] Setting key e7c587b747fd5be59235c5e8f6d06ead
I20260811 00:55:40.005904 25756 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334: No bootstrap required, opened a new log
I20260811 00:55:40.008416 25756 raft_consensus.cc:348] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } }
I20260811 00:55:40.008656 25756 raft_consensus.cc:374] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:40.008692 25756 raft_consensus.cc:729] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a918e7b423bf4b60b146f5b794596334, State: Initialized, Role: FOLLOWER
I20260811 00:55:40.008865 25756 consensus_queue.cc:260] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } }
I20260811 00:55:40.008965 25756 raft_consensus.cc:388] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:55:40.009001 25756 raft_consensus.cc:482] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:55:40.009059 25756 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:40.010731 25756 raft_consensus.cc:504] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } }
I20260811 00:55:40.010874 25756 leader_election.cc:302] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a918e7b423bf4b60b146f5b794596334; no voters:
I20260811 00:55:40.011304 25756 leader_election.cc:288] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:55:40.011363 25769 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:55:40.011610 25769 raft_consensus.cc:686] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [term 1 LEADER]: Becoming Leader. State: Replica: a918e7b423bf4b60b146f5b794596334, State: Running, Role: LEADER
I20260811 00:55:40.011726 25756 sys_catalog.cc:564] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:55:40.011737 25769 consensus_queue.cc:237] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } }
I20260811 00:55:40.012198 25769 sys_catalog.cc:455] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a918e7b423bf4b60b146f5b794596334. Latest consensus state: current_term: 1 leader_uuid: "a918e7b423bf4b60b146f5b794596334" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } }
I20260811 00:55:40.012279 25769 sys_catalog.cc:458] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [sys.catalog]: This master's current role is: LEADER
I20260811 00:55:40.012832 25777 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:55:40.012795 25770 sys_catalog.cc:455] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a918e7b423bf4b60b146f5b794596334" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } }
I20260811 00:55:40.012893 25770 sys_catalog.cc:458] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [sys.catalog]: This master's current role is: LEADER
I20260811 00:55:40.013530 25777 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 00:55:40 dist-test-slave-h3ft krb5kdc[25620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409739, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM
I20260811 00:55:40.018105 25777 catalog_manager.cc:1347] Generated new cluster ID: 8ae5bbf38e204796b1345a1c74c09ce3
I20260811 00:55:40.018186 25777 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:55:40.023149 25766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:40.006566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60808 (local address 127.15.70.62:41971)
0811 00:55:40.006873 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:40.006885 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:40.006946 (+ 61us) server_negotiation.cc:407] Connection header received
0811 00:55:40.008439 (+ 1493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:40.008452 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:40.008539 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:40.008879 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:40.010044 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:40.011387 (+ 1343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:40.012742 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:40.013650 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:40.013791 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:40.017872 (+ 4081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:40.017877 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:40.017878 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:40.017896 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:40.020560 (+ 2664us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:40.021191 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:40.021195 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:40.021196 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:40.021365 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:40.021671 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:40.021672 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:40.021672 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:40.022099 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:40.022301 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:40.022479 (+ 178us) server_negotiation.cc:299] Negotiation successful
0811 00:55:40.022663 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241,"thread_start_us":174,"threads_started":1}
I20260811 00:55:40.036140 25777 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:55:40.036857 25777 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:55:40.041311 25777 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334: Generated new TSK 0
I20260811 00:55:40.041538 25777 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.15.70.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.70.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.70.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.1.keytab.
Entry for principal oryx/127.15.70.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.1.keytab.
I20260811 00:55:40.084374 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.1:0
--local_ip_for_outbound_sockets=127.15.70.1
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:41971
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.1.keytab
--principal=oryx/127.15.70.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:44081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:40.183058 25802 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:40.183314 25802 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:40.183343 25802 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:40.184653 25802 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:40.184700 25802 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:40.184731 25802 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.1
I20260811 00:55:40.186471 25802 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:44081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.1.keytab
--principal=oryx/127.15.70.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:41971
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25802
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.1
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:40.186796 25802 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:40.187167 25802 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:40.193482 25815 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:40.193492 25810 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:40.193672 25802 server_base.cc:1034] running on GCE node
W20260811 00:55:40.193756 25812 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:40.194015 25802 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:40.194299 25802 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:40.195465 25802 hybrid_clock.cc:648] HybridClock initialized: now 1786409740195446 us; error 32 us; skew 500 ppm
Aug 11 00:55:40 dist-test-slave-h3ft krb5kdc[25620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409740, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.70.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:40.198859 25802 init.cc:377] Logged in from keytab as oryx/127.15.70.1@KRBTEST.COM (short username oryx)
I20260811 00:55:40.199486 25802 webserver.cc:460] Webserver started at http://127.15.70.1:41693/ using document root <none> and password file <none>
I20260811 00:55:40.199819 25802 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:40.199909 25802 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:40.200098 25802 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:40.201509 25802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-0/data/instance:
uuid: "039628cf163f4400834624b4468d7d16"
format_stamp: "Formatted at 2026-08-11 00:55:40 on dist-test-slave-h3ft"
server_key: "4d6202055b49584ab8c8e2bf10d5b467"
server_key_iv: "9a42470c0df9e760f7d6a6c80138f293"
server_key_version: "encryptionkey@0"
I20260811 00:55:40.201983 25802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance:
uuid: "039628cf163f4400834624b4468d7d16"
format_stamp: "Formatted at 2026-08-11 00:55:40 on dist-test-slave-h3ft"
server_key: "4d6202055b49584ab8c8e2bf10d5b467"
server_key_iv: "9a42470c0df9e760f7d6a6c80138f293"
server_key_version: "encryptionkey@0"
I20260811 00:55:40.203842 25802 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.002s
I20260811 00:55:40.204910 25822 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:40.205195 25802 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:40.205335 25802 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-0/wal
uuid: "039628cf163f4400834624b4468d7d16"
format_stamp: "Formatted at 2026-08-11 00:55:40 on dist-test-slave-h3ft"
server_key: "4d6202055b49584ab8c8e2bf10d5b467"
server_key_iv: "9a42470c0df9e760f7d6a6c80138f293"
server_key_version: "encryptionkey@0"
I20260811 00:55:40.205443 25802 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:40.218156 25802 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:40.221254 25802 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:40.221489 25802 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:40.221817 25802 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:55:40.222275 25802 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:55:40.222337 25802 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:40.222386 25802 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:55:40.222415 25802 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:40.229802 25802 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.1:39029
I20260811 00:55:40.229875 26006 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.1:39029 every 8 connection(s)
I20260811 00:55:40.230291 25802 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
I20260811 00:55:40.232362 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 25802
I20260811 00:55:40.232487 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance
I20260811 00:55:40.232743 15640 external_mini_cluster.cc:1428] Setting key 6748282f7163726092e2c8953aff9e4d
Aug 11 00:55:40 dist-test-slave-h3ft krb5kdc[25620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409740, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.70.1@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM
I20260811 00:55:40.242213 25766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:40.231348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:59311 (local address 127.15.70.62:41971)
0811 00:55:40.231431 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:40.231433 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:40.231649 (+ 216us) server_negotiation.cc:407] Connection header received
0811 00:55:40.232259 (+ 610us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:40.232261 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:40.232285 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:40.232374 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:40.233788 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:40.234636 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:40.235896 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:40.236153 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:40.236213 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:40.239049 (+ 2836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:40.239050 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:40.239051 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:40.239060 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:40.240599 (+ 1539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:40.241060 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:40.241062 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:40.241062 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:40.241132 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:40.241416 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:40.241417 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:40.241417 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:40.241550 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:40.241629 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:40.241993 (+ 364us) server_negotiation.cc:299] Negotiation successful
0811 00:55:40.242100 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 00:55:40.242362 26009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:40.231294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:41971 (local address 127.15.70.1:59311)
0811 00:55:40.231494 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:40.231545 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:40.232148 (+ 603us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:40.232496 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:40.232501 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:40.233372 (+ 871us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:40.233687 (+ 315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:40.233693 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:40.234746 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:40.234747 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:40.235784 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:40.235788 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:40.236242 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:40.236244 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:40.236409 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:40.237096 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:40.237110 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:40.238917 (+ 1807us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:40.240711 (+ 1794us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:40.240719 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:40.240722 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:40.240976 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:40.241206 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:40.241207 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:40.241207 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:40.241334 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:40.241629 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:40.241638 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:40.241797 (+ 159us) client_negotiation.cc:769] Sending connection context
0811 00:55:40.241910 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 00:55:40.242102 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":107,"threads_started":1}
I20260811 00:55:40.242934 26007 heartbeater.cc:347] Connected to a master server at 127.15.70.62:41971
I20260811 00:55:40.243103 26007 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:40.243368 26007 heartbeater.cc:511] Master 127.15.70.62:41971 requested a full tablet report, sending...
WARNING: no policy specified for oryx/127.15.70.2@KRBTEST.COM; defaulting to no policy
I20260811 00:55:40.244117 25698 ts_manager.cc:194] Registered new tserver with Master: 039628cf163f4400834624b4468d7d16 (127.15.70.1:39029)
I20260811 00:55:40.244800 25698 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.70.1@KRBTEST.COM'} at 127.15.70.1:59311
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.70.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.70.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.2.keytab.
Entry for principal oryx/127.15.70.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.2.keytab.
I20260811 00:55:40.267268 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.2:0
--local_ip_for_outbound_sockets=127.15.70.2
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:41971
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.2.keytab
--principal=oryx/127.15.70.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:44081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:40.364115 26014 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:40.364368 26014 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:40.364403 26014 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:40.365670 26014 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:40.365717 26014 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:40.365746 26014 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.2
I20260811 00:55:40.367398 26014 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:44081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.2.keytab
--principal=oryx/127.15.70.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:41971
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26014
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.2
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:40.367710 26014 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:40.368012 26014 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:40.374178 26030 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:40.374221 26025 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:40.374212 26026 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:40.374377 26014 server_base.cc:1034] running on GCE node
I20260811 00:55:40.374749 26014 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:40.374994 26014 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:40.376224 26014 hybrid_clock.cc:648] HybridClock initialized: now 1786409740376201 us; error 44 us; skew 500 ppm
Aug 11 00:55:40 dist-test-slave-h3ft krb5kdc[25620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409740, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.70.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:40.379426 26014 init.cc:377] Logged in from keytab as oryx/127.15.70.2@KRBTEST.COM (short username oryx)
I20260811 00:55:40.379972 26014 webserver.cc:460] Webserver started at http://127.15.70.2:36451/ using document root <none> and password file <none>
I20260811 00:55:40.380240 26014 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:40.380291 26014 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:40.380502 26014 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:40.381744 26014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-1/data/instance:
uuid: "1ad222c9e98f4424b1589ffa21ffd5b3"
format_stamp: "Formatted at 2026-08-11 00:55:40 on dist-test-slave-h3ft"
server_key: "60c85a93b1cf12b886b5f7ceb83d7ccb"
server_key_iv: "ba780fdae637a05fc352ea0318eaa229"
server_key_version: "encryptionkey@0"
I20260811 00:55:40.382165 26014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance:
uuid: "1ad222c9e98f4424b1589ffa21ffd5b3"
format_stamp: "Formatted at 2026-08-11 00:55:40 on dist-test-slave-h3ft"
server_key: "60c85a93b1cf12b886b5f7ceb83d7ccb"
server_key_iv: "ba780fdae637a05fc352ea0318eaa229"
server_key_version: "encryptionkey@0"
I20260811 00:55:40.383776 26014 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260811 00:55:40.384688 26038 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:40.384894 26014 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:40.385005 26014 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-1/wal
uuid: "1ad222c9e98f4424b1589ffa21ffd5b3"
format_stamp: "Formatted at 2026-08-11 00:55:40 on dist-test-slave-h3ft"
server_key: "60c85a93b1cf12b886b5f7ceb83d7ccb"
server_key_iv: "ba780fdae637a05fc352ea0318eaa229"
server_key_version: "encryptionkey@0"
I20260811 00:55:40.385087 26014 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:40.407528 26014 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:40.410676 26014 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:40.410878 26014 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:40.411257 26014 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:55:40.411708 26014 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:55:40.411767 26014 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:40.411818 26014 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:55:40.411845 26014 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:40.419358 26014 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.2:33213
I20260811 00:55:40.419420 26245 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.2:33213 every 8 connection(s)
I20260811 00:55:40.419845 26014 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
I20260811 00:55:40.425215 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 26014
I20260811 00:55:40.425379 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance
I20260811 00:55:40.425621 15640 external_mini_cluster.cc:1428] Setting key 4ae270b99be53892ac9fdde4921756e1
Aug 11 00:55:40 dist-test-slave-h3ft krb5kdc[25620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409740, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.70.2@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM
I20260811 00:55:40.432305 25766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:40.420826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:53003 (local address 127.15.70.62:41971)
0811 00:55:40.420909 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:40.420911 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:40.421185 (+ 274us) server_negotiation.cc:407] Connection header received
0811 00:55:40.421995 (+ 810us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:40.421997 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:40.422022 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:40.422111 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:40.423487 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:40.424125 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:40.425369 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:40.425701 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:40.425798 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:40.428971 (+ 3173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:40.428973 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:40.428974 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:40.428984 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:40.430610 (+ 1626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:40.431133 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:40.431135 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:40.431135 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:40.431203 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:40.431498 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:40.431499 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:40.431499 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:40.431646 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:40.431730 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:40.432056 (+ 326us) server_negotiation.cc:299] Negotiation successful
0811 00:55:40.432196 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 00:55:40.432600 26248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:40.420786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:41971 (local address 127.15.70.2:53003)
0811 00:55:40.421024 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:40.421074 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:40.421795 (+ 721us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:40.422217 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:40.422222 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:40.423070 (+ 848us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:40.423352 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:40.423358 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:40.424252 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:40.424254 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:40.425251 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:40.425253 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:40.425824 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:40.425825 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:40.426024 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:40.426776 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:40.426787 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:40.428852 (+ 2065us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:40.430726 (+ 1874us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:40.430735 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:40.430738 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:40.431055 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:40.431286 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:40.431287 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:40.431287 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:40.431418 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:40.431717 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:40.431726 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:40.431904 (+ 178us) client_negotiation.cc:769] Sending connection context
0811 00:55:40.432022 (+ 118us) client_negotiation.cc:240] Negotiation successful
0811 00:55:40.432246 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":117,"threads_started":1}
I20260811 00:55:40.433395 26246 heartbeater.cc:347] Connected to a master server at 127.15.70.62:41971
I20260811 00:55:40.433549 26246 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:40.433789 26246 heartbeater.cc:511] Master 127.15.70.62:41971 requested a full tablet report, sending...
I20260811 00:55:40.434366 25698 ts_manager.cc:194] Registered new tserver with Master: 1ad222c9e98f4424b1589ffa21ffd5b3 (127.15.70.2:33213)
I20260811 00:55:40.435070 25698 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.70.2@KRBTEST.COM'} at 127.15.70.2:53003
WARNING: no policy specified for oryx/127.15.70.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.70.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.70.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.3.keytab.
Entry for principal oryx/127.15.70.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.3.keytab.
I20260811 00:55:40.462440 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.3:0
--local_ip_for_outbound_sockets=127.15.70.3
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:41971
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.3.keytab
--principal=oryx/127.15.70.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:44081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:40.561239 26254 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:40.561479 26254 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:40.561503 26254 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:40.562690 26254 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:40.562741 26254 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:40.562770 26254 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.3
I20260811 00:55:40.564450 26254 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:44081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.3.keytab
--principal=oryx/127.15.70.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:41971
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26254
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.3
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:40.564770 26254 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:40.565079 26254 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:40.571285 26271 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:40.571583 26254 server_base.cc:1034] running on GCE node
W20260811 00:55:40.571257 26273 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:40.571264 26268 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:40.571883 26254 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:40.572208 26254 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:40.573390 26254 hybrid_clock.cc:648] HybridClock initialized: now 1786409740573348 us; error 66 us; skew 500 ppm
Aug 11 00:55:40 dist-test-slave-h3ft krb5kdc[25620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409740, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.70.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:40.576574 26254 init.cc:377] Logged in from keytab as oryx/127.15.70.3@KRBTEST.COM (short username oryx)
I20260811 00:55:40.577154 26254 webserver.cc:460] Webserver started at http://127.15.70.3:33123/ using document root <none> and password file <none>
I20260811 00:55:40.577499 26254 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:40.577581 26254 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:40.577764 26254 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:40.579290 26254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-2/data/instance:
uuid: "afdd98b8317f4185accbe7820bdee827"
format_stamp: "Formatted at 2026-08-11 00:55:40 on dist-test-slave-h3ft"
server_key: "52fdadcae670c763e5448cefad8ecd50"
server_key_iv: "e1e9112ffd46c428685c31be7436bed9"
server_key_version: "encryptionkey@0"
I20260811 00:55:40.579717 26254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance:
uuid: "afdd98b8317f4185accbe7820bdee827"
format_stamp: "Formatted at 2026-08-11 00:55:40 on dist-test-slave-h3ft"
server_key: "52fdadcae670c763e5448cefad8ecd50"
server_key_iv: "e1e9112ffd46c428685c31be7436bed9"
server_key_version: "encryptionkey@0"
I20260811 00:55:40.581380 26254 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:55:40.582327 26287 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:40.582653 26254 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:40.582782 26254 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-2/wal
uuid: "afdd98b8317f4185accbe7820bdee827"
format_stamp: "Formatted at 2026-08-11 00:55:40 on dist-test-slave-h3ft"
server_key: "52fdadcae670c763e5448cefad8ecd50"
server_key_iv: "e1e9112ffd46c428685c31be7436bed9"
server_key_version: "encryptionkey@0"
I20260811 00:55:40.582873 26254 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:40.591892 26254 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:40.594522 26254 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:40.594723 26254 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:40.595080 26254 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:55:40.598579 26254 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:55:40.598649 26254 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:40.598693 26254 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:55:40.598716 26254 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:40.606596 26254 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.3:36097
I20260811 00:55:40.606637 26471 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.3:36097 every 8 connection(s)
I20260811 00:55:40.607128 26254 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
I20260811 00:55:40.610004 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 26254
I20260811 00:55:40.610126 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance
I20260811 00:55:40.610364 15640 external_mini_cluster.cc:1428] Setting key 78d787e0cc5aed49cf6ea6c587a4e77a
Aug 11 00:55:40 dist-test-slave-h3ft krb5kdc[25620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409740, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.70.3@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM
I20260811 00:55:40.618716 25766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:40.608089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:37737 (local address 127.15.70.62:41971)
0811 00:55:40.608171 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:40.608173 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:40.608438 (+ 265us) server_negotiation.cc:407] Connection header received
0811 00:55:40.609039 (+ 601us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:40.609041 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:40.609054 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:40.609122 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:40.610599 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:40.611378 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:40.612661 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:40.612904 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:40.612962 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:40.615712 (+ 2750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:40.615714 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:40.615714 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:40.615722 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:40.617189 (+ 1467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:40.617652 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:40.617653 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:40.617654 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:40.617720 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:40.618040 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:40.618041 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:40.618041 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:40.618168 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:40.618229 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:40.618545 (+ 316us) server_negotiation.cc:299] Negotiation successful
0811 00:55:40.618628 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 00:55:40.618973 26476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:40.608065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:41971 (local address 127.15.70.3:37737)
0811 00:55:40.608253 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:40.608328 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:40.608941 (+ 613us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:40.609189 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:40.609193 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:40.610099 (+ 906us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:40.610459 (+ 360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:40.610468 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:40.611480 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:40.611481 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:40.612564 (+ 1083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:40.612568 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:40.612987 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:40.612988 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:40.613114 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:40.613847 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:40.613857 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:40.615587 (+ 1730us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:40.617279 (+ 1692us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:40.617287 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:40.617289 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:40.617561 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:40.617819 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:40.617820 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:40.617820 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:40.617961 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:40.618235 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:40.618241 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:40.618406 (+ 165us) client_negotiation.cc:769] Sending connection context
0811 00:55:40.618512 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 00:55:40.618680 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":103,"threads_started":1}
I20260811 00:55:40.619709 26472 heartbeater.cc:347] Connected to a master server at 127.15.70.62:41971
I20260811 00:55:40.619836 26472 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:40.620034 26472 heartbeater.cc:511] Master 127.15.70.62:41971 requested a full tablet report, sending...
I20260811 00:55:40.620525 25698 ts_manager.cc:194] Registered new tserver with Master: afdd98b8317f4185accbe7820bdee827 (127.15.70.3:36097)
I20260811 00:55:40.620942 25698 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.70.3@KRBTEST.COM'} at 127.15.70.3:37737
I20260811 00:55:40.622505 15640 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.15.70.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.70.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.70.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.61.keytab.
Entry for principal oryx/127.15.70.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.61.keytab.
I20260811 00:55:40.658118 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.61:36339
--webserver_interface=127.15.70.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.61.keytab
--principal=oryx/127.15.70.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:44081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:41971,127.15.70.61:36339
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:40.758505 26484 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:40.758809 26484 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:40.758837 26484 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:40.760267 26484 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:55:40.760321 26484 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:40.760339 26484 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:40.760353 26484 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:55:40.760367 26484 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:55:40.762131 26484 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:44081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:41971,127.15.70.61:36339
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.61.keytab
--principal=oryx/127.15.70.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.61:36339
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.15.70.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26484
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
W20260811 00:55:40.762282 26484 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.15.70.62:41971,127.15.70.61:36339'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260811 00:55:40.762435 26484 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:40.762684 26484 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:40.768857 26495 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:40.768875 26491 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:40.768980 26484 server_base.cc:1034] running on GCE node
W20260811 00:55:40.768875 26492 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:40.769461 26484 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:40.769850 26484 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:40.771061 26484 hybrid_clock.cc:648] HybridClock initialized: now 1786409740771035 us; error 40 us; skew 500 ppm
Aug 11 00:55:40 dist-test-slave-h3ft krb5kdc[25620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409740, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.70.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:40.774314 26484 init.cc:377] Logged in from keytab as oryx/127.15.70.61@KRBTEST.COM (short username oryx)
I20260811 00:55:40.774930 26484 webserver.cc:460] Webserver started at http://127.15.70.61:40051/ using document root <none> and password file <none>
I20260811 00:55:40.775260 26484 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:40.775341 26484 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:40.775521 26484 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:40.776816 26484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-1/data/instance:
uuid: "7eb59440ba8341ac941c586dc9154d6f"
format_stamp: "Formatted at 2026-08-11 00:55:40 on dist-test-slave-h3ft"
server_key: "1213cc1e999d04233970dfd38bbcd35f"
server_key_iv: "c7f7491db853ab71ae818e85e8f05f64"
server_key_version: "encryptionkey@0"
I20260811 00:55:40.777287 26484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-1/wal/instance:
uuid: "7eb59440ba8341ac941c586dc9154d6f"
format_stamp: "Formatted at 2026-08-11 00:55:40 on dist-test-slave-h3ft"
server_key: "1213cc1e999d04233970dfd38bbcd35f"
server_key_iv: "c7f7491db853ab71ae818e85e8f05f64"
server_key_version: "encryptionkey@0"
I20260811 00:55:40.779177 26484 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260811 00:55:40.780169 26516 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:40.780448 26484 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:40.780570 26484 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-1/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-1/wal
uuid: "7eb59440ba8341ac941c586dc9154d6f"
format_stamp: "Formatted at 2026-08-11 00:55:40 on dist-test-slave-h3ft"
server_key: "1213cc1e999d04233970dfd38bbcd35f"
server_key_iv: "c7f7491db853ab71ae818e85e8f05f64"
server_key_version: "encryptionkey@0"
I20260811 00:55:40.780639 26484 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:40.795670 26484 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:40.798013 26484 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:40.798154 26484 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:40.803771 26484 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.61:36339
I20260811 00:55:40.803807 26611 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.61:36339 every 8 connection(s)
I20260811 00:55:40.804330 26484 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-1/data/info.pb
I20260811 00:55:40.805729 26613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:40.805835 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 26484
I20260811 00:55:40.808686 26613 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 00:55:40 dist-test-slave-h3ft krb5kdc[25620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409739, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.15.70.61@KRBTEST.COM
Aug 11 00:55:40 dist-test-slave-h3ft krb5kdc[25620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409740, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.70.61@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM
I20260811 00:55:40.819468 25766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:40.809628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60810 (local address 127.15.70.62:41971)
0811 00:55:40.809706 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:40.809708 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:40.809886 (+ 178us) server_negotiation.cc:407] Connection header received
0811 00:55:40.809982 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:40.809984 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:40.810005 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:40.810103 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:40.810665 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:40.811267 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:40.812184 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:40.812464 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:40.812541 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:40.815978 (+ 3437us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:40.815980 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:40.815981 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:40.815990 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:40.817672 (+ 1682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:40.818187 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:40.818188 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:40.818189 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:40.818264 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:40.818581 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:40.818582 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:40.818582 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:40.818826 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:40.818917 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:40.819244 (+ 327us) server_negotiation.cc:299] Negotiation successful
0811 00:55:40.819352 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 00:55:40.819866 26619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:40.806920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45176 (local address 127.15.70.61:36339)
0811 00:55:40.807226 (+ 306us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:40.807245 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:40.807279 (+ 34us) server_negotiation.cc:407] Connection header received
0811 00:55:40.807813 (+ 534us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:40.807821 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:40.807887 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:40.808111 (+ 224us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:40.808969 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:40.810253 (+ 1284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:40.811247 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:40.811806 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:40.811955 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:40.815334 (+ 3379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:40.815342 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:40.815343 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:40.815350 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:40.817551 (+ 2201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:40.818038 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:40.818041 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:40.818041 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:40.818157 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:40.818528 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:40.818528 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:40.818529 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:40.818859 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:40.819105 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:40.819260 (+ 155us) server_negotiation.cc:299] Negotiation successful
0811 00:55:40.819389 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":235,"thread_start_us":164,"threads_started":1}
I20260811 00:55:40.819887 26620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:40.809510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:41971 (local address 127.0.0.1:60810)
0811 00:55:40.809754 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:40.809801 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:40.809907 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:40.810130 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:40.810134 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:40.810465 (+ 331us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:40.810560 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:40.810561 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:40.811379 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:40.811380 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:40.812077 (+ 697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:40.812079 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:40.812660 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:40.812662 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:40.812778 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:40.813328 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:40.813341 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:40.815871 (+ 2530us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:40.817765 (+ 1894us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:40.817774 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:40.817776 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:40.818107 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:40.818372 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:40.818373 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:40.818373 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:40.818503 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:40.818971 (+ 468us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:40.818980 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:40.819096 (+ 116us) client_negotiation.cc:769] Sending connection context
0811 00:55:40.819207 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 00:55:40.819523 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":210,"mutex_wait_us":110,"thread_start_us":144,"threads_started":1}
I20260811 00:55:40.821765 26613 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.70.61" port: 36339 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 00:55:40 dist-test-slave-h3ft krb5kdc[25620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409740, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.70.61@KRBTEST.COM for oryx/127.15.70.61@KRBTEST.COM
I20260811 00:55:40.829171 26620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:40.822156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.61:36339 (local address 127.0.0.1:45190)
0811 00:55:40.822199 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:40.822212 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:40.822287 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:40.822446 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:40.822447 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:40.822632 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:40.822704 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:40.822707 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:40.823803 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:40.823805 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:40.824310 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:40.824312 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:40.824719 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:40.824720 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:40.824791 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:40.825217 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:40.825222 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:40.826540 (+ 1318us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:40.828108 (+ 1568us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:40.828109 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:40.828110 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:40.828280 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:40.828510 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:40.828511 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:40.828512 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:40.828575 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:40.828827 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:40.828828 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:40.828868 (+ 40us) client_negotiation.cc:769] Sending connection context
0811 00:55:40.828935 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 00:55:40.829040 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19}
I20260811 00:55:40.829171 26619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:40.822208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45190 (local address 127.15.70.61:36339)
0811 00:55:40.822241 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:40.822243 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:40.822269 (+ 26us) server_negotiation.cc:407] Connection header received
0811 00:55:40.822345 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:40.822346 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:40.822356 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:40.822406 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:40.822814 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:40.823705 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:40.824414 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:40.824631 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:40.824722 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:40.826633 (+ 1911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:40.826634 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:40.826635 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:40.826643 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:40.828003 (+ 1360us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:40.828365 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:40.828367 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:40.828367 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:40.828426 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:40.828639 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:40.828640 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:40.828641 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:40.828759 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:40.828838 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:40.829020 (+ 182us) server_negotiation.cc:299] Negotiation successful
0811 00:55:40.829085 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 00:55:40.830974 26613 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f: Bootstrap starting.
I20260811 00:55:40.832110 26613 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:40.832454 26613 log.cc:824] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f: Log is configured to *not* fsync() on all Append() calls
I20260811 00:55:40.833359 26613 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f: No bootstrap required, opened a new log
I20260811 00:55:40.835187 26613 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 36339 } }
I20260811 00:55:40.835338 26613 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:40.835363 26613 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb59440ba8341ac941c586dc9154d6f, State: Initialized, Role: FOLLOWER
I20260811 00:55:40.835539 26613 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 36339 } }
I20260811 00:55:40.835951 26613 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:55:40.835913 26625 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 36339 } } }
I20260811 00:55:40.836076 26625 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [sys.catalog]: This master's current role is: FOLLOWER
W20260811 00:55:40.838131 26646 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 00:55:40.838224 26646 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 00:55:40.840477 26484 master_runner.cc:428] Detected that this master 7eb59440ba8341ac941c586dc9154d6f is joining an existing cluster
I20260811 00:55:40.840574 26484 master_runner.cc:432] Initiating AddMaster RPC to add 127.15.70.61:36339
I20260811 00:55:40.851481 25766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:40.841959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60824 (local address 127.15.70.62:41971)
0811 00:55:40.842437 (+ 478us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:40.842439 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:40.842450 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:55:40.842483 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:40.842484 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:40.842515 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:40.842589 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:40.843038 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:40.843985 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:40.845397 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:40.845777 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:40.845848 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:40.847530 (+ 1682us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:40.847532 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:40.847533 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:40.847542 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:40.850021 (+ 2479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:40.850430 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:40.850431 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:40.850432 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:40.850501 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:40.850730 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:40.850731 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:40.850731 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:40.850898 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:40.850986 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:40.851217 (+ 231us) server_negotiation.cc:299] Negotiation successful
0811 00:55:40.851327 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":444}
I20260811 00:55:40.851868 26652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:40.841841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:41971 (local address 127.0.0.1:60824)
0811 00:55:40.842144 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:40.842172 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:40.842247 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:40.842600 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:40.842601 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:40.842827 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:40.842916 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:40.842918 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:40.844088 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:40.844089 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:40.845277 (+ 1188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:40.845281 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:40.845916 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:40.845916 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:40.845982 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:40.846842 (+ 860us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:40.846862 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:40.847413 (+ 551us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:40.850139 (+ 2726us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:40.850141 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:40.850141 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:40.850337 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:40.850573 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:40.850575 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:40.850575 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:40.850643 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:40.850975 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:40.850976 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:40.851076 (+ 100us) client_negotiation.cc:769] Sending connection context
0811 00:55:40.851605 (+ 529us) client_negotiation.cc:240] Negotiation successful
0811 00:55:40.851751 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"mutex_wait_us":21,"thread_start_us":99,"threads_started":1}
I20260811 00:55:40.854246 26619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:40.842348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45194 (local address 127.15.70.61:36339)
0811 00:55:40.842415 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:40.842417 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:40.842512 (+ 95us) server_negotiation.cc:407] Connection header received
0811 00:55:40.842646 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:40.842647 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:40.842658 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:40.842714 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:40.843372 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:40.844076 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:40.845419 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:40.845758 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:40.845829 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:40.848212 (+ 2383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:40.848213 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:40.848214 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:40.848221 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:40.852943 (+ 4722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:40.853374 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:40.853375 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:40.853376 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:40.853433 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:40.853654 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:40.853656 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:40.853656 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:40.853809 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:40.853859 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:40.854063 (+ 204us) server_negotiation.cc:299] Negotiation successful
0811 00:55:40.854155 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 00:55:40.854594 26654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:40.842216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.61:36339 (local address 127.0.0.1:45194)
0811 00:55:40.842379 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:40.842419 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:40.842537 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:40.842805 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:40.842806 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:40.843182 (+ 376us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:40.843264 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:40.843267 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:40.844173 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:40.844174 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:40.845307 (+ 1133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:40.845310 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:40.845893 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:40.845894 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:40.845982 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:40.846786 (+ 804us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:40.846792 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:40.848083 (+ 1291us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:40.853047 (+ 4964us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:40.853048 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:40.853048 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:40.853277 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:40.853506 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:40.853507 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:40.853507 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:40.853577 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:40.853905 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:40.853907 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:40.853951 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 00:55:40.854372 (+ 421us) client_negotiation.cc:240] Negotiation successful
0811 00:55:40.854473 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"mutex_wait_us":66,"thread_start_us":87,"threads_started":1}
Aug 11 00:55:40 dist-test-slave-h3ft krb5kdc[25620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409739, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.70.62@KRBTEST.COM for oryx/127.15.70.61@KRBTEST.COM
I20260811 00:55:40.864326 26657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:40.856170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.61:36339 (local address 127.0.0.1:45202)
0811 00:55:40.856332 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:40.856384 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:40.856466 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:40.856621 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:40.856626 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:40.856922 (+ 296us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:40.856991 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:40.856994 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:40.857940 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:40.857940 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:40.858587 (+ 647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:40.858590 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:40.859106 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:40.859107 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:40.859197 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:40.859741 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:40.859746 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:40.861284 (+ 1538us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:40.863101 (+ 1817us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:40.863108 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:40.863111 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:40.863352 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:40.863590 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:40.863591 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:40.863591 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:40.863653 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:40.863943 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:40.863951 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:40.864004 (+ 53us) client_negotiation.cc:769] Sending connection context
0811 00:55:40.864100 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 00:55:40.864219 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":97,"threads_started":1}
I20260811 00:55:40.864348 26619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:40.856243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45202 (local address 127.15.70.61:36339)
0811 00:55:40.856284 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:40.856286 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:40.856472 (+ 186us) server_negotiation.cc:407] Connection header received
0811 00:55:40.856528 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:40.856529 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:40.856540 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:40.856610 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:40.857083 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:40.857863 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:40.858680 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:40.858988 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:40.859114 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:40.861373 (+ 2259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:40.861375 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:40.861376 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:40.861383 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:40.862959 (+ 1576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:40.863433 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:40.863435 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:40.863435 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:40.863515 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:40.863721 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:40.863722 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:40.863722 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:40.863876 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:40.863951 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:40.864154 (+ 203us) server_negotiation.cc:299] Negotiation successful
0811 00:55:40.864245 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 00:55:40.865159 25698 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.15.70.61:36339: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f"
member_type: NON_VOTER
last_known_addr {
host: "127.15.70.61"
port: 36339
}
attrs {
promote: true
}
}
dest_uuid: "a918e7b423bf4b60b146f5b794596334"
cas_config_opid_index: -1
I20260811 00:55:40.865626 25698 consensus_queue.cc:237] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: NON_VOTER last_known_addr { host: "127.15.70.61" port: 36339 } attrs { promote: true } }
I20260811 00:55:40.866289 26658 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 7eb59440ba8341ac941c586dc9154d6f (127.15.70.61) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: NON_VOTER last_known_addr { host: "127.15.70.61" port: 36339 } attrs { promote: true } } }
I20260811 00:55:40.866677 26568 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:40.867636 26658 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.15.70.61:36339
I20260811 00:55:40.867744 26658 sys_catalog.cc:455] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "a918e7b423bf4b60b146f5b794596334" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: NON_VOTER last_known_addr { host: "127.15.70.61" port: 36339 } attrs { promote: true } } }
I20260811 00:55:40.867823 26658 sys_catalog.cc:458] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [sys.catalog]: This master's current role is: LEADER
I20260811 00:55:40.867861 26568 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [term 1 FOLLOWER]: Refusing update from remote peer a918e7b423bf4b60b146f5b794596334: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260811 00:55:40.868054 26484 master.cc:537] Master@127.15.70.61:36339 shutting down...
I20260811 00:55:40.868824 26659 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: NON_VOTER last_known_addr { host: "127.15.70.61" port: 36339 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 00:55:40.869709 25678 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260811 00:55:40.870220 25678 consensus_peers.cc:487] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 -> Peer 7eb59440ba8341ac941c586dc9154d6f (127.15.70.61:36339): Couldn't send request to peer 7eb59440ba8341ac941c586dc9154d6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 00:55:40.872028 26484 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:55:40.872145 26484 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:55:40.872206 26484 tablet_replica.cc:330] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f: stopping tablet replica
W20260811 00:55:40.874070 26522 connection.cc:441] server connection from 127.0.0.1:45176 torn down before Call kudu.master.MasterService.ListTables from 127.0.0.1:45176 (request call id 10) could send its response
I20260811 00:55:40.886415 26484 master.cc:552] Master@127.15.70.61:36339 shutdown complete.
I20260811 00:55:40.886551 26484 master_runner.cc:305] Clearing existing system tablet
I20260811 00:55:40.886731 26484 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:40.886791 26484 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:40.887646 26484 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260811 00:55:40.888276 26669 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:40.888463 26484 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:40.888541 26484 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 00:55:40.888576 26484 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-1/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-1/wal
uuid: "7eb59440ba8341ac941c586dc9154d6f"
format_stamp: "Formatted at 2026-08-11 00:55:40 on dist-test-slave-h3ft"
server_key: "1213cc1e999d04233970dfd38bbcd35f"
server_key_iv: "c7f7491db853ab71ae818e85e8f05f64"
server_key_version: "encryptionkey@0"
I20260811 00:55:40.889974 26484 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:55:40.891515 26484 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 00:55:40.891611 26484 log.cc:1196] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260811 00:55:40.891847 26484 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f: Deleting consensus metadata
I20260811 00:55:40.891995 26484 master_runner.cc:315] Copying system tablet from 127.15.70.62:41971
I20260811 00:55:40.892719 26484 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f: tablet copy: Beginning tablet copy session from remote peer at address 127.15.70.62:41971
I20260811 00:55:40.900311 26681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:40.893125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:41971 (local address 127.0.0.1:60836)
0811 00:55:40.893283 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:40.893298 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:40.893410 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:40.893615 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:40.893616 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:40.893851 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:40.893926 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:40.893929 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:40.894707 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:40.894708 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:40.895447 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:40.895450 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:40.895875 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:40.895877 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:40.895956 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:40.896564 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:40.896569 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:40.896937 (+ 368us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:40.898843 (+ 1906us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:40.898845 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:40.898845 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:40.899149 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:40.899551 (+ 402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:40.899553 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:40.899553 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:40.899626 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:40.899972 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:40.899973 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:40.900034 (+ 61us) client_negotiation.cc:769] Sending connection context
0811 00:55:40.900099 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 00:55:40.900208 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":90,"threads_started":1}
I20260811 00:55:40.900369 25766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:40.893237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60836 (local address 127.15.70.62:41971)
0811 00:55:40.893305 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:40.893307 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:40.893390 (+ 83us) server_negotiation.cc:407] Connection header received
0811 00:55:40.893510 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:40.893511 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:40.893531 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:40.893610 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:40.894034 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:40.894605 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:40.895554 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:40.895779 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:40.895875 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:40.897087 (+ 1212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:40.897089 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:40.897090 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:40.897098 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:40.898727 (+ 1629us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:40.899344 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:40.899346 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:40.899347 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:40.899437 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:40.899713 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:40.899714 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:40.899715 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:40.899882 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:40.899967 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:40.900156 (+ 189us) server_negotiation.cc:299] Negotiation successful
0811 00:55:40.900261 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 00:55:40.901127 25734 tablet_copy_service.cc:140] P a918e7b423bf4b60b146f5b794596334: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 7eb59440ba8341ac941c586dc9154d6f ({username='oryx', principal='oryx/127.15.70.61@KRBTEST.COM'} at 127.0.0.1:60836)
I20260811 00:55:40.901260 25734 tablet_copy_service.cc:161] P a918e7b423bf4b60b146f5b794596334: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 7eb59440ba8341ac941c586dc9154d6f at {username='oryx', principal='oryx/127.15.70.61@KRBTEST.COM'} at 127.0.0.1:60836: session id = 7eb59440ba8341ac941c586dc9154d6f-00000000000000000000000000000000
I20260811 00:55:40.902134 25734 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 00:55:40.902968 26484 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 00:55:40.904279 26484 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f: tablet copy: Starting download of 0 data blocks...
I20260811 00:55:40.904479 26484 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f: tablet copy: Starting download of 1 WAL segments...
I20260811 00:55:40.905596 26484 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 00:55:40.906621 25734 tablet_copy_service.cc:342] P a918e7b423bf4b60b146f5b794596334: Request end of tablet copy session 7eb59440ba8341ac941c586dc9154d6f-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.15.70.61@KRBTEST.COM'} at 127.0.0.1:60836
I20260811 00:55:40.906692 25734 tablet_copy_service.cc:433] P a918e7b423bf4b60b146f5b794596334: ending tablet copy session 7eb59440ba8341ac941c586dc9154d6f-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 7eb59440ba8341ac941c586dc9154d6f
I20260811 00:55:40.909795 26484 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:40.911435 26682 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:40.911444 26687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:40.911598 26685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:40.915264 26484 server_base.cc:1034] running on GCE node
I20260811 00:55:40.915429 26484 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:40.915680 26484 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:40.916826 26484 hybrid_clock.cc:648] HybridClock initialized: now 1786409740916820 us; error 35 us; skew 500 ppm
Aug 11 00:55:40 dist-test-slave-h3ft krb5kdc[25620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409740, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.70.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:40.918562 26484 init.cc:377] Logged in from keytab as oryx/127.15.70.61@KRBTEST.COM (short username oryx)
I20260811 00:55:40.918962 26484 webserver.cc:460] Webserver started at http://127.15.70.61:44691/ using document root <none> and password file <none>
I20260811 00:55:40.919188 26484 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:40.919221 26484 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:40.919981 26484 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260811 00:55:40.920648 26697 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:40.920814 26484 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 00:55:40.920890 26484 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-1/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-1/wal
uuid: "7eb59440ba8341ac941c586dc9154d6f"
format_stamp: "Formatted at 2026-08-11 00:55:40 on dist-test-slave-h3ft"
server_key: "1213cc1e999d04233970dfd38bbcd35f"
server_key_iv: "c7f7491db853ab71ae818e85e8f05f64"
server_key_version: "encryptionkey@0"
I20260811 00:55:40.920969 26484 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:40.934589 26484 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:40.936717 26484 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:40.940897 26484 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.61:36339
I20260811 00:55:40.941236 26792 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.61:36339 every 8 connection(s)
I20260811 00:55:40.941380 26484 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-1/data/info.pb
I20260811 00:55:40.942348 26793 sys_catalog.cc:263] Verifying existing consensus state
I20260811 00:55:40.942874 26793 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f: Bootstrap starting.
I20260811 00:55:40.945566 26793 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 00:55:40.945856 26793 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f: Bootstrap complete.
I20260811 00:55:40.946126 26793 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: NON_VOTER last_known_addr { host: "127.15.70.61" port: 36339 } attrs { promote: true } }
I20260811 00:55:40.946249 26793 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7eb59440ba8341ac941c586dc9154d6f, State: Initialized, Role: LEARNER
I20260811 00:55:40.946310 26793 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: NON_VOTER last_known_addr { host: "127.15.70.61" port: 36339 } attrs { promote: true } }
I20260811 00:55:40.946624 26793 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:55:40.946578 26796 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: NON_VOTER last_known_addr { host: "127.15.70.61" port: 36339 } attrs { promote: true } } }
I20260811 00:55:40.946697 26796 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [sys.catalog]: This master's current role is: LEARNER
I20260811 00:55:40.948417 26812 catalog_manager.cc:1259] Loaded cluster ID: 8ae5bbf38e204796b1345a1c74c09ce3
I20260811 00:55:40.948486 26812 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f: loading cluster ID for follower catalog manager: success
I20260811 00:55:40.949611 26812 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f: acquiring CA information for follower catalog manager: success
I20260811 00:55:40.949944 26812 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 00:55:40.983655 26817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:40.975468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45214 (local address 127.15.70.61:36339)
0811 00:55:40.975664 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:40.975666 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:40.975674 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:55:40.975705 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:40.975705 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:40.975717 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:40.975779 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:40.976661 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:40.977429 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:40.978529 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:40.978755 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:40.978815 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:40.980567 (+ 1752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:40.980568 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:40.980568 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:40.980577 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:40.982225 (+ 1648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:40.982699 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:40.982701 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:40.982701 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:40.982769 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:40.983079 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:40.983080 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:40.983080 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:40.983217 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:40.983319 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:40.983460 (+ 141us) server_negotiation.cc:299] Negotiation successful
0811 00:55:40.983542 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":106,"threads_started":1}
WARNING: no policy specified for oryx/127.15.70.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.70.60@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.70.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.60.keytab.
Entry for principal oryx/127.15.70.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.60.keytab.
I20260811 00:55:41.027144 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.60:46507
--webserver_interface=127.15.70.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.60.keytab
--principal=oryx/127.15.70.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:44081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:41971,127.15.70.61:36339,127.15.70.60:46507
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:41.127027 26822 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:41.127362 26822 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:41.127391 26822 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:41.128674 26822 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:55:41.128726 26822 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:41.128741 26822 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:41.128753 26822 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:55:41.128767 26822 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:55:41.130621 26822 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:44081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:41971,127.15.70.61:36339,127.15.70.60:46507
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.60.keytab
--principal=oryx/127.15.70.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.60:46507
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.15.70.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26822
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:41.130947 26822 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:41.131278 26822 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 00:55:41.137279 26822 server_base.cc:1034] running on GCE node
W20260811 00:55:41.137336 26831 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:41.137286 26832 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:41.137456 26837 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:41.137809 26822 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:41.138136 26822 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:41.139283 26822 hybrid_clock.cc:648] HybridClock initialized: now 1786409741139261 us; error 44 us; skew 500 ppm
Aug 11 00:55:41 dist-test-slave-h3ft krb5kdc[25620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409741, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.70.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:41.142473 26822 init.cc:377] Logged in from keytab as oryx/127.15.70.60@KRBTEST.COM (short username oryx)
I20260811 00:55:41.143107 26822 webserver.cc:460] Webserver started at http://127.15.70.60:35555/ using document root <none> and password file <none>
I20260811 00:55:41.143401 26822 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:41.143451 26822 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:41.143627 26822 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:41.144935 26822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-2/data/instance:
uuid: "a5410fd331ff4f8787e2ef70cd01d43f"
format_stamp: "Formatted at 2026-08-11 00:55:41 on dist-test-slave-h3ft"
server_key: "b736a325fff412fdf2fedaf1a43ff5ec"
server_key_iv: "58de6d8ce488af6bdc49a12ec00a181e"
server_key_version: "encryptionkey@0"
I20260811 00:55:41.145462 26822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-2/wal/instance:
uuid: "a5410fd331ff4f8787e2ef70cd01d43f"
format_stamp: "Formatted at 2026-08-11 00:55:41 on dist-test-slave-h3ft"
server_key: "b736a325fff412fdf2fedaf1a43ff5ec"
server_key_iv: "58de6d8ce488af6bdc49a12ec00a181e"
server_key_version: "encryptionkey@0"
I20260811 00:55:41.147161 26822 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260811 00:55:41.148104 26848 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:41.148322 26822 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:41.148456 26822 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-2/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-2/wal
uuid: "a5410fd331ff4f8787e2ef70cd01d43f"
format_stamp: "Formatted at 2026-08-11 00:55:41 on dist-test-slave-h3ft"
server_key: "b736a325fff412fdf2fedaf1a43ff5ec"
server_key_iv: "58de6d8ce488af6bdc49a12ec00a181e"
server_key_version: "encryptionkey@0"
I20260811 00:55:41.148550 26822 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:41.159466 26822 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:41.162220 26822 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:41.162420 26822 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:41.167826 26822 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.60:46507
I20260811 00:55:41.167868 26930 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.60:46507 every 8 connection(s)
I20260811 00:55:41.168324 26822 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-2/data/info.pb
I20260811 00:55:41.169622 26933 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:41.171934 26933 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } has no permanent_uuid. Determining permanent_uuid...
I20260811 00:55:41.175206 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 26822
Aug 11 00:55:41 dist-test-slave-h3ft krb5kdc[25620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409741, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.70.60@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM
Aug 11 00:55:41 dist-test-slave-h3ft krb5kdc[25620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409739, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.15.70.60@KRBTEST.COM
I20260811 00:55:41.184405 25766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.172981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60844 (local address 127.15.70.62:41971)
0811 00:55:41.173050 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:41.173052 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:41.173186 (+ 134us) server_negotiation.cc:407] Connection header received
0811 00:55:41.173852 (+ 666us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:41.173853 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:41.173867 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:41.173914 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:41.174810 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.175648 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.177320 (+ 1672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.177646 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.177733 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.180786 (+ 3053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:41.180787 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:41.180788 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:41.180796 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:41.182597 (+ 1801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:41.183144 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:41.183146 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:41.183147 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:41.183234 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:41.183543 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:41.183544 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:41.183545 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:41.183731 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:41.183807 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:41.184234 (+ 427us) server_negotiation.cc:299] Negotiation successful
0811 00:55:41.184319 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 00:55:41.184695 26935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.172790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:41971 (local address 127.0.0.1:60844)
0811 00:55:41.173024 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:41.173081 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:41.173721 (+ 640us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:41.174005 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:41.174009 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:41.174468 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:41.174721 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.174726 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.175801 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.175816 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.177228 (+ 1412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.177236 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.177785 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.177787 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.177907 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.178539 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:41.178551 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:41.180668 (+ 2117us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:41.182689 (+ 2021us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:41.182699 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:41.182702 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:41.182979 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:41.183307 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:41.183309 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:41.183309 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:41.183448 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:41.183817 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:41.183826 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:41.184045 (+ 219us) client_negotiation.cc:769] Sending connection context
0811 00:55:41.184185 (+ 140us) client_negotiation.cc:240] Negotiation successful
0811 00:55:41.184370 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":107,"threads_started":1}
I20260811 00:55:41.185355 26933 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.70.61" port: 36339 } has no permanent_uuid. Determining permanent_uuid...
I20260811 00:55:41.186440 26937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.175971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58222 (local address 127.15.70.60:46507)
0811 00:55:41.176199 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:41.176210 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:41.176226 (+ 16us) server_negotiation.cc:407] Connection header received
0811 00:55:41.176245 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:41.176246 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:41.176265 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:41.176335 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:41.177167 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.178209 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.179386 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.179694 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.179762 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.182729 (+ 2967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:41.182738 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:41.182739 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:41.182747 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:41.184663 (+ 1916us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:41.185177 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:41.185180 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:41.185181 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:41.185246 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:41.185505 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:41.185506 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:41.185506 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:41.185697 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:41.185918 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:41.186222 (+ 304us) server_negotiation.cc:299] Negotiation successful
0811 00:55:41.186315 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":161,"threads_started":1}
Aug 11 00:55:41 dist-test-slave-h3ft krb5kdc[25620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409741, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.70.60@KRBTEST.COM for oryx/127.15.70.61@KRBTEST.COM
I20260811 00:55:41.193037 26935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.185702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.61:36339 (local address 127.0.0.1:45228)
0811 00:55:41.185741 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:41.185758 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:41.185816 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:41.186042 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:41.186043 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:41.186177 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:41.186216 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.186217 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.187222 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.187223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.187961 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.187965 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.188438 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.188439 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.188492 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.188886 (+ 394us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:41.188890 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:41.190289 (+ 1399us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:41.192051 (+ 1762us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:41.192052 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:41.192052 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:41.192240 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:41.192443 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:41.192444 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:41.192444 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:41.192501 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:41.192752 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:41.192752 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:41.192794 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 00:55:41.192848 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 00:55:41.192933 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19}
I20260811 00:55:41.193059 26817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.185840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45228 (local address 127.15.70.61:36339)
0811 00:55:41.185899 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:41.185901 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:41.185910 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:55:41.185947 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:41.185948 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:41.185965 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:41.186038 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:41.186306 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.187132 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.188081 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.188337 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.188405 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.190392 (+ 1987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:41.190393 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:41.190394 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:41.190403 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:41.191947 (+ 1544us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:41.192315 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:41.192316 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:41.192317 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:41.192378 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:41.192559 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:41.192560 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:41.192560 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:41.192695 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:41.192751 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:41.192882 (+ 131us) server_negotiation.cc:299] Negotiation successful
0811 00:55:41.192973 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 00:55:41.193542 26933 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.70.60" port: 46507 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 00:55:41 dist-test-slave-h3ft krb5kdc[25620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409741, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.70.60@KRBTEST.COM for oryx/127.15.70.60@KRBTEST.COM
I20260811 00:55:41.200395 26935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.193873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:46507 (local address 127.0.0.1:58228)
0811 00:55:41.193930 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:41.193942 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:41.193986 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:41.194142 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:41.194143 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:41.194269 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:41.194307 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.194308 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.195096 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.195097 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.195576 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.195577 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.195992 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.195993 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.196051 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.196457 (+ 406us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:41.196461 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:41.197724 (+ 1263us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:41.199470 (+ 1746us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:41.199471 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:41.199472 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:41.199644 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:41.199809 (+ 165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:41.199810 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:41.199810 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:41.199866 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:41.200075 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:41.200076 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:41.200115 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 00:55:41.200172 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 00:55:41.200269 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 00:55:41.200400 26937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.193927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58228 (local address 127.15.70.60:46507)
0811 00:55:41.194020 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:41.194022 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:41.194031 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:55:41.194050 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:41.194051 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:41.194064 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:41.194142 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:41.194398 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.194946 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.195650 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.195922 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.195985 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.197821 (+ 1836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:41.197822 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:41.197823 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:41.197829 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:41.199392 (+ 1563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:41.199709 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:41.199710 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:41.199710 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:41.199756 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:41.199908 (+ 152us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:41.199909 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:41.199909 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:41.200020 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:41.200071 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:41.200211 (+ 140us) server_negotiation.cc:299] Negotiation successful
0811 00:55:41.200322 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":40,"server-negotiator.queue_time_us":66}
I20260811 00:55:41.202356 26933 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f: Bootstrap starting.
I20260811 00:55:41.203521 26933 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:41.203814 26933 log.cc:824] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f: Log is configured to *not* fsync() on all Append() calls
I20260811 00:55:41.204861 26933 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f: No bootstrap required, opened a new log
I20260811 00:55:41.206595 26933 raft_consensus.cc:348] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 36339 } } peers { permanent_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 46507 } }
I20260811 00:55:41.206750 26933 raft_consensus.cc:374] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:41.206775 26933 raft_consensus.cc:729] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5410fd331ff4f8787e2ef70cd01d43f, State: Initialized, Role: FOLLOWER
I20260811 00:55:41.206892 26933 consensus_queue.cc:260] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 36339 } } peers { permanent_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 46507 } }
I20260811 00:55:41.207401 26933 sys_catalog.cc:564] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:55:41.207355 26941 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 36339 } } peers { permanent_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 46507 } } }
I20260811 00:55:41.207494 26941 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [sys.catalog]: This master's current role is: FOLLOWER
W20260811 00:55:41.209570 26963 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 00:55:41.209636 26963 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 00:55:41.212728 26822 master_runner.cc:428] Detected that this master a5410fd331ff4f8787e2ef70cd01d43f is joining an existing cluster
I20260811 00:55:41.212797 26822 master_runner.cc:432] Initiating AddMaster RPC to add 127.15.70.60:46507
I20260811 00:55:41.223049 25766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.214467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60852 (local address 127.15.70.62:41971)
0811 00:55:41.214587 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:41.214589 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:41.214793 (+ 204us) server_negotiation.cc:407] Connection header received
0811 00:55:41.214924 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:41.214925 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:41.214940 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:41.214974 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:41.215781 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.216619 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.217917 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.218226 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.218272 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.219772 (+ 1500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:41.219773 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:41.219774 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:41.219781 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:41.221659 (+ 1878us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:41.222095 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:41.222096 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:41.222097 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:41.222172 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:41.222444 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:41.222445 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:41.222445 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:41.222585 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:41.222664 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:41.222831 (+ 167us) server_negotiation.cc:299] Negotiation successful
0811 00:55:41.222915 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260811 00:55:41.223084 26969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.214257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:41971 (local address 127.0.0.1:60852)
0811 00:55:41.214700 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:41.214729 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:41.214842 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:41.215084 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:41.215085 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:41.215565 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:41.215659 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.215663 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.216727 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.216728 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.217810 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.217813 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.218381 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.218382 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.218447 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.218982 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:41.218990 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:41.219622 (+ 632us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:41.221741 (+ 2119us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:41.221742 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:41.221743 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:41.221992 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:41.222292 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:41.222293 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:41.222294 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:41.222371 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:41.222668 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:41.222670 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:41.222728 (+ 58us) client_negotiation.cc:769] Sending connection context
0811 00:55:41.222812 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 00:55:41.222931 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":423,"mutex_wait_us":56,"thread_start_us":111,"threads_started":1}
Aug 11 00:55:41 dist-test-slave-h3ft krb5kdc[25620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409739, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.70.62@KRBTEST.COM for oryx/127.15.70.60@KRBTEST.COM
I20260811 00:55:41.238935 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 25802
I20260811 00:55:41.258905 26941 raft_consensus.cc:482] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:55:41.259186 26941 raft_consensus.cc:504] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 36339 } } peers { permanent_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 46507 } }
I20260811 00:55:41.259672 26941 leader_election.cc:288] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a918e7b423bf4b60b146f5b794596334 (127.15.70.62:41971), 7eb59440ba8341ac941c586dc9154d6f (127.15.70.61:36339)
I20260811 00:55:41.260236 25715 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a918e7b423bf4b60b146f5b794596334" is_pre_election: true
I20260811 00:55:41.261075 26749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb59440ba8341ac941c586dc9154d6f" is_pre_election: true
I20260811 00:55:41.261230 26749 raft_consensus.cc:1799] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [term 1 LEARNER]: Handling vote request from an unknown peer a5410fd331ff4f8787e2ef70cd01d43f
I20260811 00:55:41.261298 26749 raft_consensus.cc:2396] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [term 1 LEARNER]: Leader pre-election vote request: Denying vote to candidate a5410fd331ff4f8787e2ef70cd01d43f for term 1 because replica has last-logged OpId of term: 1 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260811 00:55:41.261709 26850 leader_election.cc:302] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5410fd331ff4f8787e2ef70cd01d43f; no voters: 7eb59440ba8341ac941c586dc9154d6f, a918e7b423bf4b60b146f5b794596334
I20260811 00:55:41.262030 26941 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:41.263512 26941 raft_consensus.cc:2726] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 00:55:41.265853 26970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.214233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.61:36339 (local address 127.0.0.1:45234)
0811 00:55:41.214675 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:41.214695 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:41.214845 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:41.215124 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:41.215125 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:41.215569 (+ 444us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:41.215699 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.215702 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.216717 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.216718 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.217801 (+ 1083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.217803 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.218391 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.218391 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.218458 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.250031 (+ 31573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:41.250038 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:41.261674 (+ 11636us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:41.263871 (+ 2197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:41.263873 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:41.263874 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:41.264183 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:41.264415 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:41.264416 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:41.264416 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:41.264780 (+ 364us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:41.265172 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:41.265173 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:41.265234 (+ 61us) client_negotiation.cc:769] Sending connection context
0811 00:55:41.265302 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 00:55:41.265465 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":416,"mutex_wait_us":106,"thread_start_us":116,"threads_started":1}
I20260811 00:55:41.266541 26817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.214372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45234 (local address 127.15.70.61:36339)
0811 00:55:41.214532 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:41.214534 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:41.214781 (+ 247us) server_negotiation.cc:407] Connection header received
0811 00:55:41.214943 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:41.214944 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:41.214959 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:41.215035 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:41.215822 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.216616 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.217924 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.218256 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.218303 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.261806 (+ 43503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:41.261808 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:41.261809 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:41.261820 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:41.263744 (+ 1924us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:41.264267 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:41.264268 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:41.264269 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:41.264338 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:41.264888 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:41.264889 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:41.264890 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:41.265074 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:41.265141 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:41.266279 (+ 1138us) server_negotiation.cc:299] Negotiation successful
0811 00:55:41.266423 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124}
I20260811 00:55:41.267891 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.1:39029
--local_ip_for_outbound_sockets=127.15.70.1
--tserver_master_addrs=127.15.70.62:41971
--webserver_port=41693
--webserver_interface=127.15.70.1
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.1.keytab
--principal=oryx/127.15.70.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:44081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.15.70.62:41971,127.15.70.61:36339
--tserver_master_addrs=127.15.70.62:41971,127.15.70.61:36339,127.15.70.60:46507 with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 00:55:41.268784 26937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.214559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58230 (local address 127.15.70.60:46507)
0811 00:55:41.214606 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:41.214609 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:41.214845 (+ 236us) server_negotiation.cc:407] Connection header received
0811 00:55:41.214941 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:41.214942 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:41.214953 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:41.214988 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:41.215808 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.216597 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.217905 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.218201 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.218247 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.265678 (+ 47431us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:41.265681 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:41.265681 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:41.265690 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:41.267529 (+ 1839us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:41.267934 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:41.267934 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:41.267935 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:41.268018 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:41.268230 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:41.268230 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:41.268231 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:41.268370 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:41.268419 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:41.268605 (+ 186us) server_negotiation.cc:299] Negotiation successful
0811 00:55:41.268692 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 00:55:41.269074 26657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.226068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:46507 (local address 127.0.0.1:58242)
0811 00:55:41.226122 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:41.226135 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:41.226182 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:41.226722 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:41.226723 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:41.226916 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:41.226974 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.226976 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.227718 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.227719 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.228597 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.228599 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.229058 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.229060 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.229134 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.229575 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:41.229580 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:41.231411 (+ 1831us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:41.267264 (+ 35853us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:41.267266 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:41.267267 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:41.267570 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:41.267793 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:41.267793 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:41.267794 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:41.267860 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:41.268487 (+ 627us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:41.268488 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:41.268552 (+ 64us) client_negotiation.cc:769] Sending connection context
0811 00:55:41.268617 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 00:55:41.268757 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260811 00:55:41.269129 26972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.214505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:46507 (local address 127.0.0.1:58230)
0811 00:55:41.214774 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:41.214785 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:41.214868 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:41.215181 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:41.215182 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:41.215569 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:41.215700 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.215702 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.216706 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.216707 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.217801 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.217803 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.218385 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.218386 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.218458 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.249662 (+ 31204us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:41.249672 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:41.265576 (+ 15904us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:41.267619 (+ 2043us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:41.267620 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:41.267621 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:41.267841 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:41.268123 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:41.268123 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:41.268124 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:41.268174 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:41.268464 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:41.268466 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:41.268503 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 00:55:41.268919 (+ 416us) client_negotiation.cc:240] Negotiation successful
0811 00:55:41.269022 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"mutex_wait_us":98,"thread_start_us":97,"threads_started":1}
I20260811 00:55:41.269470 26973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.226263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58242 (local address 127.15.70.60:46507)
0811 00:55:41.226543 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:41.226545 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:41.226554 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:55:41.226611 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:41.226612 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:41.226623 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:41.226696 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:41.227097 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.227633 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.228690 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.228972 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.229041 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.231575 (+ 2534us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:41.231577 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:41.231577 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:41.231585 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:41.267140 (+ 35555us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:41.267661 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:41.267662 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:41.267663 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:41.267714 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:41.267934 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:41.267935 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:41.267935 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:41.268378 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:41.269249 (+ 871us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:41.269299 (+ 50us) server_negotiation.cc:299] Negotiation successful
0811 00:55:41.269378 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":242,"thread_start_us":147,"threads_started":1}
I20260811 00:55:41.270053 25698 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.15.70.60:46507: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "a5410fd331ff4f8787e2ef70cd01d43f"
member_type: NON_VOTER
last_known_addr {
host: "127.15.70.60"
port: 46507
}
attrs {
promote: true
}
}
dest_uuid: "a918e7b423bf4b60b146f5b794596334"
cas_config_opid_index: 5
I20260811 00:55:41.270402 25698 consensus_queue.cc:237] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: NON_VOTER last_known_addr { host: "127.15.70.61" port: 36339 } attrs { promote: true } } peers { permanent_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" member_type: NON_VOTER last_known_addr { host: "127.15.70.60" port: 46507 } attrs { promote: true } }
I20260811 00:55:41.270851 26658 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER a5410fd331ff4f8787e2ef70cd01d43f (127.15.70.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: NON_VOTER last_known_addr { host: "127.15.70.61" port: 36339 } attrs { promote: true } } peers { permanent_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" member_type: NON_VOTER last_known_addr { host: "127.15.70.60" port: 46507 } attrs { promote: true } } }
I20260811 00:55:41.272051 26658 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.15.70.60:46507
I20260811 00:55:41.272142 26658 sys_catalog.cc:455] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "a918e7b423bf4b60b146f5b794596334" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: NON_VOTER last_known_addr { host: "127.15.70.61" port: 36339 } attrs { promote: true } } peers { permanent_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" member_type: NON_VOTER last_known_addr { host: "127.15.70.60" port: 46507 } attrs { promote: true } } }
I20260811 00:55:41.272219 26658 sys_catalog.cc:458] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [sys.catalog]: This master's current role is: LEADER
I20260811 00:55:41.272536 26822 master.cc:537] Master@127.15.70.60:46507 shutting down...
W20260811 00:55:41.273789 25678 consensus_peers.cc:487] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 -> Peer a5410fd331ff4f8787e2ef70cd01d43f (127.15.70.60:46507): Couldn't send request to peer a5410fd331ff4f8787e2ef70cd01d43f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 00:55:41.276366 26822 raft_consensus.cc:2229] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:55:41.276463 26822 raft_consensus.cc:2258] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:55:41.276513 26822 tablet_replica.cc:330] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f: stopping tablet replica
I20260811 00:55:41.278614 26817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.272526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45248 (local address 127.15.70.61:36339)
0811 00:55:41.272573 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:41.272575 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:41.273860 (+ 1285us) server_negotiation.cc:407] Connection header received
0811 00:55:41.274728 (+ 868us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:41.274729 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:41.274762 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:41.274817 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:41.275147 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.275959 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.277620 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.278240 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.278338 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.278460 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:41.278496 (+ 36us) server_negotiation.cc:299] Negotiation successful
0811 00:55:41.278541 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 00:55:41.278614 26657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.272468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.61:36339 (local address 127.0.0.1:45248)
0811 00:55:41.273564 (+ 1096us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:41.273576 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:41.274631 (+ 1055us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:41.274968 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:41.274969 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:41.274972 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:41.275061 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.275064 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.276063 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.276065 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.277516 (+ 1451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.277519 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.278337 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.278338 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.278404 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.278435 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 00:55:41.278478 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 00:55:41.278533 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1075}
I20260811 00:55:41.279722 26749 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [term 1 LEARNER]: Refusing update from remote peer a918e7b423bf4b60b146f5b794596334: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 00:55:41.280049 26659 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: NON_VOTER last_known_addr { host: "127.15.70.61" port: 36339 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260811 00:55:41.281060 26749 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER a5410fd331ff4f8787e2ef70cd01d43f (127.15.70.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: NON_VOTER last_known_addr { host: "127.15.70.61" port: 36339 } attrs { promote: true } } peers { permanent_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" member_type: NON_VOTER last_known_addr { host: "127.15.70.60" port: 46507 } attrs { promote: true } } }
I20260811 00:55:41.281314 26822 master.cc:552] Master@127.15.70.60:46507 shutdown complete.
I20260811 00:55:41.281355 26822 master_runner.cc:305] Clearing existing system tablet
I20260811 00:55:41.281520 26822 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:41.281561 26822 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:41.282617 26822 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 00:55:41.282912 26796 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [sys.catalog]: SysCatalogTable state changed. Reason: New leader a918e7b423bf4b60b146f5b794596334. Latest consensus state: current_term: 1 leader_uuid: "a918e7b423bf4b60b146f5b794596334" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: NON_VOTER last_known_addr { host: "127.15.70.61" port: 36339 } attrs { promote: true } } peers { permanent_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" member_type: NON_VOTER last_known_addr { host: "127.15.70.60" port: 46507 } attrs { promote: true } } }
I20260811 00:55:41.283054 26796 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [sys.catalog]: This master's current role is: LEARNER
I20260811 00:55:41.283118 26796 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a918e7b423bf4b60b146f5b794596334" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: NON_VOTER last_known_addr { host: "127.15.70.61" port: 36339 } attrs { promote: true } } peers { permanent_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" member_type: NON_VOTER last_known_addr { host: "127.15.70.60" port: 46507 } attrs { promote: true } } }
I20260811 00:55:41.283174 26796 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [sys.catalog]: This master's current role is: LEARNER
I20260811 00:55:41.283459 26659 raft_consensus.cc:1050] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334: attempting to promote NON_VOTER 7eb59440ba8341ac941c586dc9154d6f to VOTER
I20260811 00:55:41.283731 26659 consensus_queue.cc:237] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 36339 } attrs { promote: false } } peers { permanent_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" member_type: NON_VOTER last_known_addr { host: "127.15.70.60" port: 46507 } attrs { promote: true } }
I20260811 00:55:41.284519 26749 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [term 1 LEARNER]: Refusing update from remote peer a918e7b423bf4b60b146f5b794596334: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260811 00:55:41.284621 26657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.284394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:46507 (local address 127.0.0.1:58252)
0811 00:55:41.284462 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:41.284525 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.60:46507: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 00:55:41.284735 26658 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 36339 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260811 00:55:41.285207 26657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.285086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:46507 (local address 127.0.0.1:58260)
0811 00:55:41.285145 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:41.285174 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.60:46507: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260811 00:55:41.285264 25678 consensus_peers.cc:487] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 -> Peer a5410fd331ff4f8787e2ef70cd01d43f (127.15.70.60:46507): Couldn't send request to peer a5410fd331ff4f8787e2ef70cd01d43f. Status: Network error: Client connection negotiation failed: client connection to 127.15.70.60:46507: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 00:55:41.285672 26981 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 7eb59440ba8341ac941c586dc9154d6f (127.15.70.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 36339 } attrs { promote: false } } peers { permanent_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" member_type: NON_VOTER last_known_addr { host: "127.15.70.60" port: 46507 } attrs { promote: true } } }
I20260811 00:55:41.285878 26749 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 7eb59440ba8341ac941c586dc9154d6f (127.15.70.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 36339 } attrs { promote: false } } peers { permanent_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" member_type: NON_VOTER last_known_addr { host: "127.15.70.60" port: 46507 } attrs { promote: true } } }
I20260811 00:55:41.287220 26981 sys_catalog.cc:455] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "a918e7b423bf4b60b146f5b794596334" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 36339 } attrs { promote: false } } peers { permanent_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" member_type: NON_VOTER last_known_addr { host: "127.15.70.60" port: 46507 } attrs { promote: true } } }
I20260811 00:55:41.287375 26981 sys_catalog.cc:458] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [sys.catalog]: This master's current role is: LEADER
I20260811 00:55:41.287384 26658 sys_catalog.cc:455] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a918e7b423bf4b60b146f5b794596334" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 36339 } attrs { promote: false } } peers { permanent_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" member_type: NON_VOTER last_known_addr { host: "127.15.70.60" port: 46507 } attrs { promote: true } } }
I20260811 00:55:41.287514 26658 sys_catalog.cc:458] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [sys.catalog]: This master's current role is: LEADER
I20260811 00:55:41.287679 26979 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a918e7b423bf4b60b146f5b794596334" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 36339 } attrs { promote: false } } peers { permanent_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" member_type: NON_VOTER last_known_addr { host: "127.15.70.60" port: 46507 } attrs { promote: true } } }
I20260811 00:55:41.287791 26979 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [sys.catalog]: This master's current role is: FOLLOWER
I20260811 00:55:41.291127 26980 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:41.291419 26822 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:41.291530 26822 fs_manager.cc:725] Time spent opening block manager: real 0.009s user 0.000s sys 0.000s
I20260811 00:55:41.291572 26822 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-2/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-2/wal
uuid: "a5410fd331ff4f8787e2ef70cd01d43f"
format_stamp: "Formatted at 2026-08-11 00:55:41 on dist-test-slave-h3ft"
server_key: "b736a325fff412fdf2fedaf1a43ff5ec"
server_key_iv: "58de6d8ce488af6bdc49a12ec00a181e"
server_key_version: "encryptionkey@0"
I20260811 00:55:41.292469 26822 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:55:41.294024 26822 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 00:55:41.294138 26822 log.cc:1196] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260811 00:55:41.294373 26822 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f: Deleting consensus metadata
I20260811 00:55:41.294536 26822 master_runner.cc:315] Copying system tablet from 127.15.70.62:41971
I20260811 00:55:41.295365 26822 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f: tablet copy: Beginning tablet copy session from remote peer at address 127.15.70.62:41971
I20260811 00:55:41.302479 25766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.295962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60862 (local address 127.15.70.62:41971)
0811 00:55:41.296027 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:41.296029 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:41.296042 (+ 13us) server_negotiation.cc:407] Connection header received
0811 00:55:41.296115 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:41.296116 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:41.296129 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:41.296206 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:41.296584 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.297152 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.297969 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.298203 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.298288 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.299548 (+ 1260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:41.299550 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:41.299551 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:41.299560 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:41.301137 (+ 1577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:41.301557 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:41.301559 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:41.301560 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:41.301629 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:41.301850 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:41.301851 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:41.301852 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:41.301999 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:41.302085 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:41.302257 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 00:55:41.302358 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 00:55:41.302482 26993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.295780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:41971 (local address 127.0.0.1:60862)
0811 00:55:41.295941 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:41.295956 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:41.296039 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:41.296215 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:41.296216 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:41.296439 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:41.296493 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.296496 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.297248 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.297250 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.297869 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.297872 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.298287 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.298288 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.298365 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.298978 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:41.298984 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:41.299439 (+ 455us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:41.301249 (+ 1810us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:41.301251 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:41.301252 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:41.301462 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:41.301703 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:41.301704 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:41.301704 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:41.301779 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:41.302073 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:41.302075 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:41.302130 (+ 55us) client_negotiation.cc:769] Sending connection context
0811 00:55:41.302221 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 00:55:41.302356 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":102,"threads_started":1}
I20260811 00:55:41.303078 25734 tablet_copy_service.cc:140] P a918e7b423bf4b60b146f5b794596334: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer a5410fd331ff4f8787e2ef70cd01d43f ({username='oryx', principal='oryx/127.15.70.60@KRBTEST.COM'} at 127.0.0.1:60862)
I20260811 00:55:41.303169 25734 tablet_copy_service.cc:161] P a918e7b423bf4b60b146f5b794596334: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer a5410fd331ff4f8787e2ef70cd01d43f at {username='oryx', principal='oryx/127.15.70.60@KRBTEST.COM'} at 127.0.0.1:60862: session id = a5410fd331ff4f8787e2ef70cd01d43f-00000000000000000000000000000000
I20260811 00:55:41.303937 25734 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 00:55:41.304594 26822 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 00:55:41.305855 26822 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f: tablet copy: Starting download of 0 data blocks...
I20260811 00:55:41.306061 26822 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f: tablet copy: Starting download of 1 WAL segments...
I20260811 00:55:41.306958 26822 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 00:55:41.308053 25734 tablet_copy_service.cc:342] P a918e7b423bf4b60b146f5b794596334: Request end of tablet copy session a5410fd331ff4f8787e2ef70cd01d43f-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.15.70.60@KRBTEST.COM'} at 127.0.0.1:60862
I20260811 00:55:41.308136 25734 tablet_copy_service.cc:433] P a918e7b423bf4b60b146f5b794596334: ending tablet copy session a5410fd331ff4f8787e2ef70cd01d43f-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer a5410fd331ff4f8787e2ef70cd01d43f
I20260811 00:55:41.311700 26822 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:41.313180 26994 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:41.313434 26995 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:41.315246 26997 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:41.319276 26822 server_base.cc:1034] running on GCE node
I20260811 00:55:41.319433 26822 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:41.319655 26822 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:41.320797 26822 hybrid_clock.cc:648] HybridClock initialized: now 1786409741320788 us; error 37 us; skew 500 ppm
Aug 11 00:55:41 dist-test-slave-h3ft krb5kdc[25620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409741, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.70.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:41.324021 26822 init.cc:377] Logged in from keytab as oryx/127.15.70.60@KRBTEST.COM (short username oryx)
I20260811 00:55:41.324438 26822 webserver.cc:460] Webserver started at http://127.15.70.60:39673/ using document root <none> and password file <none>
I20260811 00:55:41.324592 26822 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:41.324659 26822 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:41.325459 26822 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 00:55:41.326159 27010 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:41.326335 26822 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:41.326390 26822 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-2/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-2/wal
uuid: "a5410fd331ff4f8787e2ef70cd01d43f"
format_stamp: "Formatted at 2026-08-11 00:55:41 on dist-test-slave-h3ft"
server_key: "b736a325fff412fdf2fedaf1a43ff5ec"
server_key_iv: "58de6d8ce488af6bdc49a12ec00a181e"
server_key_version: "encryptionkey@0"
I20260811 00:55:41.326463 26822 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:41.337762 26822 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:41.339962 26822 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:41.344197 26822 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.60:46507
I20260811 00:55:41.344676 27092 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.60:46507 every 8 connection(s)
I20260811 00:55:41.344769 26822 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/master-2/data/info.pb
I20260811 00:55:41.345884 27093 sys_catalog.cc:263] Verifying existing consensus state
I20260811 00:55:41.346457 27093 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f: Bootstrap starting.
I20260811 00:55:41.349872 27093 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 00:55:41.350196 27093 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f: Bootstrap complete.
I20260811 00:55:41.350453 27093 raft_consensus.cc:348] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 36339 } attrs { promote: false } } peers { permanent_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" member_type: NON_VOTER last_known_addr { host: "127.15.70.60" port: 46507 } attrs { promote: true } }
I20260811 00:55:41.350575 27093 raft_consensus.cc:729] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a5410fd331ff4f8787e2ef70cd01d43f, State: Initialized, Role: LEARNER
I20260811 00:55:41.350633 27093 consensus_queue.cc:260] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 36339 } attrs { promote: false } } peers { permanent_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" member_type: NON_VOTER last_known_addr { host: "127.15.70.60" port: 46507 } attrs { promote: true } }
I20260811 00:55:41.350862 27093 sys_catalog.cc:564] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:55:41.350850 27097 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 36339 } attrs { promote: false } } peers { permanent_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" member_type: NON_VOTER last_known_addr { host: "127.15.70.60" port: 46507 } attrs { promote: true } } }
I20260811 00:55:41.351152 27097 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [sys.catalog]: This master's current role is: LEARNER
I20260811 00:55:41.353012 27115 catalog_manager.cc:1259] Loaded cluster ID: 8ae5bbf38e204796b1345a1c74c09ce3
I20260811 00:55:41.353114 27115 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f: loading cluster ID for follower catalog manager: success
I20260811 00:55:41.354506 27115 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f: acquiring CA information for follower catalog manager: success
I20260811 00:55:41.354856 27115 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260811 00:55:41.408197 26974 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:41.408596 26974 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:41.408639 26974 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:41.410653 26974 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:41.410732 26974 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:41.410775 26974 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.1
I20260811 00:55:41.413587 26974 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:44081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.1.keytab
--principal=oryx/127.15.70.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.1:39029
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.70.1
--webserver_port=41693
--tserver_master_addrs=127.15.70.62:41971,127.15.70.61:36339,127.15.70.60:46507
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26974
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.1
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:41.413932 26974 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:41.414265 26974 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:41.421010 27125 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:41.421005 27126 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:41.421528 27131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:41.422490 26974 server_base.cc:1034] running on GCE node
I20260811 00:55:41.422734 26974 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:41.423099 26974 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:41.424293 26974 hybrid_clock.cc:648] HybridClock initialized: now 1786409741424270 us; error 41 us; skew 500 ppm
Aug 11 00:55:41 dist-test-slave-h3ft krb5kdc[25620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409741, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.70.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:41.428203 26974 init.cc:377] Logged in from keytab as oryx/127.15.70.1@KRBTEST.COM (short username oryx)
I20260811 00:55:41.428851 26974 webserver.cc:460] Webserver started at http://127.15.70.1:41693/ using document root <none> and password file <none>
I20260811 00:55:41.429172 26974 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:41.429271 26974 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:41.430895 26974 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 00:55:41.431618 27144 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:41.431811 26974 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 00:55:41.431903 26974 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-0/wal
uuid: "039628cf163f4400834624b4468d7d16"
format_stamp: "Formatted at 2026-08-11 00:55:40 on dist-test-slave-h3ft"
server_key: "4d6202055b49584ab8c8e2bf10d5b467"
server_key_iv: "9a42470c0df9e760f7d6a6c80138f293"
server_key_version: "encryptionkey@0"
I20260811 00:55:41.432332 26974 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:41.436452 26246 heartbeater.cc:503] Master 127.15.70.62:41971 was elected leader, sending a full tablet report...
I20260811 00:55:41.442750 26974 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:41.445447 26974 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:41.445631 26974 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:41.445922 26974 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:55:41.446290 26974 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:55:41.446391 26974 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:41.446465 26974 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:55:41.446496 26974 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:41.454538 26974 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.1:39029
I20260811 00:55:41.454638 27339 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.1:39029 every 8 connection(s)
I20260811 00:55:41.455134 26974 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
I20260811 00:55:41.457613 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 26974
I20260811 00:55:41.457823 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 26014
Aug 11 00:55:41 dist-test-slave-h3ft krb5kdc[25620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409741, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.70.1@KRBTEST.COM for oryx/127.15.70.61@KRBTEST.COM
Aug 11 00:55:41 dist-test-slave-h3ft krb5kdc[25620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409741, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.70.1@KRBTEST.COM for oryx/127.15.70.60@KRBTEST.COM
I20260811 00:55:41.473125 26817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.456110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:58973 (local address 127.15.70.61:36339)
0811 00:55:41.456169 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:41.456171 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:41.456667 (+ 496us) server_negotiation.cc:407] Connection header received
0811 00:55:41.457326 (+ 659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:41.457328 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:41.457353 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:41.457437 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:41.458898 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.460073 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.462238 (+ 2165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.462664 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.462718 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.466648 (+ 3930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:41.466651 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:41.466651 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:41.466662 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:41.471705 (+ 5043us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:41.472091 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:41.472092 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:41.472093 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:41.472151 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:41.472316 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:41.472317 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:41.472317 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:41.472483 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:41.472534 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:41.472901 (+ 367us) server_negotiation.cc:299] Negotiation successful
0811 00:55:41.473008 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 00:55:41.473584 27348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.456064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.61:36339 (local address 127.15.70.1:58973)
0811 00:55:41.456571 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:41.456584 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:41.457168 (+ 584us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:41.457599 (+ 431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:41.457604 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:41.458288 (+ 684us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:41.458753 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.458763 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.460230 (+ 1467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.460232 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.462090 (+ 1858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.462115 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.462842 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.462844 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.463076 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.464542 (+ 1466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:41.464554 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:41.466533 (+ 1979us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:41.471799 (+ 5266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:41.471800 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:41.471801 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:41.472014 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:41.472210 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:41.472211 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:41.472211 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:41.472261 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:41.472662 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:41.472663 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:41.472715 (+ 52us) client_negotiation.cc:769] Sending connection context
0811 00:55:41.472843 (+ 128us) client_negotiation.cc:240] Negotiation successful
0811 00:55:41.473078 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":473,"mutex_wait_us":4,"spinlock_wait_cycles":384,"thread_start_us":120,"threads_started":1}
I20260811 00:55:41.474093 27347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.456414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:46507 (local address 127.15.70.1:55957)
0811 00:55:41.457361 (+ 947us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:41.457372 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:41.457425 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:41.457651 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:41.457652 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:41.461710 (+ 4058us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:41.461817 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.461820 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.462911 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.462912 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.463701 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.463702 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.464311 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.464313 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.464403 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.466480 (+ 2077us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:41.466487 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:41.468470 (+ 1983us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:41.470939 (+ 2469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:41.470956 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:41.470961 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:41.471493 (+ 532us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:41.471778 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:41.471779 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:41.471779 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:41.471983 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:41.472424 (+ 441us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:41.472433 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:41.472717 (+ 284us) client_negotiation.cc:769] Sending connection context
0811 00:55:41.472841 (+ 124us) client_negotiation.cc:240] Negotiation successful
0811 00:55:41.473641 (+ 800us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":928,"mutex_wait_us":591,"thread_start_us":100,"threads_started":1}
I20260811 00:55:41.474262 27343 heartbeater.cc:347] Connected to a master server at 127.15.70.61:36339
I20260811 00:55:41.474288 27349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.456673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:55957 (local address 127.15.70.60:46507)
0811 00:55:41.456816 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:41.456818 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:41.457478 (+ 660us) server_negotiation.cc:407] Connection header received
0811 00:55:41.457514 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:41.457515 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:41.457531 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:41.457603 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:41.461930 (+ 4327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.462828 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.463815 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.464214 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.464297 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.468607 (+ 4310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:41.468609 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:41.468610 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:41.468622 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:41.470813 (+ 2191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:41.471601 (+ 788us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:41.471603 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:41.471604 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:41.471690 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:41.472094 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:41.472095 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:41.472096 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:41.472316 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:41.472390 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:41.472988 (+ 598us) server_negotiation.cc:299] Negotiation successful
0811 00:55:41.473140 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":86,"threads_started":1}
I20260811 00:55:41.474403 27343 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:41.474663 27343 heartbeater.cc:511] Master 127.15.70.61:36339 requested a full tablet report, sending...
I20260811 00:55:41.474721 27340 heartbeater.cc:347] Connected to a master server at 127.15.70.60:46507
I20260811 00:55:41.474778 27340 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:41.474874 27340 heartbeater.cc:511] Master 127.15.70.60:46507 requested a full tablet report, sending...
I20260811 00:55:41.475492 26733 ts_manager.cc:194] Registered new tserver with Master: 039628cf163f4400834624b4468d7d16 (127.15.70.1:39029)
I20260811 00:55:41.475514 27034 ts_manager.cc:194] Registered new tserver with Master: 039628cf163f4400834624b4468d7d16 (127.15.70.1:39029)
Aug 11 00:55:41 dist-test-slave-h3ft krb5kdc[25620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409741, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.70.1@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM
I20260811 00:55:41.491952 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.2:33213
--local_ip_for_outbound_sockets=127.15.70.2
--tserver_master_addrs=127.15.70.62:41971
--webserver_port=36451
--webserver_interface=127.15.70.2
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.2.keytab
--principal=oryx/127.15.70.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:44081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.15.70.62:41971,127.15.70.61:36339
--tserver_master_addrs=127.15.70.62:41971,127.15.70.61:36339,127.15.70.60:46507 with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 00:55:41.494241 25766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.456470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:52369 (local address 127.15.70.62:41971)
0811 00:55:41.456535 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:41.456537 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:41.456548 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:55:41.457285 (+ 737us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:41.457288 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:41.457307 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:41.457372 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:41.485918 (+ 28546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.486632 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.487968 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.488186 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.488269 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.491158 (+ 2889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:41.491166 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:41.491167 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:41.491176 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:41.492877 (+ 1701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:41.493306 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:41.493309 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:41.493309 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:41.493372 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:41.493598 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:41.493599 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:41.493600 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:41.493736 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:41.493821 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:41.494007 (+ 186us) server_negotiation.cc:299] Negotiation successful
0811 00:55:41.494108 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 00:55:41.494267 27346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.456064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:41971 (local address 127.15.70.1:52369)
0811 00:55:41.456288 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:41.456331 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:41.457139 (+ 808us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:41.485250 (+ 28111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:41.485253 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:41.485577 (+ 324us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:41.485706 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.485711 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.486751 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.486753 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.487821 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.487826 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.488291 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.488293 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.488398 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.489134 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:41.489140 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:41.490945 (+ 1805us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:41.492987 (+ 2042us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:41.492989 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:41.492989 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:41.493209 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:41.493453 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:41.493454 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:41.493454 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:41.493526 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:41.493823 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:41.493824 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:41.493884 (+ 60us) client_negotiation.cc:769] Sending connection context
0811 00:55:41.493962 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 00:55:41.494108 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":119,"threads_started":1}
I20260811 00:55:41.494978 27342 heartbeater.cc:347] Connected to a master server at 127.15.70.62:41971
I20260811 00:55:41.495117 27342 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:41.495239 27342 heartbeater.cc:511] Master 127.15.70.62:41971 requested a full tablet report, sending...
I20260811 00:55:41.495632 25698 ts_manager.cc:194] Re-registered known tserver with Master: 039628cf163f4400834624b4468d7d16 (127.15.70.1:39029)
I20260811 00:55:41.496218 25698 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.70.1@KRBTEST.COM'} at 127.15.70.1:52369
W20260811 00:55:41.592888 27354 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:41.593178 27354 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:41.593209 27354 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:41.594517 27354 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:41.594563 27354 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:41.594591 27354 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.2
I20260811 00:55:41.596302 27354 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:44081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.2.keytab
--principal=oryx/127.15.70.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.2:33213
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.70.2
--webserver_port=36451
--tserver_master_addrs=127.15.70.62:41971,127.15.70.61:36339,127.15.70.60:46507
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27354
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.2
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:41.596580 27354 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:41.596828 27354 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:41.603434 27360 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:41.603425 27363 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:41.603425 27365 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:41.603813 27354 server_base.cc:1034] running on GCE node
I20260811 00:55:41.604206 27354 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:41.604540 27354 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:41.605719 27354 hybrid_clock.cc:648] HybridClock initialized: now 1786409741605704 us; error 32 us; skew 500 ppm
Aug 11 00:55:41 dist-test-slave-h3ft krb5kdc[25620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409741, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.70.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:41.609126 27354 init.cc:377] Logged in from keytab as oryx/127.15.70.2@KRBTEST.COM (short username oryx)
I20260811 00:55:41.609760 27354 webserver.cc:460] Webserver started at http://127.15.70.2:36451/ using document root <none> and password file <none>
I20260811 00:55:41.610013 27354 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:41.610075 27354 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:41.611792 27354 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:55:41.612618 27376 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:41.612996 27354 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:41.613129 27354 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-1/wal
uuid: "1ad222c9e98f4424b1589ffa21ffd5b3"
format_stamp: "Formatted at 2026-08-11 00:55:40 on dist-test-slave-h3ft"
server_key: "60c85a93b1cf12b886b5f7ceb83d7ccb"
server_key_iv: "ba780fdae637a05fc352ea0318eaa229"
server_key_version: "encryptionkey@0"
I20260811 00:55:41.613670 27354 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:41.622056 26472 heartbeater.cc:503] Master 127.15.70.62:41971 was elected leader, sending a full tablet report...
I20260811 00:55:41.641268 27354 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:41.644464 27354 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:41.644711 27354 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:41.645098 27354 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:55:41.645529 27354 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:55:41.645601 27354 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:41.645653 27354 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:55:41.645680 27354 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:41.653687 27354 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.2:33213
I20260811 00:55:41.653740 27575 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.2:33213 every 8 connection(s)
I20260811 00:55:41.654209 27354 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
I20260811 00:55:41.660553 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 27354
I20260811 00:55:41.660786 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 26254
Aug 11 00:55:41 dist-test-slave-h3ft krb5kdc[25620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409741, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.70.2@KRBTEST.COM for oryx/127.15.70.61@KRBTEST.COM
Aug 11 00:55:41 dist-test-slave-h3ft krb5kdc[25620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409741, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.70.2@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM
I20260811 00:55:41.674916 26817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.655799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:53237 (local address 127.15.70.61:36339)
0811 00:55:41.655861 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:41.655863 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:41.655872 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:55:41.656548 (+ 676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:41.656550 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:41.656568 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:41.656633 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:41.657366 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.658175 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.659775 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.659998 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.660036 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.667593 (+ 7557us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:41.667598 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:41.667599 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:41.667612 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:41.672528 (+ 4916us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:41.673400 (+ 872us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:41.673402 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:41.673403 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:41.673497 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:41.673883 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:41.673884 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:41.673884 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:41.674078 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:41.674128 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:41.674630 (+ 502us) server_negotiation.cc:299] Negotiation successful
0811 00:55:41.674748 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 00:55:41.675681 27583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.655571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.61:36339 (local address 127.15.70.2:53237)
0811 00:55:41.655687 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:41.655697 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:41.656168 (+ 471us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:41.656720 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:41.656722 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:41.657102 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:41.657209 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.657212 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.658332 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.658333 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.659654 (+ 1321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.659657 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.660126 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.660127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.660333 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.664545 (+ 4212us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:41.664563 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:41.667385 (+ 2822us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:41.672675 (+ 5290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:41.672692 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:41.672696 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:41.673233 (+ 537us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:41.673606 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:41.673607 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:41.673607 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:41.673793 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:41.674195 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:41.674203 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:41.674467 (+ 264us) client_negotiation.cc:769] Sending connection context
0811 00:55:41.675112 (+ 645us) client_negotiation.cc:240] Negotiation successful
0811 00:55:41.675355 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"mutex_wait_us":128,"thread_start_us":69,"threads_started":1}
I20260811 00:55:41.676219 27579 heartbeater.cc:347] Connected to a master server at 127.15.70.61:36339
I20260811 00:55:41.676331 27579 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:41.676558 27579 heartbeater.cc:511] Master 127.15.70.61:36339 requested a full tablet report, sending...
I20260811 00:55:41.676592 25766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.655198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:42857 (local address 127.15.70.62:41971)
0811 00:55:41.655297 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:41.655301 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:41.655585 (+ 284us) server_negotiation.cc:407] Connection header received
0811 00:55:41.656379 (+ 794us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:41.656380 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:41.656395 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:41.656467 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:41.657312 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.658213 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.659784 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.660100 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.660184 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.671242 (+ 11058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:41.671247 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:41.671248 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:41.671262 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:41.674851 (+ 3589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:41.675427 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:41.675430 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:41.675430 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:41.675511 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:41.675781 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:41.675782 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:41.675782 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:41.675976 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:41.676045 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:41.676294 (+ 249us) server_negotiation.cc:299] Negotiation successful
0811 00:55:41.676416 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 00:55:41.677042 27581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.655205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:41971 (local address 127.15.70.2:42857)
0811 00:55:41.655404 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:41.655459 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:41.656149 (+ 690us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:41.656481 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:41.656485 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:41.656944 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:41.657198 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.657204 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.658333 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.658333 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.659665 (+ 1332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.659667 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.660189 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.660189 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.660333 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.669056 (+ 8723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:41.669063 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:41.671027 (+ 1964us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:41.675029 (+ 4002us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:41.675030 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:41.675031 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:41.675311 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:41.675611 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:41.675612 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:41.675612 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:41.675691 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:41.676088 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:41.676089 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:41.676148 (+ 59us) client_negotiation.cc:769] Sending connection context
0811 00:55:41.676707 (+ 559us) client_negotiation.cc:240] Negotiation successful
0811 00:55:41.676859 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"mutex_wait_us":135,"thread_start_us":115,"threads_started":1}
I20260811 00:55:41.677081 26733 ts_manager.cc:194] Registered new tserver with Master: 1ad222c9e98f4424b1589ffa21ffd5b3 (127.15.70.2:33213)
I20260811 00:55:41.679824 27577 heartbeater.cc:347] Connected to a master server at 127.15.70.62:41971
I20260811 00:55:41.679917 27577 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:41.680037 27577 heartbeater.cc:511] Master 127.15.70.62:41971 requested a full tablet report, sending...
I20260811 00:55:41.680351 25698 ts_manager.cc:194] Re-registered known tserver with Master: 1ad222c9e98f4424b1589ffa21ffd5b3 (127.15.70.2:33213)
I20260811 00:55:41.680896 25698 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.70.2@KRBTEST.COM'} at 127.15.70.2:42857
Aug 11 00:55:41 dist-test-slave-h3ft krb5kdc[25620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409741, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.70.2@KRBTEST.COM for oryx/127.15.70.60@KRBTEST.COM
I20260811 00:55:41.688606 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.3:36097
--local_ip_for_outbound_sockets=127.15.70.3
--tserver_master_addrs=127.15.70.62:41971
--webserver_port=33123
--webserver_interface=127.15.70.3
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.3.keytab
--principal=oryx/127.15.70.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:44081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.15.70.62:41971,127.15.70.61:36339
--tserver_master_addrs=127.15.70.62:41971,127.15.70.61:36339,127.15.70.60:46507 with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 00:55:41.688916 27349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.655300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:59011 (local address 127.15.70.60:46507)
0811 00:55:41.655364 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:41.655366 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:41.655591 (+ 225us) server_negotiation.cc:407] Connection header received
0811 00:55:41.656294 (+ 703us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:41.656296 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:41.656321 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:41.656376 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:41.657603 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.658229 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.659738 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.660101 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.660194 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.685198 (+ 25004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:41.685202 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:41.685202 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:41.685215 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:41.687245 (+ 2030us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:41.687730 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:41.687732 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:41.687732 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:41.687856 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:41.688119 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:41.688120 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:41.688121 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:41.688320 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:41.688393 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:41.688621 (+ 228us) server_negotiation.cc:299] Negotiation successful
0811 00:55:41.688776 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 00:55:41.689033 27582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.655209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:46507 (local address 127.15.70.2:59011)
0811 00:55:41.655458 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:41.655470 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:41.656168 (+ 698us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:41.656481 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:41.656485 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:41.657437 (+ 952us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:41.657496 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.657498 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.658340 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.658342 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.659617 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.659620 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.660479 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.660480 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.660545 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.682607 (+ 22062us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:41.682613 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:41.684998 (+ 2385us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:41.687375 (+ 2377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:41.687377 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:41.687378 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:41.687615 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:41.687954 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:41.687956 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:41.687956 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:41.688034 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:41.688414 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:41.688415 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:41.688492 (+ 77us) client_negotiation.cc:769] Sending connection context
0811 00:55:41.688587 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 00:55:41.688772 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"mutex_wait_us":89,"thread_start_us":109,"threads_started":1}
I20260811 00:55:41.689476 27576 heartbeater.cc:347] Connected to a master server at 127.15.70.60:46507
I20260811 00:55:41.689561 27576 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:41.689729 27576 heartbeater.cc:511] Master 127.15.70.60:46507 requested a full tablet report, sending...
I20260811 00:55:41.690162 27034 ts_manager.cc:194] Registered new tserver with Master: 1ad222c9e98f4424b1589ffa21ffd5b3 (127.15.70.2:33213)
I20260811 00:55:41.758540 26657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.754764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:46507 (local address 127.0.0.1:58270)
0811 00:55:41.754936 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:41.754955 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:41.755120 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:41.755380 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:41.755382 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:41.755385 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:41.755466 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.755469 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.756502 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.756504 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.757358 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.757361 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.758277 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.758278 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.758334 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.758340 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 00:55:41.758388 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 00:55:41.758441 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":78}
I20260811 00:55:41.758556 27349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.754922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58270 (local address 127.15.70.60:46507)
0811 00:55:41.754984 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:41.754986 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:41.755084 (+ 98us) server_negotiation.cc:407] Connection header received
0811 00:55:41.755203 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:41.755204 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:41.755240 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:41.755325 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:41.755576 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.756395 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.757464 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.758163 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.758253 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.758346 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:41.758395 (+ 49us) server_negotiation.cc:299] Negotiation successful
0811 00:55:41.758448 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 00:55:41.759191 27051 raft_consensus.cc:1203] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260811 00:55:41.759497 27097 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [sys.catalog]: SysCatalogTable state changed. Reason: New leader a918e7b423bf4b60b146f5b794596334. Latest consensus state: current_term: 1 leader_uuid: "a918e7b423bf4b60b146f5b794596334" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 36339 } attrs { promote: false } } peers { permanent_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" member_type: NON_VOTER last_known_addr { host: "127.15.70.60" port: 46507 } attrs { promote: true } } }
I20260811 00:55:41.759652 27097 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [sys.catalog]: This master's current role is: LEARNER
W20260811 00:55:41.790680 27584 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:41.791010 27584 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:41.791083 27584 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:41.792491 27584 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:41.792568 27584 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:41.792634 27584 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.3
I20260811 00:55:41.794422 27584 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:44081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.3.keytab
--principal=oryx/127.15.70.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.3:36097
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.70.3
--webserver_port=33123
--tserver_master_addrs=127.15.70.62:41971,127.15.70.61:36339,127.15.70.60:46507
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27584
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.3
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:41.794785 27584 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:41.795174 27584 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:41.801405 27594 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:41.801497 27593 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:41.801599 27584 server_base.cc:1034] running on GCE node
W20260811 00:55:41.801405 27597 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:41.801997 27584 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:41.802310 27584 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:41.803481 27584 hybrid_clock.cc:648] HybridClock initialized: now 1786409741803458 us; error 42 us; skew 500 ppm
Aug 11 00:55:41 dist-test-slave-h3ft krb5kdc[25620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409741, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.70.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:41.807252 27584 init.cc:377] Logged in from keytab as oryx/127.15.70.3@KRBTEST.COM (short username oryx)
I20260811 00:55:41.807865 27584 webserver.cc:460] Webserver started at http://127.15.70.3:33123/ using document root <none> and password file <none>
I20260811 00:55:41.808216 27584 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:41.808338 27584 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:41.810194 27584 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:55:41.811072 27612 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:41.811277 27584 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:41.811408 27584 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-2/wal
uuid: "afdd98b8317f4185accbe7820bdee827"
format_stamp: "Formatted at 2026-08-11 00:55:40 on dist-test-slave-h3ft"
server_key: "52fdadcae670c763e5448cefad8ecd50"
server_key_iv: "e1e9112ffd46c428685c31be7436bed9"
server_key_version: "encryptionkey@0"
I20260811 00:55:41.811895 27584 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:41.831787 27584 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:41.834869 27584 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:41.835104 27584 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:41.835474 27584 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:55:41.835883 27584 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:55:41.835919 27584 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:41.835980 27584 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:55:41.835999 27584 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:41.843480 27584 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.3:36097
I20260811 00:55:41.843541 27808 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.3:36097 every 8 connection(s)
I20260811 00:55:41.843955 27584 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
I20260811 00:55:41.846830 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 27584
Aug 11 00:55:41 dist-test-slave-h3ft krb5kdc[25620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409741, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.70.3@KRBTEST.COM for oryx/127.15.70.61@KRBTEST.COM
Aug 11 00:55:41 dist-test-slave-h3ft krb5kdc[25620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409741, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.70.3@KRBTEST.COM for oryx/127.15.70.60@KRBTEST.COM
Aug 11 00:55:41 dist-test-slave-h3ft krb5kdc[25620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409741, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.70.3@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM
I20260811 00:55:41.860014 26817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.845378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:37645 (local address 127.15.70.61:36339)
0811 00:55:41.845436 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:41.845438 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:41.845591 (+ 153us) server_negotiation.cc:407] Connection header received
0811 00:55:41.846128 (+ 537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:41.846131 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:41.846153 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:41.846190 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:41.847440 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.848235 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.851404 (+ 3169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.851706 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.851747 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.855781 (+ 4034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:41.855783 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:41.855783 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:41.855791 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:41.857906 (+ 2115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:41.858525 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:41.858527 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:41.858527 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:41.858592 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:41.858929 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:41.858930 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:41.858931 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:41.859118 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:41.859176 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:41.859791 (+ 615us) server_negotiation.cc:299] Negotiation successful
0811 00:55:41.859901 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 00:55:41.860520 27349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.844990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:45849 (local address 127.15.70.60:46507)
0811 00:55:41.845053 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:41.845055 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:41.845284 (+ 229us) server_negotiation.cc:407] Connection header received
0811 00:55:41.846094 (+ 810us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:41.846096 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:41.846123 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:41.846213 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:41.847415 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.848275 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.849931 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.850275 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.850349 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.855790 (+ 5441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:41.855791 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:41.855792 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:41.855800 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:41.858950 (+ 3150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:41.859615 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:41.859616 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:41.859616 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:41.859677 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:41.859884 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:41.859885 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:41.859886 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:41.860021 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:41.860086 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:41.860318 (+ 232us) server_negotiation.cc:299] Negotiation successful
0811 00:55:41.860427 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 00:55:41.860736 27816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.844872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:46507 (local address 127.15.70.3:45849)
0811 00:55:41.845127 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:41.845172 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:41.845942 (+ 770us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:41.846283 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:41.846287 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:41.846875 (+ 588us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:41.847285 (+ 410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.847292 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.848416 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.848418 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.849830 (+ 1412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.849832 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.850908 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.850909 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.851084 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.851846 (+ 762us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:41.851858 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:41.855691 (+ 3833us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:41.859205 (+ 3514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:41.859207 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:41.859207 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:41.859456 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:41.859750 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:41.859751 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:41.859751 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:41.859812 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:41.860116 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:41.860116 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:41.860165 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 00:55:41.860237 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 00:55:41.860433 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201,"mutex_wait_us":82,"thread_start_us":118,"threads_started":1}
I20260811 00:55:41.861263 27814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.845264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.61:36339 (local address 127.15.70.3:37645)
0811 00:55:41.845502 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:41.845512 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:41.845970 (+ 458us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:41.846297 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:41.846297 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:41.847223 (+ 926us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:41.847312 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.847315 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.848409 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.848410 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.851248 (+ 2838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.851252 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.851875 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.851876 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.851947 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.852497 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:41.852502 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:41.855654 (+ 3152us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:41.858020 (+ 2366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:41.858030 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:41.858033 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:41.858421 (+ 388us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:41.858663 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:41.858663 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:41.858664 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:41.858832 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:41.859217 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:41.859225 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:41.859439 (+ 214us) client_negotiation.cc:769] Sending connection context
0811 00:55:41.860202 (+ 763us) client_negotiation.cc:240] Negotiation successful
0811 00:55:41.861146 (+ 944us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221,"mutex_wait_us":1795,"thread_start_us":77,"threads_started":1}
I20260811 00:55:41.861516 27809 heartbeater.cc:347] Connected to a master server at 127.15.70.60:46507
I20260811 00:55:41.861673 27809 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:41.861933 27809 heartbeater.cc:511] Master 127.15.70.60:46507 requested a full tablet report, sending...
I20260811 00:55:41.862363 27829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.849126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45262 (local address 127.15.70.61:36339)
0811 00:55:41.849421 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:41.849423 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:41.849583 (+ 160us) server_negotiation.cc:407] Connection header received
0811 00:55:41.849608 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:41.849609 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:41.849620 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:41.849684 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:41.850410 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.851181 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.852303 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.852642 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.852707 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.854277 (+ 1570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:41.854279 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:41.854279 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:41.854287 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:41.858750 (+ 4463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:41.860239 (+ 1489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:41.860239 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:41.860240 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:41.860297 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:41.860721 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:41.860722 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:41.860722 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:41.860859 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:41.862091 (+ 1232us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:41.862141 (+ 50us) server_negotiation.cc:299] Negotiation successful
0811 00:55:41.862240 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":272,"thread_start_us":76,"threads_started":1}
I20260811 00:55:41.862644 25766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.844927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:39895 (local address 127.15.70.62:41971)
0811 00:55:41.845004 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:41.845007 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:41.845475 (+ 468us) server_negotiation.cc:407] Connection header received
0811 00:55:41.846300 (+ 825us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:41.846302 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:41.846319 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:41.846385 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:41.847428 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.848275 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.850441 (+ 2166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.850749 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.850811 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.857263 (+ 6452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:41.857265 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:41.857265 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:41.857275 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:41.859104 (+ 1829us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:41.859829 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:41.859831 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:41.859832 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:41.859907 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:41.860447 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:41.860449 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:41.860449 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:41.860608 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:41.860654 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:41.862431 (+ 1777us) server_negotiation.cc:299] Negotiation successful
0811 00:55:41.862527 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 00:55:41.862816 27828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.848886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60876 (local address 127.15.70.62:41971)
0811 00:55:41.849213 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:41.849215 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:41.849223 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:55:41.849246 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:41.849247 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:41.849260 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:41.849343 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:41.850343 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.851467 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.852812 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.853125 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.853174 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.855027 (+ 1853us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:41.855029 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:41.855030 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:41.855038 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:41.859491 (+ 4453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:41.860951 (+ 1460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:41.860952 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:41.860952 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:41.861016 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:41.861591 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:41.861592 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:41.861593 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:41.861726 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:41.861819 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:41.862512 (+ 693us) server_negotiation.cc:299] Negotiation successful
0811 00:55:41.862592 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291,"thread_start_us":69,"threads_started":1}
I20260811 00:55:41.863070 27034 ts_manager.cc:194] Registered new tserver with Master: afdd98b8317f4185accbe7820bdee827 (127.15.70.3:36097)
I20260811 00:55:41.863245 27818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.844871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:41971 (local address 127.15.70.3:39895)
0811 00:55:41.845394 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:41.845405 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:41.845942 (+ 537us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:41.846462 (+ 520us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:41.846462 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:41.846883 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:41.847285 (+ 402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.847292 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.848428 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.848429 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.850349 (+ 1920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.850352 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.852207 (+ 1855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.852208 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.852273 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.854841 (+ 2568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:41.854847 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:41.857130 (+ 2283us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:41.859523 (+ 2393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:41.859524 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:41.859524 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:41.859733 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:41.859990 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:41.859990 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:41.859991 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:41.860048 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:41.862240 (+ 2192us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:41.862241 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:41.862288 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 00:55:41.862986 (+ 698us) client_negotiation.cc:240] Negotiation successful
0811 00:55:41.863129 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":486,"mutex_wait_us":42,"spinlock_wait_cycles":11008,"thread_start_us":125,"threads_started":1}
I20260811 00:55:41.863668 27811 heartbeater.cc:347] Connected to a master server at 127.15.70.62:41971
I20260811 00:55:41.863725 27811 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:41.863806 27811 heartbeater.cc:511] Master 127.15.70.62:41971 requested a full tablet report, sending...
I20260811 00:55:41.864077 25698 ts_manager.cc:194] Re-registered known tserver with Master: afdd98b8317f4185accbe7820bdee827 (127.15.70.3:36097)
I20260811 00:55:41.864490 27812 heartbeater.cc:347] Connected to a master server at 127.15.70.61:36339
I20260811 00:55:41.864568 27812 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:41.864606 25698 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.70.3@KRBTEST.COM'} at 127.15.70.3:39895
I20260811 00:55:41.864648 27812 heartbeater.cc:511] Master 127.15.70.61:36339 requested a full tablet report, sending...
I20260811 00:55:41.864969 26733 ts_manager.cc:194] Registered new tserver with Master: afdd98b8317f4185accbe7820bdee827 (127.15.70.3:36097)
I20260811 00:55:41.865921 27833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.849428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58284 (local address 127.15.70.60:46507)
0811 00:55:41.854321 (+ 4893us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:41.854324 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:41.854463 (+ 139us) server_negotiation.cc:407] Connection header received
0811 00:55:41.854573 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:41.854574 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:41.854591 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:41.854647 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:41.855382 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.856147 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.857241 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.857580 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.857628 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.860719 (+ 3091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:41.860720 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:41.860721 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:41.860729 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:41.864192 (+ 3463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:41.864913 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:41.864914 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:41.864915 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:41.864986 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:41.865305 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:41.865306 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:41.865307 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:41.865458 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:41.865564 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:41.865721 (+ 157us) server_negotiation.cc:299] Negotiation successful
0811 00:55:41.865816 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4865,"thread_start_us":78,"threads_started":1}
I20260811 00:55:41.864794 25697 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60876:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:55:41.867523 25697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:55:41.868500 27836 sys_catalog.cc:455] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a918e7b423bf4b60b146f5b794596334" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 36339 } attrs { promote: false } } peers { permanent_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" member_type: NON_VOTER last_known_addr { host: "127.15.70.60" port: 46507 } attrs { promote: true } } }
I20260811 00:55:41.868609 27836 sys_catalog.cc:458] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [sys.catalog]: This master's current role is: LEADER
I20260811 00:55:41.870052 27836 raft_consensus.cc:1050] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334: attempting to promote NON_VOTER a5410fd331ff4f8787e2ef70cd01d43f to VOTER
I20260811 00:55:41.870329 27836 consensus_queue.cc:237] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 36339 } attrs { promote: false } } peers { permanent_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 46507 } attrs { promote: false } }
I20260811 00:55:41.870863 27049 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [term 1 LEARNER]: Refusing update from remote peer a918e7b423bf4b60b146f5b794596334: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260811 00:55:41.870874 26749 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [term 1 FOLLOWER]: Refusing update from remote peer a918e7b423bf4b60b146f5b794596334: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260811 00:55:41.871109 27837 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 46507 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260811 00:55:41.871212 26983 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 36339 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260811 00:55:41.871881 27837 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, a5410fd331ff4f8787e2ef70cd01d43f (127.15.70.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 36339 } attrs { promote: false } } peers { permanent_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 46507 } attrs { promote: false } } }
I20260811 00:55:41.872047 26749 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, a5410fd331ff4f8787e2ef70cd01d43f (127.15.70.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 36339 } attrs { promote: false } } peers { permanent_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 46507 } attrs { promote: false } } }
I20260811 00:55:41.872979 27836 sys_catalog.cc:455] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "a918e7b423bf4b60b146f5b794596334" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 36339 } attrs { promote: false } } peers { permanent_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 46507 } attrs { promote: false } } }
I20260811 00:55:41.873083 27836 sys_catalog.cc:458] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [sys.catalog]: This master's current role is: LEADER
I20260811 00:55:41.873162 27857 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a918e7b423bf4b60b146f5b794596334" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 36339 } attrs { promote: false } } peers { permanent_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 46507 } attrs { promote: false } } }
I20260811 00:55:41.873272 27857 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [sys.catalog]: This master's current role is: FOLLOWER
I20260811 00:55:41.873550 27049 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, a5410fd331ff4f8787e2ef70cd01d43f (127.15.70.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 36339 } attrs { promote: false } } peers { permanent_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 46507 } attrs { promote: false } } }
I20260811 00:55:41.874711 27097 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a918e7b423bf4b60b146f5b794596334" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 36339 } attrs { promote: false } } peers { permanent_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 46507 } attrs { promote: false } } }
I20260811 00:55:41.874802 27097 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [sys.catalog]: This master's current role is: FOLLOWER
I20260811 00:55:41.875165 26983 sys_catalog.cc:455] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a918e7b423bf4b60b146f5b794596334" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 36339 } attrs { promote: false } } peers { permanent_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 46507 } attrs { promote: false } } }
I20260811 00:55:41.875253 27837 sys_catalog.cc:455] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a918e7b423bf4b60b146f5b794596334" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 36339 } attrs { promote: false } } peers { permanent_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 46507 } attrs { promote: false } } }
I20260811 00:55:41.875259 26983 sys_catalog.cc:458] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [sys.catalog]: This master's current role is: LEADER
I20260811 00:55:41.875355 27837 sys_catalog.cc:458] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334 [sys.catalog]: This master's current role is: LEADER
I20260811 00:55:41.880805 26657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.876359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.2:33213 (local address 127.0.0.1:42414)
0811 00:55:41.876612 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:41.876628 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:41.876678 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:41.877153 (+ 475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:41.877154 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:41.877156 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:41.877222 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.877225 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.878682 (+ 1457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.878683 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.879645 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.879649 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.880620 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.880621 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.880666 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.880669 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:55:41.880704 (+ 35us) client_negotiation.cc:240] Negotiation successful
0811 00:55:41.880739 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"mutex_wait_us":3}
I20260811 00:55:41.881000 27868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.876594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42414 (local address 127.15.70.2:33213)
0811 00:55:41.876970 (+ 376us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:41.876973 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:41.876982 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:55:41.877025 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:41.877027 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:41.877043 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:41.877126 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:41.877332 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.878568 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.879754 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.880523 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.880616 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.880716 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:41.880745 (+ 29us) server_negotiation.cc:299] Negotiation successful
0811 00:55:41.880783 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":126,"threads_started":1}
I20260811 00:55:41.881443 27864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.876421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:36097 (local address 127.0.0.1:53986)
0811 00:55:41.877263 (+ 842us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:41.877276 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:41.877339 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:41.877620 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:41.877621 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:41.877623 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:41.877707 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.877710 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.878960 (+ 1250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.878960 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.880033 (+ 1073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.880034 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.881180 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.881181 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.881254 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.881259 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 00:55:41.881315 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 00:55:41.881365 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":817,"thread_start_us":135,"threads_started":1}
I20260811 00:55:41.881778 27867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.876570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53986 (local address 127.15.70.3:36097)
0811 00:55:41.876787 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:41.876793 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:41.877333 (+ 540us) server_negotiation.cc:407] Connection header received
0811 00:55:41.877427 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:41.877429 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:41.877450 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:41.877533 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:41.877798 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.878869 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.880127 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.880854 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.881098 (+ 244us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.881192 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:41.881639 (+ 447us) server_negotiation.cc:299] Negotiation successful
0811 00:55:41.881692 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":112,"threads_started":1}
I20260811 00:55:41.881939 27462 tablet_service.cc:1467] Processing CreateTablet for tablet 13c1f4286dac4ea381828827fb2a07b9 (DEFAULT_TABLE table=test-table [id=6b5440ea721b4561b7c79c0935e147ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:55:41.882477 27462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13c1f4286dac4ea381828827fb2a07b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:41.882421 27687 tablet_service.cc:1467] Processing CreateTablet for tablet 13c1f4286dac4ea381828827fb2a07b9 (DEFAULT_TABLE table=test-table [id=6b5440ea721b4561b7c79c0935e147ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:55:41.882660 27869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.877040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40604 (local address 127.15.70.1:39029)
0811 00:55:41.877284 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:41.877295 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:41.877559 (+ 264us) server_negotiation.cc:407] Connection header received
0811 00:55:41.877610 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:41.877613 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:41.877629 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:41.877705 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:41.877973 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.878698 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.881229 (+ 2531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.882027 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.882104 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.882183 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:41.882502 (+ 319us) server_negotiation.cc:299] Negotiation successful
0811 00:55:41.882565 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":128,"threads_started":1}
I20260811 00:55:41.882858 27687 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13c1f4286dac4ea381828827fb2a07b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:41.882972 27863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.876461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:39029 (local address 127.0.0.1:40604)
0811 00:55:41.877436 (+ 975us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:41.877446 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:41.877502 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:41.877791 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:41.877791 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:41.877793 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:41.877829 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.877831 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.878800 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.878801 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.880029 (+ 1228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.880033 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.882225 (+ 2192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.882226 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.882291 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.882296 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 00:55:41.882764 (+ 468us) client_negotiation.cc:240] Negotiation successful
0811 00:55:41.882817 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":951,"thread_start_us":103,"threads_started":1}
I20260811 00:55:41.883785 27222 tablet_service.cc:1467] Processing CreateTablet for tablet 13c1f4286dac4ea381828827fb2a07b9 (DEFAULT_TABLE table=test-table [id=6b5440ea721b4561b7c79c0935e147ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:55:41.884178 27222 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13c1f4286dac4ea381828827fb2a07b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:41.886126 27870 tablet_bootstrap.cc:492] T 13c1f4286dac4ea381828827fb2a07b9 P 1ad222c9e98f4424b1589ffa21ffd5b3: Bootstrap starting.
I20260811 00:55:41.886901 27870 tablet_bootstrap.cc:654] T 13c1f4286dac4ea381828827fb2a07b9 P 1ad222c9e98f4424b1589ffa21ffd5b3: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:41.887324 27870 log.cc:824] T 13c1f4286dac4ea381828827fb2a07b9 P 1ad222c9e98f4424b1589ffa21ffd5b3: Log is configured to *not* fsync() on all Append() calls
I20260811 00:55:41.887475 27872 tablet_bootstrap.cc:492] T 13c1f4286dac4ea381828827fb2a07b9 P afdd98b8317f4185accbe7820bdee827: Bootstrap starting.
I20260811 00:55:41.888195 27876 tablet_bootstrap.cc:492] T 13c1f4286dac4ea381828827fb2a07b9 P 039628cf163f4400834624b4468d7d16: Bootstrap starting.
I20260811 00:55:41.888370 27872 tablet_bootstrap.cc:654] T 13c1f4286dac4ea381828827fb2a07b9 P afdd98b8317f4185accbe7820bdee827: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:41.888437 27870 tablet_bootstrap.cc:492] T 13c1f4286dac4ea381828827fb2a07b9 P 1ad222c9e98f4424b1589ffa21ffd5b3: No bootstrap required, opened a new log
I20260811 00:55:41.888504 27870 ts_tablet_manager.cc:1397] T 13c1f4286dac4ea381828827fb2a07b9 P 1ad222c9e98f4424b1589ffa21ffd5b3: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 00:55:41.888777 27872 log.cc:824] T 13c1f4286dac4ea381828827fb2a07b9 P afdd98b8317f4185accbe7820bdee827: Log is configured to *not* fsync() on all Append() calls
I20260811 00:55:41.888900 27876 tablet_bootstrap.cc:654] T 13c1f4286dac4ea381828827fb2a07b9 P 039628cf163f4400834624b4468d7d16: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:41.889245 27876 log.cc:824] T 13c1f4286dac4ea381828827fb2a07b9 P 039628cf163f4400834624b4468d7d16: Log is configured to *not* fsync() on all Append() calls
I20260811 00:55:41.889654 27872 tablet_bootstrap.cc:492] T 13c1f4286dac4ea381828827fb2a07b9 P afdd98b8317f4185accbe7820bdee827: No bootstrap required, opened a new log
I20260811 00:55:41.889729 27872 ts_tablet_manager.cc:1397] T 13c1f4286dac4ea381828827fb2a07b9 P afdd98b8317f4185accbe7820bdee827: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 00:55:41.890110 27876 tablet_bootstrap.cc:492] T 13c1f4286dac4ea381828827fb2a07b9 P 039628cf163f4400834624b4468d7d16: No bootstrap required, opened a new log
I20260811 00:55:41.890197 27876 ts_tablet_manager.cc:1397] T 13c1f4286dac4ea381828827fb2a07b9 P 039628cf163f4400834624b4468d7d16: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 00:55:41.891466 27870 raft_consensus.cc:348] T 13c1f4286dac4ea381828827fb2a07b9 P 1ad222c9e98f4424b1589ffa21ffd5b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad222c9e98f4424b1589ffa21ffd5b3" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 33213 } } peers { permanent_uuid: "afdd98b8317f4185accbe7820bdee827" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36097 } } peers { permanent_uuid: "039628cf163f4400834624b4468d7d16" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39029 } }
I20260811 00:55:41.891667 27870 raft_consensus.cc:374] T 13c1f4286dac4ea381828827fb2a07b9 P 1ad222c9e98f4424b1589ffa21ffd5b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:41.891717 27870 raft_consensus.cc:729] T 13c1f4286dac4ea381828827fb2a07b9 P 1ad222c9e98f4424b1589ffa21ffd5b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad222c9e98f4424b1589ffa21ffd5b3, State: Initialized, Role: FOLLOWER
I20260811 00:55:41.891919 27870 consensus_queue.cc:260] T 13c1f4286dac4ea381828827fb2a07b9 P 1ad222c9e98f4424b1589ffa21ffd5b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad222c9e98f4424b1589ffa21ffd5b3" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 33213 } } peers { permanent_uuid: "afdd98b8317f4185accbe7820bdee827" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36097 } } peers { permanent_uuid: "039628cf163f4400834624b4468d7d16" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39029 } }
I20260811 00:55:41.892316 27577 heartbeater.cc:503] Master 127.15.70.62:41971 was elected leader, sending a full tablet report...
I20260811 00:55:41.892544 27870 ts_tablet_manager.cc:1428] T 13c1f4286dac4ea381828827fb2a07b9 P 1ad222c9e98f4424b1589ffa21ffd5b3: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260811 00:55:41.892706 27872 raft_consensus.cc:348] T 13c1f4286dac4ea381828827fb2a07b9 P afdd98b8317f4185accbe7820bdee827 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad222c9e98f4424b1589ffa21ffd5b3" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 33213 } } peers { permanent_uuid: "afdd98b8317f4185accbe7820bdee827" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36097 } } peers { permanent_uuid: "039628cf163f4400834624b4468d7d16" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39029 } }
I20260811 00:55:41.892897 27872 raft_consensus.cc:374] T 13c1f4286dac4ea381828827fb2a07b9 P afdd98b8317f4185accbe7820bdee827 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:41.892932 27872 raft_consensus.cc:729] T 13c1f4286dac4ea381828827fb2a07b9 P afdd98b8317f4185accbe7820bdee827 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afdd98b8317f4185accbe7820bdee827, State: Initialized, Role: FOLLOWER
I20260811 00:55:41.893059 27872 consensus_queue.cc:260] T 13c1f4286dac4ea381828827fb2a07b9 P afdd98b8317f4185accbe7820bdee827 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad222c9e98f4424b1589ffa21ffd5b3" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 33213 } } peers { permanent_uuid: "afdd98b8317f4185accbe7820bdee827" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36097 } } peers { permanent_uuid: "039628cf163f4400834624b4468d7d16" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39029 } }
I20260811 00:55:41.893321 27872 ts_tablet_manager.cc:1428] T 13c1f4286dac4ea381828827fb2a07b9 P afdd98b8317f4185accbe7820bdee827: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260811 00:55:41.893554 27811 heartbeater.cc:503] Master 127.15.70.62:41971 was elected leader, sending a full tablet report...
I20260811 00:55:41.894121 27876 raft_consensus.cc:348] T 13c1f4286dac4ea381828827fb2a07b9 P 039628cf163f4400834624b4468d7d16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad222c9e98f4424b1589ffa21ffd5b3" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 33213 } } peers { permanent_uuid: "afdd98b8317f4185accbe7820bdee827" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36097 } } peers { permanent_uuid: "039628cf163f4400834624b4468d7d16" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39029 } }
I20260811 00:55:41.894362 27876 raft_consensus.cc:374] T 13c1f4286dac4ea381828827fb2a07b9 P 039628cf163f4400834624b4468d7d16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:41.894421 27876 raft_consensus.cc:729] T 13c1f4286dac4ea381828827fb2a07b9 P 039628cf163f4400834624b4468d7d16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039628cf163f4400834624b4468d7d16, State: Initialized, Role: FOLLOWER
I20260811 00:55:41.894583 27876 consensus_queue.cc:260] T 13c1f4286dac4ea381828827fb2a07b9 P 039628cf163f4400834624b4468d7d16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad222c9e98f4424b1589ffa21ffd5b3" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 33213 } } peers { permanent_uuid: "afdd98b8317f4185accbe7820bdee827" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36097 } } peers { permanent_uuid: "039628cf163f4400834624b4468d7d16" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39029 } }
I20260811 00:55:41.894990 27876 ts_tablet_manager.cc:1428] T 13c1f4286dac4ea381828827fb2a07b9 P 039628cf163f4400834624b4468d7d16: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260811 00:55:41.895124 27342 heartbeater.cc:503] Master 127.15.70.62:41971 was elected leader, sending a full tablet report...
W20260811 00:55:41.905223 27580 tablet.cc:2369] T 13c1f4286dac4ea381828827fb2a07b9 P 1ad222c9e98f4424b1589ffa21ffd5b3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 00:55:41.948479 27880 raft_consensus.cc:482] T 13c1f4286dac4ea381828827fb2a07b9 P 1ad222c9e98f4424b1589ffa21ffd5b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:55:41.948657 27880 raft_consensus.cc:504] T 13c1f4286dac4ea381828827fb2a07b9 P 1ad222c9e98f4424b1589ffa21ffd5b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad222c9e98f4424b1589ffa21ffd5b3" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 33213 } } peers { permanent_uuid: "afdd98b8317f4185accbe7820bdee827" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36097 } } peers { permanent_uuid: "039628cf163f4400834624b4468d7d16" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39029 } }
I20260811 00:55:41.949050 27883 raft_consensus.cc:482] T 13c1f4286dac4ea381828827fb2a07b9 P 039628cf163f4400834624b4468d7d16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:55:41.949189 27883 raft_consensus.cc:504] T 13c1f4286dac4ea381828827fb2a07b9 P 039628cf163f4400834624b4468d7d16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad222c9e98f4424b1589ffa21ffd5b3" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 33213 } } peers { permanent_uuid: "afdd98b8317f4185accbe7820bdee827" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36097 } } peers { permanent_uuid: "039628cf163f4400834624b4468d7d16" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39029 } }
I20260811 00:55:41.949290 27880 leader_election.cc:288] T 13c1f4286dac4ea381828827fb2a07b9 P 1ad222c9e98f4424b1589ffa21ffd5b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afdd98b8317f4185accbe7820bdee827 (127.15.70.3:36097), 039628cf163f4400834624b4468d7d16 (127.15.70.1:39029)
I20260811 00:55:41.950372 27883 leader_election.cc:288] T 13c1f4286dac4ea381828827fb2a07b9 P 039628cf163f4400834624b4468d7d16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ad222c9e98f4424b1589ffa21ffd5b3 (127.15.70.2:33213), afdd98b8317f4185accbe7820bdee827 (127.15.70.3:36097)
I20260811 00:55:41.953330 27582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.949482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:36097 (local address 127.15.70.2:53603)
0811 00:55:41.949589 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:41.949606 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:41.949662 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:41.949821 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:41.949822 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:41.949824 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:41.949934 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.949936 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.950965 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.950966 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.952233 (+ 1267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.952236 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.953064 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.953065 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.953139 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.953144 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 00:55:41.953190 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 00:55:41.953241 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77}
I20260811 00:55:41.953766 27867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.949571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:53603 (local address 127.15.70.3:36097)
0811 00:55:41.949627 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:41.949630 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:41.949647 (+ 17us) server_negotiation.cc:407] Connection header received
0811 00:55:41.949735 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:41.949736 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:41.949751 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:41.949813 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:41.950066 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.950873 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.952352 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.952959 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.953021 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.953034 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:41.953547 (+ 513us) server_negotiation.cc:299] Negotiation successful
0811 00:55:41.953693 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":86,"server-negotiator.queue_time_us":22}
I20260811 00:55:41.953801 27346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.949979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.2:33213 (local address 127.15.70.1:47125)
0811 00:55:41.950079 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:41.950088 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:41.950118 (+ 30us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:41.950580 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:41.950581 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:41.950583 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:41.950677 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.950680 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.951626 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.951627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.952779 (+ 1152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.952782 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.953537 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.953538 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.953628 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.953632 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:55:41.953681 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 00:55:41.953724 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":84}
I20260811 00:55:41.954092 27868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.950113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:47125 (local address 127.15.70.2:33213)
0811 00:55:41.950329 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:41.950331 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:41.950340 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:55:41.950361 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:41.950362 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:41.950373 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:41.950428 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:41.950768 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.951502 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.952880 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.953416 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.953487 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.953498 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:41.953957 (+ 459us) server_negotiation.cc:299] Negotiation successful
0811 00:55:41.953998 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":196}
I20260811 00:55:41.954223 27583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.949524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:39029 (local address 127.15.70.2:58001)
0811 00:55:41.949746 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:41.949756 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:41.949784 (+ 28us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:41.950192 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:41.950193 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:41.950194 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:41.950276 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.950278 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.951761 (+ 1483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.951762 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.952992 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.952995 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.953956 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.953957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.954031 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.954034 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:55:41.954086 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 00:55:41.954131 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":209}
I20260811 00:55:41.954236 27869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.949860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:58001 (local address 127.15.70.1:39029)
0811 00:55:41.949912 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:41.949914 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:41.949923 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:55:41.949964 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:41.949965 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:41.949978 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:41.950027 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:41.950776 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.951657 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.953274 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.953819 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.953893 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.953906 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:41.954122 (+ 216us) server_negotiation.cc:299] Negotiation successful
0811 00:55:41.954171 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 00:55:41.954406 27496 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13c1f4286dac4ea381828827fb2a07b9" candidate_uuid: "039628cf163f4400834624b4468d7d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad222c9e98f4424b1589ffa21ffd5b3" is_pre_election: true
I20260811 00:55:41.954521 27496 raft_consensus.cc:2454] T 13c1f4286dac4ea381828827fb2a07b9 P 1ad222c9e98f4424b1589ffa21ffd5b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 039628cf163f4400834624b4468d7d16 in term 0.
I20260811 00:55:41.954464 27724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13c1f4286dac4ea381828827fb2a07b9" candidate_uuid: "1ad222c9e98f4424b1589ffa21ffd5b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afdd98b8317f4185accbe7820bdee827" is_pre_election: true
I20260811 00:55:41.954640 27724 raft_consensus.cc:2454] T 13c1f4286dac4ea381828827fb2a07b9 P afdd98b8317f4185accbe7820bdee827 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ad222c9e98f4424b1589ffa21ffd5b3 in term 0.
I20260811 00:55:41.954821 27147 leader_election.cc:302] T 13c1f4286dac4ea381828827fb2a07b9 P 039628cf163f4400834624b4468d7d16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039628cf163f4400834624b4468d7d16, 1ad222c9e98f4424b1589ffa21ffd5b3; no voters:
I20260811 00:55:41.954952 27382 leader_election.cc:302] T 13c1f4286dac4ea381828827fb2a07b9 P 1ad222c9e98f4424b1589ffa21ffd5b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad222c9e98f4424b1589ffa21ffd5b3, afdd98b8317f4185accbe7820bdee827; no voters:
I20260811 00:55:41.954989 27883 raft_consensus.cc:2781] T 13c1f4286dac4ea381828827fb2a07b9 P 039628cf163f4400834624b4468d7d16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:55:41.955087 27883 raft_consensus.cc:482] T 13c1f4286dac4ea381828827fb2a07b9 P 039628cf163f4400834624b4468d7d16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:55:41.955143 27880 raft_consensus.cc:2781] T 13c1f4286dac4ea381828827fb2a07b9 P 1ad222c9e98f4424b1589ffa21ffd5b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:55:41.955121 27883 raft_consensus.cc:3037] T 13c1f4286dac4ea381828827fb2a07b9 P 039628cf163f4400834624b4468d7d16 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:41.955112 27253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13c1f4286dac4ea381828827fb2a07b9" candidate_uuid: "1ad222c9e98f4424b1589ffa21ffd5b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039628cf163f4400834624b4468d7d16" is_pre_election: true
I20260811 00:55:41.955199 27880 raft_consensus.cc:482] T 13c1f4286dac4ea381828827fb2a07b9 P 1ad222c9e98f4424b1589ffa21ffd5b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:55:41.955224 27880 raft_consensus.cc:3037] T 13c1f4286dac4ea381828827fb2a07b9 P 1ad222c9e98f4424b1589ffa21ffd5b3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:41.955950 27347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.950181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:36097 (local address 127.15.70.1:53341)
0811 00:55:41.950486 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:41.950497 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:41.950533 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:41.950837 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:41.950838 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:41.950841 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:41.950913 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.950914 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.952011 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.952012 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.953163 (+ 1151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:41.953167 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.955633 (+ 2466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.955634 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:41.955719 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.955723 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:55:41.955796 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 00:55:41.955848 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282}
I20260811 00:55:41.955956 27884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.950376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:53341 (local address 127.15.70.3:36097)
0811 00:55:41.950685 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:41.950688 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:41.950696 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:55:41.950721 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:41.950722 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:41.950734 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:41.951041 (+ 307us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:41.951082 (+ 41us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.951919 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.953296 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.955530 (+ 2234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.955611 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.955624 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:41.955824 (+ 200us) server_negotiation.cc:299] Negotiation successful
0811 00:55:41.955866 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281,"thread_start_us":156,"threads_started":1}
W20260811 00:55:41.956373 27344 tablet.cc:2369] T 13c1f4286dac4ea381828827fb2a07b9 P 039628cf163f4400834624b4468d7d16: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 00:55:41.956468 27883 raft_consensus.cc:504] T 13c1f4286dac4ea381828827fb2a07b9 P 039628cf163f4400834624b4468d7d16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad222c9e98f4424b1589ffa21ffd5b3" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 33213 } } peers { permanent_uuid: "afdd98b8317f4185accbe7820bdee827" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36097 } } peers { permanent_uuid: "039628cf163f4400834624b4468d7d16" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39029 } }
I20260811 00:55:41.956475 27880 raft_consensus.cc:504] T 13c1f4286dac4ea381828827fb2a07b9 P 1ad222c9e98f4424b1589ffa21ffd5b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad222c9e98f4424b1589ffa21ffd5b3" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 33213 } } peers { permanent_uuid: "afdd98b8317f4185accbe7820bdee827" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36097 } } peers { permanent_uuid: "039628cf163f4400834624b4468d7d16" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39029 } }
I20260811 00:55:41.956595 27253 raft_consensus.cc:2379] T 13c1f4286dac4ea381828827fb2a07b9 P 039628cf163f4400834624b4468d7d16 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ad222c9e98f4424b1589ffa21ffd5b3 in current term 1: Already voted for candidate 039628cf163f4400834624b4468d7d16 in this term.
I20260811 00:55:41.956825 27252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13c1f4286dac4ea381828827fb2a07b9" candidate_uuid: "1ad222c9e98f4424b1589ffa21ffd5b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039628cf163f4400834624b4468d7d16"
I20260811 00:55:41.956883 27723 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13c1f4286dac4ea381828827fb2a07b9" candidate_uuid: "039628cf163f4400834624b4468d7d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afdd98b8317f4185accbe7820bdee827" is_pre_election: true
I20260811 00:55:41.956905 27724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13c1f4286dac4ea381828827fb2a07b9" candidate_uuid: "1ad222c9e98f4424b1589ffa21ffd5b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afdd98b8317f4185accbe7820bdee827"
I20260811 00:55:41.957000 27723 raft_consensus.cc:2454] T 13c1f4286dac4ea381828827fb2a07b9 P afdd98b8317f4185accbe7820bdee827 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 039628cf163f4400834624b4468d7d16 in term 0.
I20260811 00:55:41.957221 27883 leader_election.cc:288] T 13c1f4286dac4ea381828827fb2a07b9 P 039628cf163f4400834624b4468d7d16 [CANDIDATE]: Term 1 election: Requested vote from peers 1ad222c9e98f4424b1589ffa21ffd5b3 (127.15.70.2:33213), afdd98b8317f4185accbe7820bdee827 (127.15.70.3:36097)
I20260811 00:55:41.957238 27496 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13c1f4286dac4ea381828827fb2a07b9" candidate_uuid: "039628cf163f4400834624b4468d7d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad222c9e98f4424b1589ffa21ffd5b3"
I20260811 00:55:41.957288 27880 leader_election.cc:288] T 13c1f4286dac4ea381828827fb2a07b9 P 1ad222c9e98f4424b1589ffa21ffd5b3 [CANDIDATE]: Term 1 election: Requested vote from peers afdd98b8317f4185accbe7820bdee827 (127.15.70.3:36097), 039628cf163f4400834624b4468d7d16 (127.15.70.1:39029)
I20260811 00:55:41.957333 27496 raft_consensus.cc:2379] T 13c1f4286dac4ea381828827fb2a07b9 P 1ad222c9e98f4424b1589ffa21ffd5b3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 039628cf163f4400834624b4468d7d16 in current term 1: Already voted for candidate 1ad222c9e98f4424b1589ffa21ffd5b3 in this term.
I20260811 00:55:41.957391 27382 leader_election.cc:302] T 13c1f4286dac4ea381828827fb2a07b9 P 1ad222c9e98f4424b1589ffa21ffd5b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ad222c9e98f4424b1589ffa21ffd5b3; no voters: 039628cf163f4400834624b4468d7d16, afdd98b8317f4185accbe7820bdee827
I20260811 00:55:41.957491 27880 raft_consensus.cc:2726] T 13c1f4286dac4ea381828827fb2a07b9 P 1ad222c9e98f4424b1589ffa21ffd5b3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260811 00:55:41.957472 27724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13c1f4286dac4ea381828827fb2a07b9" candidate_uuid: "039628cf163f4400834624b4468d7d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afdd98b8317f4185accbe7820bdee827"
I20260811 00:55:41.957544 27724 raft_consensus.cc:3037] T 13c1f4286dac4ea381828827fb2a07b9 P afdd98b8317f4185accbe7820bdee827 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:41.958606 27724 raft_consensus.cc:2454] T 13c1f4286dac4ea381828827fb2a07b9 P afdd98b8317f4185accbe7820bdee827 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 039628cf163f4400834624b4468d7d16 in term 1.
I20260811 00:55:41.958825 27148 leader_election.cc:302] T 13c1f4286dac4ea381828827fb2a07b9 P 039628cf163f4400834624b4468d7d16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 039628cf163f4400834624b4468d7d16, afdd98b8317f4185accbe7820bdee827; no voters: 1ad222c9e98f4424b1589ffa21ffd5b3
I20260811 00:55:41.958963 27883 raft_consensus.cc:2781] T 13c1f4286dac4ea381828827fb2a07b9 P 039628cf163f4400834624b4468d7d16 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:55:41.959175 27883 raft_consensus.cc:686] T 13c1f4286dac4ea381828827fb2a07b9 P 039628cf163f4400834624b4468d7d16 [term 1 LEADER]: Becoming Leader. State: Replica: 039628cf163f4400834624b4468d7d16, State: Running, Role: LEADER
I20260811 00:55:41.959298 27883 consensus_queue.cc:237] T 13c1f4286dac4ea381828827fb2a07b9 P 039628cf163f4400834624b4468d7d16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad222c9e98f4424b1589ffa21ffd5b3" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 33213 } } peers { permanent_uuid: "afdd98b8317f4185accbe7820bdee827" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36097 } } peers { permanent_uuid: "039628cf163f4400834624b4468d7d16" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39029 } }
I20260811 00:55:41.960350 25698 catalog_manager.cc:5495] T 13c1f4286dac4ea381828827fb2a07b9 P 039628cf163f4400834624b4468d7d16 reported cstate change: term changed from 0 to 1, leader changed from <none> to 039628cf163f4400834624b4468d7d16 (127.15.70.1). New cstate: current_term: 1 leader_uuid: "039628cf163f4400834624b4468d7d16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad222c9e98f4424b1589ffa21ffd5b3" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 33213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afdd98b8317f4185accbe7820bdee827" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36097 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "039628cf163f4400834624b4468d7d16" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39029 } health_report { overall_health: HEALTHY } } }
I20260811 00:55:41.974375 27869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.971488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40614 (local address 127.15.70.1:39029)
0811 00:55:41.971560 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:41.971562 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:41.971575 (+ 13us) server_negotiation.cc:407] Connection header received
0811 00:55:41.971636 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:41.971637 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:41.971659 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:41.971726 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:55:41.971891 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.972407 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.973258 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:41.973570 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:41.973696 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:41.973923 (+ 227us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:55:41.974098 (+ 175us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:55:41.974175 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:41.974223 (+ 48us) server_negotiation.cc:299] Negotiation successful
0811 00:55:41.974247 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 00:55:41.976706 27496 raft_consensus.cc:1261] T 13c1f4286dac4ea381828827fb2a07b9 P 1ad222c9e98f4424b1589ffa21ffd5b3 [term 1 FOLLOWER]: Refusing update from remote peer 039628cf163f4400834624b4468d7d16: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:55:41.976707 27724 raft_consensus.cc:1261] T 13c1f4286dac4ea381828827fb2a07b9 P afdd98b8317f4185accbe7820bdee827 [term 1 FOLLOWER]: Refusing update from remote peer 039628cf163f4400834624b4468d7d16: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:55:41.977089 27885 consensus_queue.cc:1035] T 13c1f4286dac4ea381828827fb2a07b9 P 039628cf163f4400834624b4468d7d16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afdd98b8317f4185accbe7820bdee827" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:55:41.977272 27883 consensus_queue.cc:1035] T 13c1f4286dac4ea381828827fb2a07b9 P 039628cf163f4400834624b4468d7d16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad222c9e98f4424b1589ffa21ffd5b3" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 33213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:55:41.981853 27896 mvcc.cc:205] Tried to move back new op lower bound from 7317134303132758016 to 7317134303066005504. Current Snapshot: MvccSnapshot[applied={T|T < 7317134303132758016}]
I20260811 00:55:41.982448 27891 mvcc.cc:205] Tried to move back new op lower bound from 7317134303132758016 to 7317134303066005504. Current Snapshot: MvccSnapshot[applied={T|T < 7317134303132758016}]
I20260811 00:55:41.983708 27890 mvcc.cc:205] Tried to move back new op lower bound from 7317134303132758016 to 7317134303066005504. Current Snapshot: MvccSnapshot[applied={T|T < 7317134303132758016 or (T in {7317134303132758016})}]
I20260811 00:55:41.983697 25698 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60876:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:55:41.983806 25698 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60876:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:55:41.985776 25698 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a918e7b423bf4b60b146f5b794596334: Sending DeleteTablet for 3 replicas of tablet 13c1f4286dac4ea381828827fb2a07b9
I20260811 00:55:41.986141 27462 tablet_service.cc:1514] Processing DeleteTablet for tablet 13c1f4286dac4ea381828827fb2a07b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:55:41 UTC) from {username='oryx', principal='oryx/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:42414
I20260811 00:55:41.986172 27687 tablet_service.cc:1514] Processing DeleteTablet for tablet 13c1f4286dac4ea381828827fb2a07b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:55:41 UTC) from {username='oryx', principal='oryx/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:53986
I20260811 00:55:41.986415 27222 tablet_service.cc:1514] Processing DeleteTablet for tablet 13c1f4286dac4ea381828827fb2a07b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:55:41 UTC) from {username='oryx', principal='oryx/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:40604
I20260811 00:55:41.986703 27914 tablet_replica.cc:330] T 13c1f4286dac4ea381828827fb2a07b9 P 039628cf163f4400834624b4468d7d16: stopping tablet replica
I20260811 00:55:41.986841 27914 raft_consensus.cc:2229] T 13c1f4286dac4ea381828827fb2a07b9 P 039628cf163f4400834624b4468d7d16 [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:55:41.986968 27914 raft_consensus.cc:2258] T 13c1f4286dac4ea381828827fb2a07b9 P 039628cf163f4400834624b4468d7d16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:55:41.987270 27912 tablet_replica.cc:330] T 13c1f4286dac4ea381828827fb2a07b9 P 1ad222c9e98f4424b1589ffa21ffd5b3: stopping tablet replica
I20260811 00:55:41.987432 27912 raft_consensus.cc:2229] T 13c1f4286dac4ea381828827fb2a07b9 P 1ad222c9e98f4424b1589ffa21ffd5b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:55:41.987638 27912 raft_consensus.cc:2258] T 13c1f4286dac4ea381828827fb2a07b9 P 1ad222c9e98f4424b1589ffa21ffd5b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:55:41.987635 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 25643
I20260811 00:55:41.987866 27913 tablet_replica.cc:330] T 13c1f4286dac4ea381828827fb2a07b9 P afdd98b8317f4185accbe7820bdee827: stopping tablet replica
I20260811 00:55:41.988020 27913 raft_consensus.cc:2229] T 13c1f4286dac4ea381828827fb2a07b9 P afdd98b8317f4185accbe7820bdee827 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:55:41.988222 27913 raft_consensus.cc:2258] T 13c1f4286dac4ea381828827fb2a07b9 P afdd98b8317f4185accbe7820bdee827 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:55:41.988241 27912 ts_tablet_manager.cc:1905] T 13c1f4286dac4ea381828827fb2a07b9 P 1ad222c9e98f4424b1589ffa21ffd5b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:55:41.990367 27912 ts_tablet_manager.cc:1918] T 13c1f4286dac4ea381828827fb2a07b9 P 1ad222c9e98f4424b1589ffa21ffd5b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:55:41.990455 27912 log.cc:1196] T 13c1f4286dac4ea381828827fb2a07b9 P 1ad222c9e98f4424b1589ffa21ffd5b3: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-1/wal/wals/13c1f4286dac4ea381828827fb2a07b9
I20260811 00:55:41.990710 27912 ts_tablet_manager.cc:1939] T 13c1f4286dac4ea381828827fb2a07b9 P 1ad222c9e98f4424b1589ffa21ffd5b3: Deleting consensus metadata
I20260811 00:55:41.996914 27913 ts_tablet_manager.cc:1905] T 13c1f4286dac4ea381828827fb2a07b9 P afdd98b8317f4185accbe7820bdee827: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:55:41.999151 27913 ts_tablet_manager.cc:1918] T 13c1f4286dac4ea381828827fb2a07b9 P afdd98b8317f4185accbe7820bdee827: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:55:41.999271 27913 log.cc:1196] T 13c1f4286dac4ea381828827fb2a07b9 P afdd98b8317f4185accbe7820bdee827: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-2/wal/wals/13c1f4286dac4ea381828827fb2a07b9
I20260811 00:55:41.999647 27913 ts_tablet_manager.cc:1939] T 13c1f4286dac4ea381828827fb2a07b9 P afdd98b8317f4185accbe7820bdee827: Deleting consensus metadata
I20260811 00:55:42.001582 27914 ts_tablet_manager.cc:1905] T 13c1f4286dac4ea381828827fb2a07b9 P 039628cf163f4400834624b4468d7d16: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:55:42.003597 27914 ts_tablet_manager.cc:1918] T 13c1f4286dac4ea381828827fb2a07b9 P 039628cf163f4400834624b4468d7d16: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:55:42.003703 27914 log.cc:1196] T 13c1f4286dac4ea381828827fb2a07b9 P 039628cf163f4400834624b4468d7d16: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-0/wal/wals/13c1f4286dac4ea381828827fb2a07b9
I20260811 00:55:42.004026 27914 ts_tablet_manager.cc:1939] T 13c1f4286dac4ea381828827fb2a07b9 P 039628cf163f4400834624b4468d7d16: Deleting consensus metadata
W20260811 00:55:42.011843 27147 connection.cc:535] server connection from 127.0.0.1:40604 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 00:55:42.011890 27617 connection.cc:535] server connection from 127.0.0.1:53986 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 00:55:42.012117 27380 connection.cc:535] server connection from 127.0.0.1:42414 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 00:55:42.014277 27833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:41.987707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58298 (local address 127.15.70.60:46507)
0811 00:55:41.994853 (+ 7146us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:41.994855 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:42.003325 (+ 8470us) server_negotiation.cc:407] Connection header received
0811 00:55:42.003469 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:42.003470 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:42.003495 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:42.003531 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:42.004772 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:42.005673 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:42.006912 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:42.007303 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:42.007384 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:42.009326 (+ 1942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:42.009328 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:42.009329 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:42.009339 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:42.011393 (+ 2054us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:42.012470 (+ 1077us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:42.012472 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:42.012472 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:42.012546 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:42.013475 (+ 929us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:42.013477 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:42.013477 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:42.013666 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:42.013788 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:42.014038 (+ 250us) server_negotiation.cc:299] Negotiation successful
0811 00:55:42.014162 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7103}
I20260811 00:55:42.022657 27829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:42.013824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45264 (local address 127.15.70.61:36339)
0811 00:55:42.013892 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:42.013894 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:42.014061 (+ 167us) server_negotiation.cc:407] Connection header received
0811 00:55:42.014179 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:42.014180 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:42.014201 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:42.014236 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:42.015744 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:42.016397 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:42.017259 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:42.017575 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:42.017663 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:42.019517 (+ 1854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:42.019519 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:42.019519 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:42.019528 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:42.021308 (+ 1780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:42.021708 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:42.021710 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:42.021710 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:42.021778 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:42.022013 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:42.022015 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:42.022015 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:42.022184 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:42.022292 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:42.022403 (+ 111us) server_negotiation.cc:299] Negotiation successful
0811 00:55:42.022510 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 00:55:42.023123 27349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:42.014215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58308 (local address 127.15.70.60:46507)
0811 00:55:42.014266 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:42.014268 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:42.014667 (+ 399us) server_negotiation.cc:407] Connection header received
0811 00:55:42.014823 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:42.014824 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:42.014837 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:42.014889 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:42.015783 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:42.016599 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:42.017754 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:42.018061 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:42.018101 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:42.019744 (+ 1643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:42.019746 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:42.019747 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:42.019756 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:42.021714 (+ 1958us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:42.022167 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:42.022168 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:42.022169 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:42.022236 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:42.022456 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:42.022457 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:42.022457 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:42.022604 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:42.022687 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:42.022901 (+ 214us) server_negotiation.cc:299] Negotiation successful
0811 00:55:42.022993 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 00:55:42.983078 27925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:42.982576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:41971 (local address 127.15.70.2:48365)
0811 00:55:42.982746 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:42.982930 (+ 184us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:41971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":93,"threads_started":1}
W20260811 00:55:42.983435 27577 heartbeater.cc:644] Failed to heartbeat to 127.15.70.62:41971 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.15.70.62:41971: connect: Connection refused (error 111)
I20260811 00:55:42.984302 27927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:42.983970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:41971 (local address 127.15.70.3:33033)
0811 00:55:42.984144 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:42.984232 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:41971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":86,"threads_started":1}
I20260811 00:55:42.984347 27929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:42.984009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:41971 (local address 127.15.70.1:55599)
0811 00:55:42.984197 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:42.984286 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:41971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":91,"threads_started":1}
W20260811 00:55:42.984593 27811 heartbeater.cc:644] Failed to heartbeat to 127.15.70.62:41971 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.15.70.62:41971: connect: Connection refused (error 111)
W20260811 00:55:42.984598 27342 heartbeater.cc:644] Failed to heartbeat to 127.15.70.62:41971 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.15.70.62:41971: connect: Connection refused (error 111)
I20260811 00:55:43.486493 27930 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a918e7b423bf4b60b146f5b794596334)
I20260811 00:55:43.486487 27931 raft_consensus.cc:482] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a918e7b423bf4b60b146f5b794596334)
I20260811 00:55:43.486646 27931 raft_consensus.cc:504] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 36339 } attrs { promote: false } } peers { permanent_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 46507 } attrs { promote: false } }
I20260811 00:55:43.486760 27930 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 36339 } attrs { promote: false } } peers { permanent_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 46507 } attrs { promote: false } }
I20260811 00:55:43.486974 27931 leader_election.cc:288] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a918e7b423bf4b60b146f5b794596334 (127.15.70.62:41971), 7eb59440ba8341ac941c586dc9154d6f (127.15.70.61:36339)
I20260811 00:55:43.487335 27930 leader_election.cc:288] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a918e7b423bf4b60b146f5b794596334 (127.15.70.62:41971), a5410fd331ff4f8787e2ef70cd01d43f (127.15.70.60:46507)
I20260811 00:55:43.487818 27936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:43.487421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:41971 (local address 127.0.0.1:33102)
0811 00:55:43.487665 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:43.487735 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:41971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"spinlock_wait_cycles":1792,"thread_start_us":101,"threads_started":1}
I20260811 00:55:43.487821 27933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:43.487185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:41971 (local address 127.0.0.1:33086)
0811 00:55:43.487684 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:43.487766 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:41971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":59,"threads_started":1}
W20260811 00:55:43.487977 26698 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.70.62:41971: connect: Connection refused (error 111)
W20260811 00:55:43.488210 27011 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.70.62:41971: connect: Connection refused (error 111)
I20260811 00:55:43.488534 27936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:43.488420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:41971 (local address 127.0.0.1:33104)
0811 00:55:43.488467 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:43.488503 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:41971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 00:55:43.488749 26698 leader_election.cc:334] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a918e7b423bf4b60b146f5b794596334 (127.15.70.62:41971): Network error: Client connection negotiation failed: client connection to 127.15.70.62:41971: connect: Connection refused (error 111)
I20260811 00:55:43.488790 27933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:43.488693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:41971 (local address 127.0.0.1:33112)
0811 00:55:43.488736 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:43.488761 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:41971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 00:55:43.488855 27011 leader_election.cc:334] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a918e7b423bf4b60b146f5b794596334 (127.15.70.62:41971): Network error: Client connection negotiation failed: client connection to 127.15.70.62:41971: connect: Connection refused (error 111)
I20260811 00:55:43.491060 27938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:43.487558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45276 (local address 127.15.70.61:36339)
0811 00:55:43.487755 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:43.487758 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:43.487768 (+ 10us) server_negotiation.cc:407] Connection header received
0811 00:55:43.487801 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:43.487801 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:43.487813 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:43.487937 (+ 124us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:43.488166 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:43.489079 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:43.490188 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:43.490680 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:43.490736 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:43.490749 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:43.490915 (+ 166us) server_negotiation.cc:299] Negotiation successful
0811 00:55:43.490951 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":47,"threads_started":1}
I20260811 00:55:43.491062 27935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:43.487201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.61:36339 (local address 127.0.0.1:45276)
0811 00:55:43.487437 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:43.487454 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:43.487549 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:43.487973 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:43.487975 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:43.487977 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:43.488063 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:43.488066 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:43.489171 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:43.489173 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:43.490079 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:43.490082 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:43.490760 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:43.490761 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:43.490824 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:43.490829 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 00:55:43.490893 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 00:55:43.490941 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":57,"threads_started":1}
I20260811 00:55:43.491333 26749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "7eb59440ba8341ac941c586dc9154d6f" is_pre_election: true
I20260811 00:55:43.491484 26749 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5410fd331ff4f8787e2ef70cd01d43f in term 1.
I20260811 00:55:43.491590 27937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:43.487458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:46507 (local address 127.0.0.1:58320)
0811 00:55:43.487663 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:43.487674 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:43.487734 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:43.488499 (+ 765us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:43.488500 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:43.488503 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:43.488563 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:43.488565 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:43.489497 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:43.489498 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:43.490418 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:43.490420 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:43.491287 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:43.491288 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:43.491364 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:43.491370 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 00:55:43.491401 (+ 31us) client_negotiation.cc:240] Negotiation successful
0811 00:55:43.491452 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":71,"threads_started":1}
I20260811 00:55:43.491676 27012 leader_election.cc:302] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7eb59440ba8341ac941c586dc9154d6f, a5410fd331ff4f8787e2ef70cd01d43f; no voters: a918e7b423bf4b60b146f5b794596334
I20260811 00:55:43.491820 27931 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 00:55:43.491926 27931 raft_consensus.cc:482] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [term 1 FOLLOWER]: Starting leader election (detected failure of leader a918e7b423bf4b60b146f5b794596334)
I20260811 00:55:43.491926 27939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:43.487625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58320 (local address 127.15.70.60:46507)
0811 00:55:43.487837 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:43.487839 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:43.487847 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:55:43.487875 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:43.487876 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:43.488278 (+ 402us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:43.488665 (+ 387us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:43.488707 (+ 42us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:43.489407 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:43.490512 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:43.491083 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:43.491716 (+ 633us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:43.491732 (+ 16us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:43.491751 (+ 19us) server_negotiation.cc:299] Negotiation successful
0811 00:55:43.491801 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":54,"threads_started":1}
I20260811 00:55:43.491972 27931 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [term 1 FOLLOWER]: Advancing to term 2
I20260811 00:55:43.492141 27049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7eb59440ba8341ac941c586dc9154d6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" is_pre_election: true
I20260811 00:55:43.493002 27931 raft_consensus.cc:504] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 36339 } attrs { promote: false } } peers { permanent_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 46507 } attrs { promote: false } }
I20260811 00:55:43.493167 27049 raft_consensus.cc:2379] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7eb59440ba8341ac941c586dc9154d6f in current term 2: Already voted for candidate a5410fd331ff4f8787e2ef70cd01d43f in this term.
I20260811 00:55:43.493196 27931 leader_election.cc:288] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [CANDIDATE]: Term 2 election: Requested vote from peers a918e7b423bf4b60b146f5b794596334 (127.15.70.62:41971), 7eb59440ba8341ac941c586dc9154d6f (127.15.70.61:36339)
I20260811 00:55:43.493402 27935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:43.493301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:41971 (local address 127.0.0.1:33124)
0811 00:55:43.493339 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:43.493373 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:41971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
I20260811 00:55:43.493419 26749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "7eb59440ba8341ac941c586dc9154d6f"
I20260811 00:55:43.493516 26749 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [term 1 FOLLOWER]: Advancing to term 2
I20260811 00:55:43.493579 26704 leader_election.cc:302] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7eb59440ba8341ac941c586dc9154d6f; no voters: a5410fd331ff4f8787e2ef70cd01d43f, a918e7b423bf4b60b146f5b794596334
I20260811 00:55:43.494343 26749 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5410fd331ff4f8787e2ef70cd01d43f in term 2.
I20260811 00:55:43.494472 27930 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 00:55:43.494616 27012 leader_election.cc:302] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7eb59440ba8341ac941c586dc9154d6f, a5410fd331ff4f8787e2ef70cd01d43f; no voters:
I20260811 00:55:43.494730 27931 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [term 2 FOLLOWER]: Leader election won for term 2
I20260811 00:55:43.494918 27935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:43.494812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:41971 (local address 127.0.0.1:33128)
0811 00:55:43.494857 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:43.494890 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:41971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260811 00:55:43.494923 27931 raft_consensus.cc:686] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [term 2 LEADER]: Becoming Leader. State: Replica: a5410fd331ff4f8787e2ef70cd01d43f, State: Running, Role: LEADER
W20260811 00:55:43.495052 27011 leader_election.cc:334] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a918e7b423bf4b60b146f5b794596334 (127.15.70.62:41971): Network error: Client connection negotiation failed: client connection to 127.15.70.62:41971: connect: Connection refused (error 111)
I20260811 00:55:43.495065 27931 consensus_queue.cc:237] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 36339 } attrs { promote: false } } peers { permanent_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 46507 } attrs { promote: false } }
I20260811 00:55:43.495536 27942 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [sys.catalog]: SysCatalogTable state changed. Reason: New leader a5410fd331ff4f8787e2ef70cd01d43f. Latest consensus state: current_term: 2 leader_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 36339 } attrs { promote: false } } peers { permanent_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 46507 } attrs { promote: false } } }
I20260811 00:55:43.495649 27942 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [sys.catalog]: This master's current role is: LEADER
I20260811 00:55:43.495867 27946 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:55:43.496459 27946 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:55:43.496528 27946 catalog_manager.cc:1259] Loaded cluster ID: 8ae5bbf38e204796b1345a1c74c09ce3
I20260811 00:55:43.496546 27946 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:55:43.496702 27946 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:55:43.496759 27946 catalog_manager.cc:5879] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f: Loaded TSK: 0
I20260811 00:55:43.496872 27946 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:55:43.517827 27034 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58308:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:55:43.520226 27034 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:55:43.521881 27935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:43.521708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:41971 (local address 127.0.0.1:33136)
0811 00:55:43.521766 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:43.521834 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:41971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 00:55:43.521920 26749 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [term 2 FOLLOWER]: Refusing update from remote peer a5410fd331ff4f8787e2ef70cd01d43f: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260811 00:55:43.522215 27931 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 36339 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260811 00:55:43.522377 27935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:43.522245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:41971 (local address 127.0.0.1:33150)
0811 00:55:43.522300 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:43.522331 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:41971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 00:55:43.522625 27011 consensus_peers.cc:487] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f -> Peer a918e7b423bf4b60b146f5b794596334 (127.15.70.62:41971): Couldn't send request to peer a918e7b423bf4b60b146f5b794596334. Status: Network error: Client connection negotiation failed: client connection to 127.15.70.62:41971: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 00:55:43.523166 27930 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [sys.catalog]: SysCatalogTable state changed. Reason: New leader a5410fd331ff4f8787e2ef70cd01d43f. Latest consensus state: current_term: 2 leader_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 36339 } attrs { promote: false } } peers { permanent_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 46507 } attrs { promote: false } } }
I20260811 00:55:43.523299 27930 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [sys.catalog]: This master's current role is: FOLLOWER
I20260811 00:55:43.523799 27942 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 36339 } attrs { promote: false } } peers { permanent_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 46507 } attrs { promote: false } } }
I20260811 00:55:43.523923 27942 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f [sys.catalog]: This master's current role is: LEADER
I20260811 00:55:43.524092 27930 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a918e7b423bf4b60b146f5b794596334" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 41971 } } peers { permanent_uuid: "7eb59440ba8341ac941c586dc9154d6f" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 36339 } attrs { promote: false } } peers { permanent_uuid: "a5410fd331ff4f8787e2ef70cd01d43f" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 46507 } attrs { promote: false } } }
I20260811 00:55:43.524194 27930 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7eb59440ba8341ac941c586dc9154d6f [sys.catalog]: This master's current role is: FOLLOWER
I20260811 00:55:43.524318 27951 mvcc.cc:205] Tried to move back new op lower bound from 7317134309462519808 to 7317134309356769280. Current Snapshot: MvccSnapshot[applied={T|T < 7317134309462519808 or (T in {7317134309462519808})}]
I20260811 00:55:43.529749 27961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:43.526211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53988 (local address 127.15.70.3:36097)
0811 00:55:43.526768 (+ 557us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:43.526771 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:43.526780 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:55:43.526812 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:43.526813 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:43.526825 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:43.526928 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:43.527112 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:43.527838 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:43.528775 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:43.529363 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:43.529453 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:43.529481 (+ 28us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:43.529604 (+ 123us) server_negotiation.cc:299] Negotiation successful
0811 00:55:43.529660 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":527,"thread_start_us":80,"threads_started":1}
I20260811 00:55:43.529748 27935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:43.526047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:36097 (local address 127.0.0.1:53988)
0811 00:55:43.526129 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:43.526146 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:43.526219 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:43.526929 (+ 710us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:43.526929 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:43.526931 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:43.527041 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:43.527043 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:43.527930 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:43.527931 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:43.528667 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:43.528669 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:43.529462 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:43.529463 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:43.529528 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:43.529534 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 00:55:43.529586 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 00:55:43.529649 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260811 00:55:43.530083 27933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:43.526047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.2:33213 (local address 127.0.0.1:42418)
0811 00:55:43.526330 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:43.526341 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:43.526395 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:43.526612 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:43.526613 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:43.526618 (+ 5us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:43.526725 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:43.526727 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:43.527777 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:43.527779 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:43.528983 (+ 1204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:43.528987 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:43.529823 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:43.529824 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:43.529901 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:43.529904 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:55:43.529959 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 00:55:43.530006 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"mutex_wait_us":24}
I20260811 00:55:43.530087 27687 tablet_service.cc:1467] Processing CreateTablet for tablet 17904c0962684c2bbe253fe61c8530d6 (DEFAULT_TABLE table=test-table [id=c292be3acf3d4f10b641b295b747a548]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:55:43.530165 27962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:43.526294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42418 (local address 127.15.70.2:33213)
0811 00:55:43.526451 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:43.526453 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:43.526463 (+ 10us) server_negotiation.cc:407] Connection header received
0811 00:55:43.526499 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:43.526500 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:43.526534 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:43.526609 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:43.526827 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:43.527674 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:43.529093 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:43.529711 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:43.529776 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:43.529791 (+ 15us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:43.530029 (+ 238us) server_negotiation.cc:299] Negotiation successful
0811 00:55:43.530083 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":97,"threads_started":1}
I20260811 00:55:43.530283 27687 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17904c0962684c2bbe253fe61c8530d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:43.530498 27462 tablet_service.cc:1467] Processing CreateTablet for tablet 17904c0962684c2bbe253fe61c8530d6 (DEFAULT_TABLE table=test-table [id=c292be3acf3d4f10b641b295b747a548]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:55:43.530579 27960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:43.526180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:39029 (local address 127.0.0.1:40620)
0811 00:55:43.526589 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:43.526601 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:43.526655 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:43.527256 (+ 601us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:43.527257 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:43.527260 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:43.527304 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:43.527305 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:43.528186 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:43.528187 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:43.529442 (+ 1255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:43.529444 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:43.530320 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:43.530322 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:43.530409 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:43.530416 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 00:55:43.530448 (+ 32us) client_negotiation.cc:240] Negotiation successful
0811 00:55:43.530499 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":110,"threads_started":1}
I20260811 00:55:43.530643 27462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17904c0962684c2bbe253fe61c8530d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:43.530975 27964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:43.526575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40620 (local address 127.15.70.1:39029)
0811 00:55:43.526739 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:43.526742 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:43.526750 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:55:43.526881 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:43.526882 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:43.527179 (+ 297us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:43.527251 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:43.527366 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:43.528086 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:43.529550 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:43.530206 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:43.530756 (+ 550us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:43.530778 (+ 22us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:43.530799 (+ 21us) server_negotiation.cc:299] Negotiation successful
0811 00:55:43.530862 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":96,"threads_started":1}
I20260811 00:55:43.531258 27222 tablet_service.cc:1467] Processing CreateTablet for tablet 17904c0962684c2bbe253fe61c8530d6 (DEFAULT_TABLE table=test-table [id=c292be3acf3d4f10b641b295b747a548]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:55:43.531457 27222 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17904c0962684c2bbe253fe61c8530d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:43.532428 27966 tablet_bootstrap.cc:492] T 17904c0962684c2bbe253fe61c8530d6 P afdd98b8317f4185accbe7820bdee827: Bootstrap starting.
I20260811 00:55:43.533135 27966 tablet_bootstrap.cc:654] T 17904c0962684c2bbe253fe61c8530d6 P afdd98b8317f4185accbe7820bdee827: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:43.533234 27969 tablet_bootstrap.cc:492] T 17904c0962684c2bbe253fe61c8530d6 P 039628cf163f4400834624b4468d7d16: Bootstrap starting.
I20260811 00:55:43.533613 27967 tablet_bootstrap.cc:492] T 17904c0962684c2bbe253fe61c8530d6 P 1ad222c9e98f4424b1589ffa21ffd5b3: Bootstrap starting.
I20260811 00:55:43.533726 27969 tablet_bootstrap.cc:654] T 17904c0962684c2bbe253fe61c8530d6 P 039628cf163f4400834624b4468d7d16: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:43.534086 27967 tablet_bootstrap.cc:654] T 17904c0962684c2bbe253fe61c8530d6 P 1ad222c9e98f4424b1589ffa21ffd5b3: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:43.534430 27969 tablet_bootstrap.cc:492] T 17904c0962684c2bbe253fe61c8530d6 P 039628cf163f4400834624b4468d7d16: No bootstrap required, opened a new log
I20260811 00:55:43.534535 27969 ts_tablet_manager.cc:1397] T 17904c0962684c2bbe253fe61c8530d6 P 039628cf163f4400834624b4468d7d16: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:43.534586 27966 tablet_bootstrap.cc:492] T 17904c0962684c2bbe253fe61c8530d6 P afdd98b8317f4185accbe7820bdee827: No bootstrap required, opened a new log
I20260811 00:55:43.534648 27966 ts_tablet_manager.cc:1397] T 17904c0962684c2bbe253fe61c8530d6 P afdd98b8317f4185accbe7820bdee827: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 00:55:43.534741 27969 raft_consensus.cc:348] T 17904c0962684c2bbe253fe61c8530d6 P 039628cf163f4400834624b4468d7d16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad222c9e98f4424b1589ffa21ffd5b3" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 33213 } } peers { permanent_uuid: "afdd98b8317f4185accbe7820bdee827" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36097 } } peers { permanent_uuid: "039628cf163f4400834624b4468d7d16" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39029 } }
I20260811 00:55:43.534855 27969 raft_consensus.cc:374] T 17904c0962684c2bbe253fe61c8530d6 P 039628cf163f4400834624b4468d7d16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:43.534890 27969 raft_consensus.cc:729] T 17904c0962684c2bbe253fe61c8530d6 P 039628cf163f4400834624b4468d7d16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039628cf163f4400834624b4468d7d16, State: Initialized, Role: FOLLOWER
I20260811 00:55:43.534832 27966 raft_consensus.cc:348] T 17904c0962684c2bbe253fe61c8530d6 P afdd98b8317f4185accbe7820bdee827 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad222c9e98f4424b1589ffa21ffd5b3" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 33213 } } peers { permanent_uuid: "afdd98b8317f4185accbe7820bdee827" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36097 } } peers { permanent_uuid: "039628cf163f4400834624b4468d7d16" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39029 } }
I20260811 00:55:43.534951 27969 consensus_queue.cc:260] T 17904c0962684c2bbe253fe61c8530d6 P 039628cf163f4400834624b4468d7d16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad222c9e98f4424b1589ffa21ffd5b3" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 33213 } } peers { permanent_uuid: "afdd98b8317f4185accbe7820bdee827" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36097 } } peers { permanent_uuid: "039628cf163f4400834624b4468d7d16" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39029 } }
I20260811 00:55:43.534992 27966 raft_consensus.cc:374] T 17904c0962684c2bbe253fe61c8530d6 P afdd98b8317f4185accbe7820bdee827 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:43.535072 27966 raft_consensus.cc:729] T 17904c0962684c2bbe253fe61c8530d6 P afdd98b8317f4185accbe7820bdee827 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afdd98b8317f4185accbe7820bdee827, State: Initialized, Role: FOLLOWER
I20260811 00:55:43.535163 27969 ts_tablet_manager.cc:1428] T 17904c0962684c2bbe253fe61c8530d6 P 039628cf163f4400834624b4468d7d16: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:43.535154 27966 consensus_queue.cc:260] T 17904c0962684c2bbe253fe61c8530d6 P afdd98b8317f4185accbe7820bdee827 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad222c9e98f4424b1589ffa21ffd5b3" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 33213 } } peers { permanent_uuid: "afdd98b8317f4185accbe7820bdee827" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36097 } } peers { permanent_uuid: "039628cf163f4400834624b4468d7d16" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39029 } }
I20260811 00:55:43.535279 27967 tablet_bootstrap.cc:492] T 17904c0962684c2bbe253fe61c8530d6 P 1ad222c9e98f4424b1589ffa21ffd5b3: No bootstrap required, opened a new log
I20260811 00:55:43.535373 27966 ts_tablet_manager.cc:1428] T 17904c0962684c2bbe253fe61c8530d6 P afdd98b8317f4185accbe7820bdee827: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:43.535382 27967 ts_tablet_manager.cc:1397] T 17904c0962684c2bbe253fe61c8530d6 P 1ad222c9e98f4424b1589ffa21ffd5b3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 00:55:43.535595 27967 raft_consensus.cc:348] T 17904c0962684c2bbe253fe61c8530d6 P 1ad222c9e98f4424b1589ffa21ffd5b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad222c9e98f4424b1589ffa21ffd5b3" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 33213 } } peers { permanent_uuid: "afdd98b8317f4185accbe7820bdee827" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36097 } } peers { permanent_uuid: "039628cf163f4400834624b4468d7d16" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39029 } }
I20260811 00:55:43.535693 27967 raft_consensus.cc:374] T 17904c0962684c2bbe253fe61c8530d6 P 1ad222c9e98f4424b1589ffa21ffd5b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:43.535720 27967 raft_consensus.cc:729] T 17904c0962684c2bbe253fe61c8530d6 P 1ad222c9e98f4424b1589ffa21ffd5b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad222c9e98f4424b1589ffa21ffd5b3, State: Initialized, Role: FOLLOWER
I20260811 00:55:43.535792 27967 consensus_queue.cc:260] T 17904c0962684c2bbe253fe61c8530d6 P 1ad222c9e98f4424b1589ffa21ffd5b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad222c9e98f4424b1589ffa21ffd5b3" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 33213 } } peers { permanent_uuid: "afdd98b8317f4185accbe7820bdee827" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36097 } } peers { permanent_uuid: "039628cf163f4400834624b4468d7d16" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39029 } }
I20260811 00:55:43.535960 27967 ts_tablet_manager.cc:1428] T 17904c0962684c2bbe253fe61c8530d6 P 1ad222c9e98f4424b1589ffa21ffd5b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 00:55:43.536533 27979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:43.536211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:41971 (local address 127.15.70.1:53187)
0811 00:55:43.536380 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:43.536457 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:41971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":106,"threads_started":1}
I20260811 00:55:43.536549 27984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:43.536300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:41971 (local address 127.15.70.2:42975)
0811 00:55:43.536473 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:43.536512 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:41971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":107,"threads_started":1}
I20260811 00:55:43.536641 27976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:43.535712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:41971 (local address 127.15.70.3:40781)
0811 00:55:43.536551 (+ 839us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:43.536599 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:41971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":801,"thread_start_us":109,"threads_started":1}
I20260811 00:55:43.537201 27984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:43.537046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:41971 (local address 127.15.70.2:47217)
0811 00:55:43.537101 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:43.537165 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:41971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 00:55:43.537173 27809 heartbeater.cc:503] Master 127.15.70.60:46507 was elected leader, sending a full tablet report...
I20260811 00:55:43.538079 27340 heartbeater.cc:503] Master 127.15.70.60:46507 was elected leader, sending a full tablet report...
I20260811 00:55:43.538322 27979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:43.538114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:41971 (local address 127.15.70.1:42559)
0811 00:55:43.538256 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:43.538289 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:41971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122}
I20260811 00:55:43.538450 27576 heartbeater.cc:503] Master 127.15.70.60:46507 was elected leader, sending a full tablet report...
I20260811 00:55:43.538611 27976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:43.538491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:41971 (local address 127.15.70.3:60957)
0811 00:55:43.538554 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:43.538584 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:41971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260811 00:55:43.596123 27813 tablet.cc:2369] T 17904c0962684c2bbe253fe61c8530d6 P afdd98b8317f4185accbe7820bdee827: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 00:55:43.673736 27977 raft_consensus.cc:482] T 17904c0962684c2bbe253fe61c8530d6 P 1ad222c9e98f4424b1589ffa21ffd5b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:55:43.673919 27977 raft_consensus.cc:504] T 17904c0962684c2bbe253fe61c8530d6 P 1ad222c9e98f4424b1589ffa21ffd5b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad222c9e98f4424b1589ffa21ffd5b3" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 33213 } } peers { permanent_uuid: "afdd98b8317f4185accbe7820bdee827" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36097 } } peers { permanent_uuid: "039628cf163f4400834624b4468d7d16" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39029 } }
I20260811 00:55:43.674221 27977 leader_election.cc:288] T 17904c0962684c2bbe253fe61c8530d6 P 1ad222c9e98f4424b1589ffa21ffd5b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afdd98b8317f4185accbe7820bdee827 (127.15.70.3:36097), 039628cf163f4400834624b4468d7d16 (127.15.70.1:39029)
I20260811 00:55:43.674602 27253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17904c0962684c2bbe253fe61c8530d6" candidate_uuid: "1ad222c9e98f4424b1589ffa21ffd5b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039628cf163f4400834624b4468d7d16" is_pre_election: true
I20260811 00:55:43.674615 27724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17904c0962684c2bbe253fe61c8530d6" candidate_uuid: "1ad222c9e98f4424b1589ffa21ffd5b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afdd98b8317f4185accbe7820bdee827" is_pre_election: true
I20260811 00:55:43.674734 27253 raft_consensus.cc:2454] T 17904c0962684c2bbe253fe61c8530d6 P 039628cf163f4400834624b4468d7d16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ad222c9e98f4424b1589ffa21ffd5b3 in term 0.
I20260811 00:55:43.674746 27724 raft_consensus.cc:2454] T 17904c0962684c2bbe253fe61c8530d6 P afdd98b8317f4185accbe7820bdee827 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ad222c9e98f4424b1589ffa21ffd5b3 in term 0.
I20260811 00:55:43.674978 27382 leader_election.cc:302] T 17904c0962684c2bbe253fe61c8530d6 P 1ad222c9e98f4424b1589ffa21ffd5b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad222c9e98f4424b1589ffa21ffd5b3, afdd98b8317f4185accbe7820bdee827; no voters:
I20260811 00:55:43.675154 27977 raft_consensus.cc:2781] T 17904c0962684c2bbe253fe61c8530d6 P 1ad222c9e98f4424b1589ffa21ffd5b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:55:43.675208 27977 raft_consensus.cc:482] T 17904c0962684c2bbe253fe61c8530d6 P 1ad222c9e98f4424b1589ffa21ffd5b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:55:43.675225 27977 raft_consensus.cc:3037] T 17904c0962684c2bbe253fe61c8530d6 P 1ad222c9e98f4424b1589ffa21ffd5b3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:43.676186 27977 raft_consensus.cc:504] T 17904c0962684c2bbe253fe61c8530d6 P 1ad222c9e98f4424b1589ffa21ffd5b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad222c9e98f4424b1589ffa21ffd5b3" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 33213 } } peers { permanent_uuid: "afdd98b8317f4185accbe7820bdee827" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36097 } } peers { permanent_uuid: "039628cf163f4400834624b4468d7d16" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39029 } }
I20260811 00:55:43.676349 27977 leader_election.cc:288] T 17904c0962684c2bbe253fe61c8530d6 P 1ad222c9e98f4424b1589ffa21ffd5b3 [CANDIDATE]: Term 1 election: Requested vote from peers afdd98b8317f4185accbe7820bdee827 (127.15.70.3:36097), 039628cf163f4400834624b4468d7d16 (127.15.70.1:39029)
I20260811 00:55:43.676535 27724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17904c0962684c2bbe253fe61c8530d6" candidate_uuid: "1ad222c9e98f4424b1589ffa21ffd5b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afdd98b8317f4185accbe7820bdee827"
I20260811 00:55:43.676635 27724 raft_consensus.cc:3037] T 17904c0962684c2bbe253fe61c8530d6 P afdd98b8317f4185accbe7820bdee827 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:43.676607 27253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17904c0962684c2bbe253fe61c8530d6" candidate_uuid: "1ad222c9e98f4424b1589ffa21ffd5b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "039628cf163f4400834624b4468d7d16"
I20260811 00:55:43.676702 27253 raft_consensus.cc:3037] T 17904c0962684c2bbe253fe61c8530d6 P 039628cf163f4400834624b4468d7d16 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:43.677618 27724 raft_consensus.cc:2454] T 17904c0962684c2bbe253fe61c8530d6 P afdd98b8317f4185accbe7820bdee827 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad222c9e98f4424b1589ffa21ffd5b3 in term 1.
I20260811 00:55:43.677840 27253 raft_consensus.cc:2454] T 17904c0962684c2bbe253fe61c8530d6 P 039628cf163f4400834624b4468d7d16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad222c9e98f4424b1589ffa21ffd5b3 in term 1.
I20260811 00:55:43.677865 27382 leader_election.cc:302] T 17904c0962684c2bbe253fe61c8530d6 P 1ad222c9e98f4424b1589ffa21ffd5b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad222c9e98f4424b1589ffa21ffd5b3, afdd98b8317f4185accbe7820bdee827; no voters:
I20260811 00:55:43.678038 27977 raft_consensus.cc:2781] T 17904c0962684c2bbe253fe61c8530d6 P 1ad222c9e98f4424b1589ffa21ffd5b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:55:43.678306 27977 raft_consensus.cc:686] T 17904c0962684c2bbe253fe61c8530d6 P 1ad222c9e98f4424b1589ffa21ffd5b3 [term 1 LEADER]: Becoming Leader. State: Replica: 1ad222c9e98f4424b1589ffa21ffd5b3, State: Running, Role: LEADER
I20260811 00:55:43.678401 27977 consensus_queue.cc:237] T 17904c0962684c2bbe253fe61c8530d6 P 1ad222c9e98f4424b1589ffa21ffd5b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad222c9e98f4424b1589ffa21ffd5b3" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 33213 } } peers { permanent_uuid: "afdd98b8317f4185accbe7820bdee827" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36097 } } peers { permanent_uuid: "039628cf163f4400834624b4468d7d16" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39029 } }
I20260811 00:55:43.678970 27984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:43.678811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:41971 (local address 127.15.70.2:44163)
0811 00:55:43.678880 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:43.678924 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:41971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 00:55:43.679538 27034 catalog_manager.cc:5495] T 17904c0962684c2bbe253fe61c8530d6 P 1ad222c9e98f4424b1589ffa21ffd5b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ad222c9e98f4424b1589ffa21ffd5b3 (127.15.70.2). New cstate: current_term: 1 leader_uuid: "1ad222c9e98f4424b1589ffa21ffd5b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad222c9e98f4424b1589ffa21ffd5b3" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 33213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afdd98b8317f4185accbe7820bdee827" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36097 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "039628cf163f4400834624b4468d7d16" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39029 } health_report { overall_health: UNKNOWN } } }
I20260811 00:55:43.719390 27962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:43.716207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42420 (local address 127.15.70.2:33213)
0811 00:55:43.716263 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:43.716265 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:43.716277 (+ 12us) server_negotiation.cc:407] Connection header received
0811 00:55:43.716361 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:43.716362 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:43.716390 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:43.716462 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:55:43.716692 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:43.717462 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:43.718350 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:43.718670 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:43.718750 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:43.718933 (+ 183us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:55:43.719097 (+ 164us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:55:43.719166 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:43.719210 (+ 44us) server_negotiation.cc:299] Negotiation successful
0811 00:55:43.719241 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 00:55:43.720984 27724 raft_consensus.cc:1261] T 17904c0962684c2bbe253fe61c8530d6 P afdd98b8317f4185accbe7820bdee827 [term 1 FOLLOWER]: Refusing update from remote peer 1ad222c9e98f4424b1589ffa21ffd5b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:55:43.721114 27253 raft_consensus.cc:1261] T 17904c0962684c2bbe253fe61c8530d6 P 039628cf163f4400834624b4468d7d16 [term 1 FOLLOWER]: Refusing update from remote peer 1ad222c9e98f4424b1589ffa21ffd5b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:55:43.721346 27987 consensus_queue.cc:1035] T 17904c0962684c2bbe253fe61c8530d6 P 1ad222c9e98f4424b1589ffa21ffd5b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afdd98b8317f4185accbe7820bdee827" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:55:43.721594 27977 consensus_queue.cc:1035] T 17904c0962684c2bbe253fe61c8530d6 P 1ad222c9e98f4424b1589ffa21ffd5b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "039628cf163f4400834624b4468d7d16" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:55:43.722916 27979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:43.722603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:41971 (local address 127.15.70.1:47705)
0811 00:55:43.722800 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:43.722853 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:41971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169}
I20260811 00:55:43.722973 27976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:43.722848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:41971 (local address 127.15.70.3:33513)
0811 00:55:43.722900 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:43.722930 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:41971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 00:55:43.724047 27984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:43.723879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:41971 (local address 127.15.70.2:48051)
0811 00:55:43.723979 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:43.724011 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:41971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260811 00:55:43.724946 27984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:43.724840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:41971 (local address 127.15.70.2:56345)
0811 00:55:43.724881 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:43.724913 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:41971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260811 00:55:43.725406 27976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:43.725273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:41971 (local address 127.15.70.3:48257)
0811 00:55:43.725328 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:43.725357 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:41971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 00:55:43.726714 27979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:43.725473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:41971 (local address 127.15.70.1:59373)
0811 00:55:43.726632 (+ 1159us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:43.726675 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:41971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1137}
I20260811 00:55:43.726922 27034 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58308:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:55:43.727089 27034 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58308:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:55:43.728684 27034 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a5410fd331ff4f8787e2ef70cd01d43f: Sending DeleteTablet for 3 replicas of tablet 17904c0962684c2bbe253fe61c8530d6
I20260811 00:55:43.729220 27462 tablet_service.cc:1514] Processing DeleteTablet for tablet 17904c0962684c2bbe253fe61c8530d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:55:43 UTC) from {username='oryx', principal='oryx/127.15.70.60@KRBTEST.COM'} at 127.0.0.1:42418
I20260811 00:55:43.729212 27687 tablet_service.cc:1514] Processing DeleteTablet for tablet 17904c0962684c2bbe253fe61c8530d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:55:43 UTC) from {username='oryx', principal='oryx/127.15.70.60@KRBTEST.COM'} at 127.0.0.1:53988
I20260811 00:55:43.729288 27222 tablet_service.cc:1514] Processing DeleteTablet for tablet 17904c0962684c2bbe253fe61c8530d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:55:43 UTC) from {username='oryx', principal='oryx/127.15.70.60@KRBTEST.COM'} at 127.0.0.1:40620
I20260811 00:55:43.729528 28008 tablet_replica.cc:330] T 17904c0962684c2bbe253fe61c8530d6 P afdd98b8317f4185accbe7820bdee827: stopping tablet replica
I20260811 00:55:43.729599 28008 raft_consensus.cc:2229] T 17904c0962684c2bbe253fe61c8530d6 P afdd98b8317f4185accbe7820bdee827 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:55:43.729663 28008 raft_consensus.cc:2258] T 17904c0962684c2bbe253fe61c8530d6 P afdd98b8317f4185accbe7820bdee827 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:55:43.729776 28012 tablet_replica.cc:330] T 17904c0962684c2bbe253fe61c8530d6 P 1ad222c9e98f4424b1589ffa21ffd5b3: stopping tablet replica
I20260811 00:55:43.729849 28012 raft_consensus.cc:2229] T 17904c0962684c2bbe253fe61c8530d6 P 1ad222c9e98f4424b1589ffa21ffd5b3 [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:55:43.729782 28013 tablet_replica.cc:330] T 17904c0962684c2bbe253fe61c8530d6 P 039628cf163f4400834624b4468d7d16: stopping tablet replica
I20260811 00:55:43.729945 28012 raft_consensus.cc:2258] T 17904c0962684c2bbe253fe61c8530d6 P 1ad222c9e98f4424b1589ffa21ffd5b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:55:43.730037 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 26974
I20260811 00:55:43.741001 28012 ts_tablet_manager.cc:1905] T 17904c0962684c2bbe253fe61c8530d6 P 1ad222c9e98f4424b1589ffa21ffd5b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:55:43.741413 28008 ts_tablet_manager.cc:1905] T 17904c0962684c2bbe253fe61c8530d6 P afdd98b8317f4185accbe7820bdee827: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:55:43.743836 28008 ts_tablet_manager.cc:1918] T 17904c0962684c2bbe253fe61c8530d6 P afdd98b8317f4185accbe7820bdee827: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:55:43.745990 28012 ts_tablet_manager.cc:1918] T 17904c0962684c2bbe253fe61c8530d6 P 1ad222c9e98f4424b1589ffa21ffd5b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:55:43.746083 28012 log.cc:1196] T 17904c0962684c2bbe253fe61c8530d6 P 1ad222c9e98f4424b1589ffa21ffd5b3: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-1/wal/wals/17904c0962684c2bbe253fe61c8530d6
I20260811 00:55:43.746393 28012 ts_tablet_manager.cc:1939] T 17904c0962684c2bbe253fe61c8530d6 P 1ad222c9e98f4424b1589ffa21ffd5b3: Deleting consensus metadata
I20260811 00:55:43.746695 28008 log.cc:1196] T 17904c0962684c2bbe253fe61c8530d6 P afdd98b8317f4185accbe7820bdee827: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409704606556-15640-0/minicluster-data/ts-2/wal/wals/17904c0962684c2bbe253fe61c8530d6
I20260811 00:55:43.747056 28008 ts_tablet_manager.cc:1939] T 17904c0962684c2bbe253fe61c8530d6 P afdd98b8317f4185accbe7820bdee827: Deleting consensus metadata
I20260811 00:55:43.747656 27014 catalog_manager.cc:4841] TS afdd98b8317f4185accbe7820bdee827 (127.15.70.3:36097): tablet 17904c0962684c2bbe253fe61c8530d6 (table test-table [id=c292be3acf3d4f10b641b295b747a548]) successfully deleted
I20260811 00:55:43.747709 27012 catalog_manager.cc:4841] TS 1ad222c9e98f4424b1589ffa21ffd5b3 (127.15.70.2:33213): tablet 17904c0962684c2bbe253fe61c8530d6 (table test-table [id=c292be3acf3d4f10b641b295b747a548]) successfully deleted
I20260811 00:55:43.753291 27960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:43.753103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:39029 (local address 127.0.0.1:40634)
0811 00:55:43.753178 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:43.753224 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.1:39029: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 00:55:43.753350 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 27354
W20260811 00:55:43.753553 27012 catalog_manager.cc:4584] TS 039628cf163f4400834624b4468d7d16 (127.15.70.1:39029): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 17904c0962684c2bbe253fe61c8530d6: Network error: Client connection negotiation failed: client connection to 127.15.70.1:39029: connect: Connection refused (error 111)
I20260811 00:55:43.768240 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 27584
I20260811 00:55:43.790989 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 26484
I20260811 00:55:43.805619 27960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:43.805400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:39029 (local address 127.0.0.1:40650)
0811 00:55:43.805499 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:43.805550 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.1:39029: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260811 00:55:43.806177 27960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:43.806066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:39029 (local address 127.0.0.1:40662)
0811 00:55:43.806123 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:43.806154 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.1:39029: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 00:55:43.811445 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 26822
2026-08-11T00:55:43Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (5473 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:55:43 dist-test-slave-h3ft krb5kdc[28020](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:55:43 dist-test-slave-h3ft krb5kdc[28020](info): set up 2 sockets
Aug 11 00:55:43 dist-test-slave-h3ft krb5kdc[28020](info): commencing operation
krb5kdc: starting...
W20260811 00:55:45.153223 15640 mini_kdc.cc:121] Time spent starting KDC: real 1.304s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Aug 11 00:55:45 dist-test-slave-h3ft krb5kdc[28020](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409745, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:55:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:55:45Z Disabled control of system clock
WARNING: no policy specified for oryx/127.15.70.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.70.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.70.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.62.keytab.
Entry for principal oryx/127.15.70.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.62.keytab.
I20260811 00:55:45.308473 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:40199
--webserver_interface=127.15.70.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.62.keytab
--principal=oryx/127.15.70.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:38921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:40199
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:45.406213 28040 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:45.406582 28040 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:45.406632 28040 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:45.408119 28040 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:55:45.408219 28040 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 00:55:45.408242 28040 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:45.408267 28040 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:45.408296 28040 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:55:45.408315 28040 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:55:45.410183 28040 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:38921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:40199
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.62.keytab
--principal=oryx/127.15.70.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:40199
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28040
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:45.410568 28040 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:45.410871 28040 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:45.416886 28053 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:45.416853 28048 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:45.416848 28051 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:45.417358 28040 server_base.cc:1034] running on GCE node
I20260811 00:55:45.417640 28040 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:45.417960 28040 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:45.419097 28040 hybrid_clock.cc:648] HybridClock initialized: now 1786409745419069 us; error 47 us; skew 500 ppm
Aug 11 00:55:45 dist-test-slave-h3ft krb5kdc[28020](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409745, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.70.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:45.426991 28040 init.cc:377] Logged in from keytab as oryx/127.15.70.62@KRBTEST.COM (short username oryx)
I20260811 00:55:45.427728 28040 webserver.cc:460] Webserver started at http://127.15.70.62:35999/ using document root <none> and password file <none>
I20260811 00:55:45.428042 28040 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:45.428112 28040 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:45.428251 28040 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:45.429826 28040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "802eda0d72274b71956fcba4925fd37a"
format_stamp: "Formatted at 2026-08-11 00:55:45 on dist-test-slave-h3ft"
server_key: "958d222dd07a18970994e746b98ecc2d"
server_key_iv: "5b1d27dc3fcf69feb83a5b1f0d4d1f20"
server_key_version: "encryptionkey@0"
I20260811 00:55:45.430311 28040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "802eda0d72274b71956fcba4925fd37a"
format_stamp: "Formatted at 2026-08-11 00:55:45 on dist-test-slave-h3ft"
server_key: "958d222dd07a18970994e746b98ecc2d"
server_key_iv: "5b1d27dc3fcf69feb83a5b1f0d4d1f20"
server_key_version: "encryptionkey@0"
I20260811 00:55:45.432384 28040 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260811 00:55:45.433511 28068 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:45.433811 28040 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:45.434034 28040 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "802eda0d72274b71956fcba4925fd37a"
format_stamp: "Formatted at 2026-08-11 00:55:45 on dist-test-slave-h3ft"
server_key: "958d222dd07a18970994e746b98ecc2d"
server_key_iv: "5b1d27dc3fcf69feb83a5b1f0d4d1f20"
server_key_version: "encryptionkey@0"
I20260811 00:55:45.434173 28040 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:45.451687 28040 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:45.454586 28040 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:45.454823 28040 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:45.461207 28040 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:40199
I20260811 00:55:45.461267 28170 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:40199 every 8 connection(s)
I20260811 00:55:45.461695 28040 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:55:45.462561 28171 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:45.465543 28171 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 802eda0d72274b71956fcba4925fd37a: Bootstrap starting.
I20260811 00:55:45.466342 28171 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 802eda0d72274b71956fcba4925fd37a: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:45.466607 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 28040
I20260811 00:55:45.466720 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 00:55:45.466792 28171 log.cc:824] T 00000000000000000000000000000000 P 802eda0d72274b71956fcba4925fd37a: Log is configured to *not* fsync() on all Append() calls
I20260811 00:55:45.466948 15640 external_mini_cluster.cc:1428] Setting key bfa70807fa5032bd23becd6c93a4e607
I20260811 00:55:45.468008 28171 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 802eda0d72274b71956fcba4925fd37a: No bootstrap required, opened a new log
I20260811 00:55:45.471469 28171 raft_consensus.cc:348] T 00000000000000000000000000000000 P 802eda0d72274b71956fcba4925fd37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "802eda0d72274b71956fcba4925fd37a" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 40199 } }
I20260811 00:55:45.471709 28171 raft_consensus.cc:374] T 00000000000000000000000000000000 P 802eda0d72274b71956fcba4925fd37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:45.471748 28171 raft_consensus.cc:729] T 00000000000000000000000000000000 P 802eda0d72274b71956fcba4925fd37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 802eda0d72274b71956fcba4925fd37a, State: Initialized, Role: FOLLOWER
I20260811 00:55:45.471906 28171 consensus_queue.cc:260] T 00000000000000000000000000000000 P 802eda0d72274b71956fcba4925fd37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "802eda0d72274b71956fcba4925fd37a" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 40199 } }
I20260811 00:55:45.472025 28171 raft_consensus.cc:388] T 00000000000000000000000000000000 P 802eda0d72274b71956fcba4925fd37a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:55:45.472067 28171 raft_consensus.cc:482] T 00000000000000000000000000000000 P 802eda0d72274b71956fcba4925fd37a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:55:45.472129 28171 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 802eda0d72274b71956fcba4925fd37a [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:45.473157 28171 raft_consensus.cc:504] T 00000000000000000000000000000000 P 802eda0d72274b71956fcba4925fd37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "802eda0d72274b71956fcba4925fd37a" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 40199 } }
I20260811 00:55:45.473320 28171 leader_election.cc:302] T 00000000000000000000000000000000 P 802eda0d72274b71956fcba4925fd37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 802eda0d72274b71956fcba4925fd37a; no voters:
I20260811 00:55:45.473593 28171 leader_election.cc:288] T 00000000000000000000000000000000 P 802eda0d72274b71956fcba4925fd37a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:55:45.473627 28179 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 802eda0d72274b71956fcba4925fd37a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:55:45.473762 28179 raft_consensus.cc:686] T 00000000000000000000000000000000 P 802eda0d72274b71956fcba4925fd37a [term 1 LEADER]: Becoming Leader. State: Replica: 802eda0d72274b71956fcba4925fd37a, State: Running, Role: LEADER
I20260811 00:55:45.473882 28179 consensus_queue.cc:237] T 00000000000000000000000000000000 P 802eda0d72274b71956fcba4925fd37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "802eda0d72274b71956fcba4925fd37a" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 40199 } }
I20260811 00:55:45.473964 28171 sys_catalog.cc:564] T 00000000000000000000000000000000 P 802eda0d72274b71956fcba4925fd37a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:55:45.474303 28179 sys_catalog.cc:455] T 00000000000000000000000000000000 P 802eda0d72274b71956fcba4925fd37a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "802eda0d72274b71956fcba4925fd37a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "802eda0d72274b71956fcba4925fd37a" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 40199 } } }
I20260811 00:55:45.474385 28179 sys_catalog.cc:458] T 00000000000000000000000000000000 P 802eda0d72274b71956fcba4925fd37a [sys.catalog]: This master's current role is: LEADER
I20260811 00:55:45.474551 28179 sys_catalog.cc:455] T 00000000000000000000000000000000 P 802eda0d72274b71956fcba4925fd37a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 802eda0d72274b71956fcba4925fd37a. Latest consensus state: current_term: 1 leader_uuid: "802eda0d72274b71956fcba4925fd37a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "802eda0d72274b71956fcba4925fd37a" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 40199 } } }
I20260811 00:55:45.474635 28179 sys_catalog.cc:458] T 00000000000000000000000000000000 P 802eda0d72274b71956fcba4925fd37a [sys.catalog]: This master's current role is: LEADER
I20260811 00:55:45.474797 28188 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:55:45.475536 28188 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 00:55:45 dist-test-slave-h3ft krb5kdc[28020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409745, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM
I20260811 00:55:45.477717 28188 catalog_manager.cc:1347] Generated new cluster ID: 2994ef5d06f1412e9a219d69165f7bc5
I20260811 00:55:45.477782 28188 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:55:45.480610 28178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:45.467729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44296 (local address 127.15.70.62:40199)
0811 00:55:45.467987 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:45.467997 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:45.468030 (+ 33us) server_negotiation.cc:407] Connection header received
0811 00:55:45.468651 (+ 621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:45.468659 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:45.468724 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:45.468866 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:45.469873 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:45.470824 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:45.472070 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:45.472606 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:45.472701 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:45.476298 (+ 3597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:45.476303 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:45.476303 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:45.476319 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:45.478616 (+ 2297us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:45.479154 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:45.479157 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:45.479158 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:45.479277 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:45.479552 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:45.479553 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:45.479553 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:45.479889 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:45.480062 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:45.480222 (+ 160us) server_negotiation.cc:299] Negotiation successful
0811 00:55:45.480373 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":118,"threads_started":1}
I20260811 00:55:45.485757 28188 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:55:45.486686 28188 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:55:45.492794 28188 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 802eda0d72274b71956fcba4925fd37a: Generated new TSK 0
I20260811 00:55:45.493074 28188 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.15.70.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.70.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.70.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.1.keytab.
Entry for principal oryx/127.15.70.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.1.keytab.
I20260811 00:55:45.531955 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.1:0
--local_ip_for_outbound_sockets=127.15.70.1
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:40199
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.1.keytab
--principal=oryx/127.15.70.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:38921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:45.638836 28216 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:45.639247 28216 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:45.639292 28216 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:45.640532 28216 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:45.640612 28216 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:45.640648 28216 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 00:55:45.640692 28216 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.1
I20260811 00:55:45.642486 28216 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:38921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.1.keytab
--principal=oryx/127.15.70.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.70.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.70.62:40199
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28216
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.1
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:45.642853 28216 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:45.643205 28216 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:45.649791 28226 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:45.649868 28230 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:45.649821 28225 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:45.650601 28216 server_base.cc:1034] running on GCE node
I20260811 00:55:45.650869 28216 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:45.651289 28216 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:45.652468 28216 hybrid_clock.cc:648] HybridClock initialized: now 1786409745652445 us; error 46 us; skew 500 ppm
Aug 11 00:55:45 dist-test-slave-h3ft krb5kdc[28020](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409745, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.70.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:45.656090 28216 init.cc:377] Logged in from keytab as oryx/127.15.70.1@KRBTEST.COM (short username oryx)
I20260811 00:55:45.656731 28216 webserver.cc:460] Webserver started at http://127.15.70.1:37655/ using document root <none> and password file <none>
I20260811 00:55:45.657065 28216 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:45.657156 28216 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:45.657347 28216 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:45.658799 28216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-0/data/instance:
uuid: "06cdf1fe87894a70beb28a86a7f36534"
format_stamp: "Formatted at 2026-08-11 00:55:45 on dist-test-slave-h3ft"
server_key: "d1421053569e747d60ff5c77a56c65f8"
server_key_iv: "5a33908024d7064ceca72e56042d421b"
server_key_version: "encryptionkey@0"
I20260811 00:55:45.659456 28216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance:
uuid: "06cdf1fe87894a70beb28a86a7f36534"
format_stamp: "Formatted at 2026-08-11 00:55:45 on dist-test-slave-h3ft"
server_key: "d1421053569e747d60ff5c77a56c65f8"
server_key_iv: "5a33908024d7064ceca72e56042d421b"
server_key_version: "encryptionkey@0"
I20260811 00:55:45.661340 28216 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260811 00:55:45.662405 28248 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:45.662650 28216 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:45.662786 28216 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-0/wal
uuid: "06cdf1fe87894a70beb28a86a7f36534"
format_stamp: "Formatted at 2026-08-11 00:55:45 on dist-test-slave-h3ft"
server_key: "d1421053569e747d60ff5c77a56c65f8"
server_key_iv: "5a33908024d7064ceca72e56042d421b"
server_key_version: "encryptionkey@0"
I20260811 00:55:45.662886 28216 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:45.683075 28216 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:45.686511 28216 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:45.686844 28216 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:45.687700 28216 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:55:45.687785 28216 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:45.687839 28216 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:55:45.687866 28216 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:45.697468 28216 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.1:33573
I20260811 00:55:45.697609 28445 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.1:33573 every 8 connection(s)
Aug 11 00:55:45 dist-test-slave-h3ft krb5kdc[28020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409745, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.70.1@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM
I20260811 00:55:45.698026 28216 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
I20260811 00:55:45.701493 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 28216
I20260811 00:55:45.701651 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance
I20260811 00:55:45.701923 15640 external_mini_cluster.cc:1428] Setting key fb683a797cb45e574ad5765d8f464fd2
I20260811 00:55:45.702317 28178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:45.688544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:36373 (local address 127.15.70.62:40199)
0811 00:55:45.688616 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:45.688619 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:45.688793 (+ 174us) server_negotiation.cc:407] Connection header received
0811 00:55:45.689626 (+ 833us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:45.689629 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:45.689651 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:45.689741 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:45.691140 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:45.692183 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:45.694331 (+ 2148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:45.694723 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:45.694825 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:45.698685 (+ 3860us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:45.698689 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:45.698689 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:45.698703 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:45.700377 (+ 1674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:45.700935 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:45.700936 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:45.700937 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:45.701007 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:45.701344 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:45.701345 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:45.701346 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:45.701515 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:45.701613 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:45.702031 (+ 418us) server_negotiation.cc:299] Negotiation successful
0811 00:55:45.702182 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 00:55:45.702471 28259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:45.688397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:40199 (local address 127.15.70.1:36373)
0811 00:55:45.688625 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:45.688686 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:45.689415 (+ 729us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:45.689873 (+ 458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:45.689877 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:45.690428 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:45.690819 (+ 391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:45.690832 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:45.692362 (+ 1530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:45.692363 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:45.694167 (+ 1804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:45.694173 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:45.694856 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:45.694857 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:45.695116 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:45.696098 (+ 982us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:45.696115 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:45.698530 (+ 2415us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:45.700498 (+ 1968us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:45.700508 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:45.700511 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:45.700849 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:45.701081 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:45.701082 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:45.701082 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:45.701265 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:45.701593 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:45.701603 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:45.701831 (+ 228us) client_negotiation.cc:769] Sending connection context
0811 00:55:45.701967 (+ 136us) client_negotiation.cc:240] Negotiation successful
0811 00:55:45.702212 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":99,"threads_started":1}
I20260811 00:55:45.705727 28446 heartbeater.cc:347] Connected to a master server at 127.15.70.62:40199
I20260811 00:55:45.705873 28446 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:45.706135 28446 heartbeater.cc:511] Master 127.15.70.62:40199 requested a full tablet report, sending...
I20260811 00:55:45.707154 28097 ts_manager.cc:194] Registered new tserver with Master: 06cdf1fe87894a70beb28a86a7f36534 (127.15.70.1:33573)
I20260811 00:55:45.708181 28097 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.70.1@KRBTEST.COM'} at 127.15.70.1:36373
I20260811 00:55:45.713557 28178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:45.704848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:44349 (local address 127.15.70.62:40199)
0811 00:55:45.704965 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:45.704968 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:45.705103 (+ 135us) server_negotiation.cc:407] Connection header received
0811 00:55:45.705141 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:45.705142 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:45.705156 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:45.705216 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:45.705780 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:45.706677 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:45.708009 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:45.708339 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:45.708420 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:45.710174 (+ 1754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:45.710176 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:45.710176 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:45.710184 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:45.711957 (+ 1773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:45.712452 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:45.712453 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:45.712454 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:45.712527 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:45.712845 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:45.712847 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:45.712847 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:45.713008 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:45.713094 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:45.713357 (+ 263us) server_negotiation.cc:299] Negotiation successful
0811 00:55:45.713476 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260811 00:55:45.713598 28456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:45.704715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:40199 (local address 127.15.70.1:44349)
0811 00:55:45.704962 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:45.704978 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:45.705071 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:45.705247 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:45.705248 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:45.705563 (+ 315us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:45.705667 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:45.705670 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:45.706950 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:45.706951 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:45.707883 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:45.707888 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:45.708502 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:45.708503 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:45.708591 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:45.709301 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:45.709398 (+ 97us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:45.710039 (+ 641us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:45.712066 (+ 2027us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:45.712069 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:45.712069 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:45.712348 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:45.712622 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:45.712623 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:45.712623 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:45.712718 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:45.713098 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:45.713100 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:45.713172 (+ 72us) client_negotiation.cc:769] Sending connection context
0811 00:55:45.713258 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 00:55:45.713416 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":151,"threads_started":1}
WARNING: no policy specified for oryx/127.15.70.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.70.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.70.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.2.keytab.
Entry for principal oryx/127.15.70.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.2.keytab.
I20260811 00:55:45.743291 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.2:0
--local_ip_for_outbound_sockets=127.15.70.2
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:40199
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.2.keytab
--principal=oryx/127.15.70.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:38921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:45.843219 28460 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:45.843523 28460 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:45.843568 28460 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:45.845803 28460 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:45.845872 28460 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:45.845906 28460 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 00:55:45.845940 28460 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.2
I20260811 00:55:45.848376 28460 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:38921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.2.keytab
--principal=oryx/127.15.70.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.70.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.70.62:40199
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28460
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.2
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:45.848723 28460 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:45.849080 28460 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:45.855376 28470 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:45.855388 28472 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:45.855391 28468 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:45.855619 28460 server_base.cc:1034] running on GCE node
I20260811 00:55:45.855870 28460 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:45.856175 28460 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:45.857365 28460 hybrid_clock.cc:648] HybridClock initialized: now 1786409745857345 us; error 36 us; skew 500 ppm
Aug 11 00:55:45 dist-test-slave-h3ft krb5kdc[28020](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409745, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.70.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:45.860852 28460 init.cc:377] Logged in from keytab as oryx/127.15.70.2@KRBTEST.COM (short username oryx)
I20260811 00:55:45.861653 28460 webserver.cc:460] Webserver started at http://127.15.70.2:42223/ using document root <none> and password file <none>
I20260811 00:55:45.861992 28460 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:45.862075 28460 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:45.862252 28460 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:45.863758 28460 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-1/data/instance:
uuid: "a9f3759bcaa743f5aba85ea86ad9145d"
format_stamp: "Formatted at 2026-08-11 00:55:45 on dist-test-slave-h3ft"
server_key: "2c456586411ce35c765fc8b436f90f47"
server_key_iv: "7603f8dab950278011674b3d8b17e21b"
server_key_version: "encryptionkey@0"
I20260811 00:55:45.864279 28460 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance:
uuid: "a9f3759bcaa743f5aba85ea86ad9145d"
format_stamp: "Formatted at 2026-08-11 00:55:45 on dist-test-slave-h3ft"
server_key: "2c456586411ce35c765fc8b436f90f47"
server_key_iv: "7603f8dab950278011674b3d8b17e21b"
server_key_version: "encryptionkey@0"
I20260811 00:55:45.866110 28460 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 00:55:45.867250 28482 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:45.867507 28460 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:45.867632 28460 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-1/wal
uuid: "a9f3759bcaa743f5aba85ea86ad9145d"
format_stamp: "Formatted at 2026-08-11 00:55:45 on dist-test-slave-h3ft"
server_key: "2c456586411ce35c765fc8b436f90f47"
server_key_iv: "7603f8dab950278011674b3d8b17e21b"
server_key_version: "encryptionkey@0"
I20260811 00:55:45.867739 28460 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:45.892416 28460 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:45.895287 28460 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:45.895489 28460 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:45.896287 28460 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:55:45.896354 28460 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:45.896395 28460 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:55:45.896418 28460 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 00:55:45 dist-test-slave-h3ft krb5kdc[28020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409745, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.70.2@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM
I20260811 00:55:45.906134 28460 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.2:46787
I20260811 00:55:45.906262 28678 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.2:46787 every 8 connection(s)
I20260811 00:55:45.906719 28460 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
I20260811 00:55:45.909662 28178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:45.896885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:54069 (local address 127.15.70.62:40199)
0811 00:55:45.896976 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:45.896978 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:45.897285 (+ 307us) server_negotiation.cc:407] Connection header received
0811 00:55:45.898326 (+ 1041us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:45.898328 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:45.898347 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:45.898417 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:45.899381 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:45.900058 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:45.901254 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:45.901491 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:45.901593 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:45.906278 (+ 4685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:45.906281 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:45.906281 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:45.906294 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:45.908201 (+ 1907us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:45.908700 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:45.908700 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:45.908701 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:45.908762 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:45.908999 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:45.909001 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:45.909001 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:45.909141 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:45.909207 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:45.909494 (+ 287us) server_negotiation.cc:299] Negotiation successful
0811 00:55:45.909578 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 00:55:45.909957 28495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:45.896840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:40199 (local address 127.15.70.2:54069)
0811 00:55:45.897096 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:45.897159 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:45.898139 (+ 980us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:45.898542 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:45.898547 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:45.898933 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:45.899269 (+ 336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:45.899277 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:45.900170 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:45.900171 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:45.901143 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:45.901146 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:45.901631 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:45.901632 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:45.901824 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:45.902621 (+ 797us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:45.902635 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:45.906096 (+ 3461us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:45.908314 (+ 2218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:45.908323 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:45.908325 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:45.908619 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:45.908823 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:45.908824 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:45.908824 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:45.908939 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:45.909209 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:45.909215 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:45.909369 (+ 154us) client_negotiation.cc:769] Sending connection context
0811 00:55:45.909467 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 00:55:45.909636 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":123,"threads_started":1}
I20260811 00:55:45.910772 28680 heartbeater.cc:347] Connected to a master server at 127.15.70.62:40199
I20260811 00:55:45.910882 28680 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:45.911157 28680 heartbeater.cc:511] Master 127.15.70.62:40199 requested a full tablet report, sending...
I20260811 00:55:45.911706 28096 ts_manager.cc:194] Registered new tserver with Master: a9f3759bcaa743f5aba85ea86ad9145d (127.15.70.2:46787)
I20260811 00:55:45.912062 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 28460
I20260811 00:55:45.912195 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance
I20260811 00:55:45.912348 28096 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.70.2@KRBTEST.COM'} at 127.15.70.2:54069
I20260811 00:55:45.912456 15640 external_mini_cluster.cc:1428] Setting key 066f4fac6b36c9765c75e29e1cd3256d
I20260811 00:55:45.919126 28178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:45.912671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:55771 (local address 127.15.70.62:40199)
0811 00:55:45.912744 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:45.912747 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:45.912756 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:55:45.912781 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:45.912781 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:45.912794 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:45.912858 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:45.913329 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:45.913903 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:45.914677 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:45.914900 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:45.914985 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:45.916166 (+ 1181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:45.916168 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:45.916169 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:45.916177 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:45.917708 (+ 1531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:45.918099 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:45.918100 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:45.918101 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:45.918169 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:45.918390 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:45.918391 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:45.918391 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:45.918581 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:45.918678 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:45.918896 (+ 218us) server_negotiation.cc:299] Negotiation successful
0811 00:55:45.918990 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 00:55:45.919137 28687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:45.912223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:40199 (local address 127.15.70.2:55771)
0811 00:55:45.912398 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:45.912409 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:45.912501 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:45.912872 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:45.912873 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:45.913160 (+ 287us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:45.913246 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:45.913249 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:45.914021 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:45.914022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:45.914577 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:45.914579 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:45.914981 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:45.914983 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:45.915102 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:45.915683 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:45.915688 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:45.916064 (+ 376us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:45.917820 (+ 1756us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:45.917821 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:45.917822 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:45.918012 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:45.918242 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:45.918243 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:45.918244 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:45.918314 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:45.918711 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:45.918713 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:45.918767 (+ 54us) client_negotiation.cc:769] Sending connection context
0811 00:55:45.918845 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 00:55:45.918983 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":77,"threads_started":1}
WARNING: no policy specified for oryx/127.15.70.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.70.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.70.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.3.keytab.
Entry for principal oryx/127.15.70.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.3.keytab.
I20260811 00:55:45.947222 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.3:0
--local_ip_for_outbound_sockets=127.15.70.3
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:40199
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.3.keytab
--principal=oryx/127.15.70.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:38921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:46.045390 28691 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:46.045733 28691 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:46.045779 28691 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:46.047045 28691 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:46.047139 28691 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:46.047175 28691 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 00:55:46.047219 28691 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.3
I20260811 00:55:46.049005 28691 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:38921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.3.keytab
--principal=oryx/127.15.70.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.70.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.70.62:40199
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28691
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.3
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:46.049355 28691 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:46.049695 28691 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 00:55:46.056219 28691 server_base.cc:1034] running on GCE node
W20260811 00:55:46.056089 28698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:46.056197 28697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:46.056089 28700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:46.056623 28691 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:46.056901 28691 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:46.058118 28691 hybrid_clock.cc:648] HybridClock initialized: now 1786409746058104 us; error 55 us; skew 500 ppm
Aug 11 00:55:46 dist-test-slave-h3ft krb5kdc[28020](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409746, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.70.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:46.061476 28691 init.cc:377] Logged in from keytab as oryx/127.15.70.3@KRBTEST.COM (short username oryx)
I20260811 00:55:46.062100 28691 webserver.cc:460] Webserver started at http://127.15.70.3:43731/ using document root <none> and password file <none>
I20260811 00:55:46.062345 28691 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:46.062395 28691 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:46.062513 28691 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:46.063879 28691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-2/data/instance:
uuid: "b5c138fd875e47b1af3b586daaeec397"
format_stamp: "Formatted at 2026-08-11 00:55:46 on dist-test-slave-h3ft"
server_key: "92c206dce1ad3efa6e93f5f1e869a8fa"
server_key_iv: "1fce144070a0088306a4b14bd4f953ac"
server_key_version: "encryptionkey@0"
I20260811 00:55:46.064365 28691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance:
uuid: "b5c138fd875e47b1af3b586daaeec397"
format_stamp: "Formatted at 2026-08-11 00:55:46 on dist-test-slave-h3ft"
server_key: "92c206dce1ad3efa6e93f5f1e869a8fa"
server_key_iv: "1fce144070a0088306a4b14bd4f953ac"
server_key_version: "encryptionkey@0"
I20260811 00:55:46.066253 28691 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 00:55:46.067401 28713 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:46.067793 28691 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:46.067924 28691 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-2/wal
uuid: "b5c138fd875e47b1af3b586daaeec397"
format_stamp: "Formatted at 2026-08-11 00:55:46 on dist-test-slave-h3ft"
server_key: "92c206dce1ad3efa6e93f5f1e869a8fa"
server_key_iv: "1fce144070a0088306a4b14bd4f953ac"
server_key_version: "encryptionkey@0"
I20260811 00:55:46.068027 28691 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:46.079900 28691 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:46.082742 28691 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:46.082890 28691 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:46.083745 28691 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:55:46.083817 28691 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:46.083865 28691 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:55:46.083884 28691 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 00:55:46 dist-test-slave-h3ft krb5kdc[28020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409746, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.70.3@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM
I20260811 00:55:46.093295 28691 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.3:38873
I20260811 00:55:46.093397 28905 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.3:38873 every 8 connection(s)
I20260811 00:55:46.093839 28691 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
I20260811 00:55:46.094728 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 28691
I20260811 00:55:46.094867 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance
I20260811 00:55:46.095166 15640 external_mini_cluster.cc:1428] Setting key b8e82cf6cb8714d044b9dfdbc24382d0
I20260811 00:55:46.095973 28178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:46.084258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:39581 (local address 127.15.70.62:40199)
0811 00:55:46.084351 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:46.084354 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:46.084607 (+ 253us) server_negotiation.cc:407] Connection header received
0811 00:55:46.085238 (+ 631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:46.085240 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:46.085257 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:46.085356 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:46.086278 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.086973 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.088245 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.088493 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.088579 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:46.091876 (+ 3297us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:46.091879 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:46.091879 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:46.091891 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:46.093842 (+ 1951us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:46.094379 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:46.094381 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:46.094381 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:46.094453 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:46.094778 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:46.094779 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:46.094779 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:46.095092 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:46.095171 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:46.095721 (+ 550us) server_negotiation.cc:299] Negotiation successful
0811 00:55:46.095857 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 00:55:46.096012 28724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:46.084240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:40199 (local address 127.15.70.3:39581)
0811 00:55:46.084439 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:46.084486 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:46.085117 (+ 631us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:46.085426 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:46.085430 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:46.085840 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:46.086159 (+ 319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:46.086166 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.087164 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.087165 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:46.088128 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:46.088130 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.088590 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.088591 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:46.088740 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:46.089430 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:46.089452 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:46.091747 (+ 2295us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:46.093942 (+ 2195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:46.093950 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:46.093953 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:46.094267 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:46.094569 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:46.094570 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:46.094570 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:46.094695 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:46.095158 (+ 463us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:46.095164 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:46.095378 (+ 214us) client_negotiation.cc:769] Sending connection context
0811 00:55:46.095506 (+ 128us) client_negotiation.cc:240] Negotiation successful
0811 00:55:46.095691 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":134,"threads_started":1}
I20260811 00:55:46.096511 28907 heartbeater.cc:347] Connected to a master server at 127.15.70.62:40199
I20260811 00:55:46.096638 28907 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:46.096853 28907 heartbeater.cc:511] Master 127.15.70.62:40199 requested a full tablet report, sending...
I20260811 00:55:46.097363 28092 ts_manager.cc:194] Registered new tserver with Master: b5c138fd875e47b1af3b586daaeec397 (127.15.70.3:38873)
I20260811 00:55:46.097921 28092 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.70.3@KRBTEST.COM'} at 127.15.70.3:39581
I20260811 00:55:46.104749 28178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:46.097942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:53661 (local address 127.15.70.62:40199)
0811 00:55:46.097992 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:46.097994 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:46.098082 (+ 88us) server_negotiation.cc:407] Connection header received
0811 00:55:46.098152 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:46.098152 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:46.098166 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:46.098283 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:46.098699 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.099308 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.100069 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.100299 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.100381 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:46.101634 (+ 1253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:46.101636 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:46.101637 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:46.101645 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:46.103324 (+ 1679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:46.103738 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:46.103740 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:46.103741 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:46.103813 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:46.104106 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:46.104107 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:46.104107 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:46.104251 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:46.104340 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:46.104534 (+ 194us) server_negotiation.cc:299] Negotiation successful
0811 00:55:46.104626 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 00:55:46.104768 28914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:46.097863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:40199 (local address 127.15.70.3:53661)
0811 00:55:46.098012 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:46.098025 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:46.098100 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:46.098289 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:46.098290 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:46.098533 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:46.098603 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:46.098605 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.099418 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.099419 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:46.099972 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:46.099974 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.100379 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.100380 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:46.100461 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:46.101073 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:46.101079 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:46.101474 (+ 395us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:46.103435 (+ 1961us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:46.103436 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:46.103437 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:46.103655 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:46.103896 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:46.103897 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:46.103897 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:46.104003 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:46.104327 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:46.104328 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:46.104389 (+ 61us) client_negotiation.cc:769] Sending connection context
0811 00:55:46.104477 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 00:55:46.104628 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":87,"threads_started":1}
I20260811 00:55:46.107511 15640 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 00:55:46 dist-test-slave-h3ft krb5kdc[28020](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409746, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 00:55:46 dist-test-slave-h3ft krb5kdc[28020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:55:46 dist-test-slave-h3ft krb5kdc[28020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
W20260811 00:55:46.136138 28178 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:55:46.128782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44310 (local address 127.15.70.62:40199)
0811 00:55:46.128878 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:46.128880 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:46.128891 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:55:46.128962 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:46.128963 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:46.128976 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:46.129048 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:46.129827 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.130536 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.131464 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.131694 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.131763 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:46.135965 (+ 4202us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44310: BlockingRecv error: recv got EOF from 127.0.0.1:44310 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 11 00:55:46 dist-test-slave-h3ft krb5kdc[28020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409746, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM
I20260811 00:55:46.145767 28178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:46.137035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44324 (local address 127.15.70.62:40199)
0811 00:55:46.137112 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:46.137114 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:46.137231 (+ 117us) server_negotiation.cc:407] Connection header received
0811 00:55:46.137284 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:46.137284 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:46.137313 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:46.137368 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:46.137919 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.138545 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.139483 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.139696 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.139811 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:46.142581 (+ 2770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:46.142584 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:46.142584 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:46.142600 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:46.144235 (+ 1635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:46.144659 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:46.144661 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:46.144662 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:46.144734 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:46.144967 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:46.144968 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:46.144969 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:46.145121 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:46.145259 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:46.145501 (+ 242us) server_negotiation.cc:299] Negotiation successful
0811 00:55:46.145627 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 00:55:46.148540 28092 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44324:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:55:46.150830 28092 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:55:46.159363 28940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:46.154258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:38873 (local address 127.0.0.1:52536)
0811 00:55:46.154516 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:46.154567 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:46.154655 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:46.155219 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:46.155222 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:46.155225 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:46.155324 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:46.155327 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.156753 (+ 1426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.156754 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:46.157876 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:46.157878 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.158933 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.158935 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:46.159067 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:46.159089 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 00:55:46.159181 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 00:55:46.159264 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":220,"mutex_wait_us":5,"thread_start_us":130,"threads_started":1}
I20260811 00:55:46.159346 28943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:46.154534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52536 (local address 127.15.70.3:38873)
0811 00:55:46.154824 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:46.154830 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:46.154844 (+ 14us) server_negotiation.cc:407] Connection header received
0811 00:55:46.154894 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:46.154896 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:46.154915 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:46.155080 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:46.155396 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.156646 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.157994 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.158837 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.158923 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:46.159069 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:46.159196 (+ 127us) server_negotiation.cc:299] Negotiation successful
0811 00:55:46.159239 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":246,"thread_start_us":135,"threads_started":1}
I20260811 00:55:46.160028 28937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:46.154258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:33573 (local address 127.0.0.1:53576)
0811 00:55:46.154840 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:46.154853 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:46.154921 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:46.155442 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:46.155443 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:46.155446 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:46.155483 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:46.155484 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.156438 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.156439 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:46.157875 (+ 1436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:46.157879 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.159756 (+ 1877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.159756 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:46.159823 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:46.159828 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 00:55:46.159888 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 00:55:46.159947 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":564,"mutex_wait_us":24,"spinlock_wait_cycles":768,"thread_start_us":117,"threads_started":1}
I20260811 00:55:46.160116 28944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:46.154546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53576 (local address 127.15.70.1:33573)
0811 00:55:46.155238 (+ 692us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:46.155242 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:46.155253 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:55:46.155300 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:46.155303 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:46.155320 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:46.155556 (+ 236us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:46.155618 (+ 62us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.156316 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.157995 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.158837 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.158923 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:46.159057 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:46.159929 (+ 872us) server_negotiation.cc:299] Negotiation successful
0811 00:55:46.159987 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":637,"thread_start_us":137,"threads_started":1}
I20260811 00:55:46.160360 28798 tablet_service.cc:1467] Processing CreateTablet for tablet 65a168a54d234bc0a34b745ffdbcc563 (DEFAULT_TABLE table=test-table [id=f99fd9af52cf44e0bb3e1b994c1c6ce2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:55:46.160699 28942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:46.154271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.2:46787 (local address 127.0.0.1:44752)
0811 00:55:46.154783 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:46.154793 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:46.154839 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:46.155313 (+ 474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:46.155314 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:46.155316 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:46.155381 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:46.155383 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.157999 (+ 2616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.157999 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:46.158709 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:46.158710 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.160365 (+ 1655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.160367 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:46.160421 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:46.160425 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:55:46.160509 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 00:55:46.160553 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":93,"threads_started":1}
I20260811 00:55:46.160714 28945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:46.154636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44752 (local address 127.15.70.2:46787)
0811 00:55:46.155035 (+ 399us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:46.155040 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:46.155053 (+ 13us) server_negotiation.cc:407] Connection header received
0811 00:55:46.155107 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:46.155109 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:46.155127 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:46.155216 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:46.155486 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.156646 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.158817 (+ 2171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.159886 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.159964 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:46.160043 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:46.160534 (+ 491us) server_negotiation.cc:299] Negotiation successful
0811 00:55:46.160579 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":98,"threads_started":1}
I20260811 00:55:46.160780 28324 tablet_service.cc:1467] Processing CreateTablet for tablet 65a168a54d234bc0a34b745ffdbcc563 (DEFAULT_TABLE table=test-table [id=f99fd9af52cf44e0bb3e1b994c1c6ce2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:55:46.160904 28798 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65a168a54d234bc0a34b745ffdbcc563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:46.161158 28324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65a168a54d234bc0a34b745ffdbcc563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:46.161748 28564 tablet_service.cc:1467] Processing CreateTablet for tablet 65a168a54d234bc0a34b745ffdbcc563 (DEFAULT_TABLE table=test-table [id=f99fd9af52cf44e0bb3e1b994c1c6ce2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:55:46.162096 28564 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65a168a54d234bc0a34b745ffdbcc563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:46.165539 28946 tablet_bootstrap.cc:492] T 65a168a54d234bc0a34b745ffdbcc563 P b5c138fd875e47b1af3b586daaeec397: Bootstrap starting.
I20260811 00:55:46.165951 28950 tablet_bootstrap.cc:492] T 65a168a54d234bc0a34b745ffdbcc563 P 06cdf1fe87894a70beb28a86a7f36534: Bootstrap starting.
I20260811 00:55:46.166643 28950 tablet_bootstrap.cc:654] T 65a168a54d234bc0a34b745ffdbcc563 P 06cdf1fe87894a70beb28a86a7f36534: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:46.166643 28946 tablet_bootstrap.cc:654] T 65a168a54d234bc0a34b745ffdbcc563 P b5c138fd875e47b1af3b586daaeec397: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:46.167101 28950 log.cc:824] T 65a168a54d234bc0a34b745ffdbcc563 P 06cdf1fe87894a70beb28a86a7f36534: Log is configured to *not* fsync() on all Append() calls
I20260811 00:55:46.167100 28946 log.cc:824] T 65a168a54d234bc0a34b745ffdbcc563 P b5c138fd875e47b1af3b586daaeec397: Log is configured to *not* fsync() on all Append() calls
I20260811 00:55:46.167507 28948 tablet_bootstrap.cc:492] T 65a168a54d234bc0a34b745ffdbcc563 P a9f3759bcaa743f5aba85ea86ad9145d: Bootstrap starting.
I20260811 00:55:46.168113 28950 tablet_bootstrap.cc:492] T 65a168a54d234bc0a34b745ffdbcc563 P 06cdf1fe87894a70beb28a86a7f36534: No bootstrap required, opened a new log
I20260811 00:55:46.168205 28950 ts_tablet_manager.cc:1397] T 65a168a54d234bc0a34b745ffdbcc563 P 06cdf1fe87894a70beb28a86a7f36534: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 00:55:46.168246 28948 tablet_bootstrap.cc:654] T 65a168a54d234bc0a34b745ffdbcc563 P a9f3759bcaa743f5aba85ea86ad9145d: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:46.168637 28948 log.cc:824] T 65a168a54d234bc0a34b745ffdbcc563 P a9f3759bcaa743f5aba85ea86ad9145d: Log is configured to *not* fsync() on all Append() calls
I20260811 00:55:46.169282 28946 tablet_bootstrap.cc:492] T 65a168a54d234bc0a34b745ffdbcc563 P b5c138fd875e47b1af3b586daaeec397: No bootstrap required, opened a new log
I20260811 00:55:46.169366 28946 ts_tablet_manager.cc:1397] T 65a168a54d234bc0a34b745ffdbcc563 P b5c138fd875e47b1af3b586daaeec397: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20260811 00:55:46.169552 28948 tablet_bootstrap.cc:492] T 65a168a54d234bc0a34b745ffdbcc563 P a9f3759bcaa743f5aba85ea86ad9145d: No bootstrap required, opened a new log
I20260811 00:55:46.169641 28948 ts_tablet_manager.cc:1397] T 65a168a54d234bc0a34b745ffdbcc563 P a9f3759bcaa743f5aba85ea86ad9145d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 00:55:46.170771 28950 raft_consensus.cc:348] T 65a168a54d234bc0a34b745ffdbcc563 P 06cdf1fe87894a70beb28a86a7f36534 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } } peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } }
I20260811 00:55:46.171030 28950 raft_consensus.cc:374] T 65a168a54d234bc0a34b745ffdbcc563 P 06cdf1fe87894a70beb28a86a7f36534 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:46.171083 28950 raft_consensus.cc:729] T 65a168a54d234bc0a34b745ffdbcc563 P 06cdf1fe87894a70beb28a86a7f36534 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06cdf1fe87894a70beb28a86a7f36534, State: Initialized, Role: FOLLOWER
I20260811 00:55:46.171255 28950 consensus_queue.cc:260] T 65a168a54d234bc0a34b745ffdbcc563 P 06cdf1fe87894a70beb28a86a7f36534 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } } peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } }
I20260811 00:55:46.171594 28950 ts_tablet_manager.cc:1428] T 65a168a54d234bc0a34b745ffdbcc563 P 06cdf1fe87894a70beb28a86a7f36534: Time spent starting tablet: real 0.003s user 0.003s sys 0.001s
I20260811 00:55:46.171784 28446 heartbeater.cc:503] Master 127.15.70.62:40199 was elected leader, sending a full tablet report...
I20260811 00:55:46.171844 28948 raft_consensus.cc:348] T 65a168a54d234bc0a34b745ffdbcc563 P a9f3759bcaa743f5aba85ea86ad9145d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } } peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } }
I20260811 00:55:46.172009 28948 raft_consensus.cc:374] T 65a168a54d234bc0a34b745ffdbcc563 P a9f3759bcaa743f5aba85ea86ad9145d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:46.171947 28946 raft_consensus.cc:348] T 65a168a54d234bc0a34b745ffdbcc563 P b5c138fd875e47b1af3b586daaeec397 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } } peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } }
I20260811 00:55:46.172041 28948 raft_consensus.cc:729] T 65a168a54d234bc0a34b745ffdbcc563 P a9f3759bcaa743f5aba85ea86ad9145d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9f3759bcaa743f5aba85ea86ad9145d, State: Initialized, Role: FOLLOWER
I20260811 00:55:46.172122 28946 raft_consensus.cc:374] T 65a168a54d234bc0a34b745ffdbcc563 P b5c138fd875e47b1af3b586daaeec397 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:46.172158 28946 raft_consensus.cc:729] T 65a168a54d234bc0a34b745ffdbcc563 P b5c138fd875e47b1af3b586daaeec397 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5c138fd875e47b1af3b586daaeec397, State: Initialized, Role: FOLLOWER
I20260811 00:55:46.172212 28948 consensus_queue.cc:260] T 65a168a54d234bc0a34b745ffdbcc563 P a9f3759bcaa743f5aba85ea86ad9145d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } } peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } }
I20260811 00:55:46.172341 28946 consensus_queue.cc:260] T 65a168a54d234bc0a34b745ffdbcc563 P b5c138fd875e47b1af3b586daaeec397 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } } peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } }
I20260811 00:55:46.172572 28948 ts_tablet_manager.cc:1428] T 65a168a54d234bc0a34b745ffdbcc563 P a9f3759bcaa743f5aba85ea86ad9145d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 00:55:46.172667 28946 ts_tablet_manager.cc:1428] T 65a168a54d234bc0a34b745ffdbcc563 P b5c138fd875e47b1af3b586daaeec397: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260811 00:55:46.172727 28680 heartbeater.cc:503] Master 127.15.70.62:40199 was elected leader, sending a full tablet report...
I20260811 00:55:46.172814 28907 heartbeater.cc:503] Master 127.15.70.62:40199 was elected leader, sending a full tablet report...
W20260811 00:55:46.199172 28448 tablet.cc:2369] T 65a168a54d234bc0a34b745ffdbcc563 P 06cdf1fe87894a70beb28a86a7f36534: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 00:55:46.344729 28908 tablet.cc:2369] T 65a168a54d234bc0a34b745ffdbcc563 P b5c138fd875e47b1af3b586daaeec397: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 00:55:46.407716 28681 tablet.cc:2369] T 65a168a54d234bc0a34b745ffdbcc563 P a9f3759bcaa743f5aba85ea86ad9145d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 00:55:46.517580 28963 raft_consensus.cc:482] T 65a168a54d234bc0a34b745ffdbcc563 P b5c138fd875e47b1af3b586daaeec397 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:55:46.517812 28963 raft_consensus.cc:504] T 65a168a54d234bc0a34b745ffdbcc563 P b5c138fd875e47b1af3b586daaeec397 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } } peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } }
I20260811 00:55:46.518385 28963 leader_election.cc:288] T 65a168a54d234bc0a34b745ffdbcc563 P b5c138fd875e47b1af3b586daaeec397 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06cdf1fe87894a70beb28a86a7f36534 (127.15.70.1:33573), a9f3759bcaa743f5aba85ea86ad9145d (127.15.70.2:46787)
I20260811 00:55:46.521854 28724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:46.518628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.2:46787 (local address 127.15.70.3:57939)
0811 00:55:46.518708 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:46.518723 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:46.518784 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:46.519040 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:46.519042 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:46.519045 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:46.519144 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:46.519147 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.519966 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.519967 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:46.520876 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:46.520879 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.521493 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.521495 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:46.521606 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:46.521611 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 00:55:46.521666 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 00:55:46.521737 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49,"mutex_wait_us":24}
I20260811 00:55:46.521853 28944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:46.518681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:54469 (local address 127.15.70.1:33573)
0811 00:55:46.518742 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:46.518745 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:46.519111 (+ 366us) server_negotiation.cc:407] Connection header received
0811 00:55:46.519159 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:46.519160 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:46.519177 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:46.519244 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:46.519437 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.519960 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.521008 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.521423 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.521528 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:46.521544 (+ 16us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:46.521734 (+ 190us) server_negotiation.cc:299] Negotiation successful
0811 00:55:46.521778 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 00:55:46.521842 28945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:46.518673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:57939 (local address 127.15.70.2:46787)
0811 00:55:46.518731 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:46.518733 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:46.518767 (+ 34us) server_negotiation.cc:407] Connection header received
0811 00:55:46.518862 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:46.518863 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:46.518905 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:46.518965 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:46.519265 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.519873 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.520997 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.521400 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.521469 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:46.521482 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:46.521700 (+ 218us) server_negotiation.cc:299] Negotiation successful
0811 00:55:46.521757 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 00:55:46.521872 28964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:46.518629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:33573 (local address 127.15.70.3:54469)
0811 00:55:46.519029 (+ 400us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:46.519041 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:46.519106 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:46.519264 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:46.519265 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:46.519267 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:46.519359 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:46.519360 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.520058 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.520059 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:46.520878 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:46.520880 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.521555 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.521556 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:46.521628 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:46.521631 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:55:46.521711 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 00:55:46.521756 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"mutex_wait_us":96,"thread_start_us":150,"threads_started":1}
I20260811 00:55:46.522341 28362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65a168a54d234bc0a34b745ffdbcc563" candidate_uuid: "b5c138fd875e47b1af3b586daaeec397" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06cdf1fe87894a70beb28a86a7f36534" is_pre_election: true
I20260811 00:55:46.522341 28598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65a168a54d234bc0a34b745ffdbcc563" candidate_uuid: "b5c138fd875e47b1af3b586daaeec397" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" is_pre_election: true
I20260811 00:55:46.522562 28362 raft_consensus.cc:2454] T 65a168a54d234bc0a34b745ffdbcc563 P 06cdf1fe87894a70beb28a86a7f36534 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5c138fd875e47b1af3b586daaeec397 in term 0.
I20260811 00:55:46.522562 28598 raft_consensus.cc:2454] T 65a168a54d234bc0a34b745ffdbcc563 P a9f3759bcaa743f5aba85ea86ad9145d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5c138fd875e47b1af3b586daaeec397 in term 0.
I20260811 00:55:46.522859 28719 leader_election.cc:302] T 65a168a54d234bc0a34b745ffdbcc563 P b5c138fd875e47b1af3b586daaeec397 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06cdf1fe87894a70beb28a86a7f36534, b5c138fd875e47b1af3b586daaeec397; no voters:
I20260811 00:55:46.523106 28963 raft_consensus.cc:2781] T 65a168a54d234bc0a34b745ffdbcc563 P b5c138fd875e47b1af3b586daaeec397 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:55:46.523180 28963 raft_consensus.cc:482] T 65a168a54d234bc0a34b745ffdbcc563 P b5c138fd875e47b1af3b586daaeec397 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:55:46.523200 28963 raft_consensus.cc:3037] T 65a168a54d234bc0a34b745ffdbcc563 P b5c138fd875e47b1af3b586daaeec397 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:46.524434 28963 raft_consensus.cc:504] T 65a168a54d234bc0a34b745ffdbcc563 P b5c138fd875e47b1af3b586daaeec397 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } } peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } }
I20260811 00:55:46.524641 28963 leader_election.cc:288] T 65a168a54d234bc0a34b745ffdbcc563 P b5c138fd875e47b1af3b586daaeec397 [CANDIDATE]: Term 1 election: Requested vote from peers 06cdf1fe87894a70beb28a86a7f36534 (127.15.70.1:33573), a9f3759bcaa743f5aba85ea86ad9145d (127.15.70.2:46787)
I20260811 00:55:46.524861 28362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65a168a54d234bc0a34b745ffdbcc563" candidate_uuid: "b5c138fd875e47b1af3b586daaeec397" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06cdf1fe87894a70beb28a86a7f36534"
I20260811 00:55:46.524864 28598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65a168a54d234bc0a34b745ffdbcc563" candidate_uuid: "b5c138fd875e47b1af3b586daaeec397" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9f3759bcaa743f5aba85ea86ad9145d"
I20260811 00:55:46.524978 28362 raft_consensus.cc:3037] T 65a168a54d234bc0a34b745ffdbcc563 P 06cdf1fe87894a70beb28a86a7f36534 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:46.525031 28598 raft_consensus.cc:3037] T 65a168a54d234bc0a34b745ffdbcc563 P a9f3759bcaa743f5aba85ea86ad9145d [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:46.526113 28362 raft_consensus.cc:2454] T 65a168a54d234bc0a34b745ffdbcc563 P 06cdf1fe87894a70beb28a86a7f36534 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5c138fd875e47b1af3b586daaeec397 in term 1.
I20260811 00:55:46.526113 28598 raft_consensus.cc:2454] T 65a168a54d234bc0a34b745ffdbcc563 P a9f3759bcaa743f5aba85ea86ad9145d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5c138fd875e47b1af3b586daaeec397 in term 1.
I20260811 00:55:46.526382 28714 leader_election.cc:302] T 65a168a54d234bc0a34b745ffdbcc563 P b5c138fd875e47b1af3b586daaeec397 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9f3759bcaa743f5aba85ea86ad9145d, b5c138fd875e47b1af3b586daaeec397; no voters:
I20260811 00:55:46.526506 28963 raft_consensus.cc:2781] T 65a168a54d234bc0a34b745ffdbcc563 P b5c138fd875e47b1af3b586daaeec397 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:55:46.526778 28963 raft_consensus.cc:686] T 65a168a54d234bc0a34b745ffdbcc563 P b5c138fd875e47b1af3b586daaeec397 [term 1 LEADER]: Becoming Leader. State: Replica: b5c138fd875e47b1af3b586daaeec397, State: Running, Role: LEADER
I20260811 00:55:46.526932 28963 consensus_queue.cc:237] T 65a168a54d234bc0a34b745ffdbcc563 P b5c138fd875e47b1af3b586daaeec397 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } } peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } }
I20260811 00:55:46.528275 28096 catalog_manager.cc:5495] T 65a168a54d234bc0a34b745ffdbcc563 P b5c138fd875e47b1af3b586daaeec397 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5c138fd875e47b1af3b586daaeec397 (127.15.70.3). New cstate: current_term: 1 leader_uuid: "b5c138fd875e47b1af3b586daaeec397" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } health_report { overall_health: UNKNOWN } } }
I20260811 00:55:46.610472 28943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:46.607874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52548 (local address 127.15.70.3:38873)
0811 00:55:46.607948 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:46.607951 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:46.607960 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:55:46.608039 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:46.608039 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:46.608065 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:46.608144 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:55:46.608305 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.608830 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.609616 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.609805 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.609860 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:46.610053 (+ 193us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:55:46.610188 (+ 135us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:55:46.610273 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:46.610351 (+ 78us) server_negotiation.cc:299] Negotiation successful
0811 00:55:46.610376 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 00:55:46.612728 28598 raft_consensus.cc:1261] T 65a168a54d234bc0a34b745ffdbcc563 P a9f3759bcaa743f5aba85ea86ad9145d [term 1 FOLLOWER]: Refusing update from remote peer b5c138fd875e47b1af3b586daaeec397: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:55:46.612800 28362 raft_consensus.cc:1261] T 65a168a54d234bc0a34b745ffdbcc563 P 06cdf1fe87894a70beb28a86a7f36534 [term 1 FOLLOWER]: Refusing update from remote peer b5c138fd875e47b1af3b586daaeec397: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:55:46.613269 28966 consensus_queue.cc:1035] T 65a168a54d234bc0a34b745ffdbcc563 P b5c138fd875e47b1af3b586daaeec397 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:55:46.613488 28963 consensus_queue.cc:1035] T 65a168a54d234bc0a34b745ffdbcc563 P b5c138fd875e47b1af3b586daaeec397 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:55:46.617230 28973 mvcc.cc:205] Tried to move back new op lower bound from 7317134322122305536 to 7317134321775525888. Current Snapshot: MvccSnapshot[applied={T|T < 7317134322122305536}]
I20260811 00:55:46.618037 28974 mvcc.cc:205] Tried to move back new op lower bound from 7317134322122305536 to 7317134321775525888. Current Snapshot: MvccSnapshot[applied={T|T < 7317134322122305536}]
I20260811 00:55:46.620496 28096 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44324:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:55:46.620631 28096 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44324:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:55:46.621613 28096 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 802eda0d72274b71956fcba4925fd37a: Sending DeleteTablet for 3 replicas of tablet 65a168a54d234bc0a34b745ffdbcc563
I20260811 00:55:46.622090 28324 tablet_service.cc:1514] Processing DeleteTablet for tablet 65a168a54d234bc0a34b745ffdbcc563 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:55:46 UTC) from {username='oryx', principal='oryx/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:53576
I20260811 00:55:46.622081 28798 tablet_service.cc:1514] Processing DeleteTablet for tablet 65a168a54d234bc0a34b745ffdbcc563 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:55:46 UTC) from {username='oryx', principal='oryx/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:52536
I20260811 00:55:46.622380 28564 tablet_service.cc:1514] Processing DeleteTablet for tablet 65a168a54d234bc0a34b745ffdbcc563 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:55:46 UTC) from {username='oryx', principal='oryx/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:44752
I20260811 00:55:46.622545 28995 tablet_replica.cc:330] T 65a168a54d234bc0a34b745ffdbcc563 P b5c138fd875e47b1af3b586daaeec397: stopping tablet replica
I20260811 00:55:46.622668 28995 raft_consensus.cc:2229] T 65a168a54d234bc0a34b745ffdbcc563 P b5c138fd875e47b1af3b586daaeec397 [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:55:46.622685 28096 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44324:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 00:55:46.622830 28995 raft_consensus.cc:2258] T 65a168a54d234bc0a34b745ffdbcc563 P b5c138fd875e47b1af3b586daaeec397 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 00:55:46.622896 28096 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:55:46.623421 28995 ts_tablet_manager.cc:1905] T 65a168a54d234bc0a34b745ffdbcc563 P b5c138fd875e47b1af3b586daaeec397: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:55:46.624382 28324 tablet_service.cc:1467] Processing CreateTablet for tablet e7b81dcbc96a4a32bb064f89216295c9 (DEFAULT_TABLE table=test-table [id=b26fccac17be4c31b3a54ed904881166]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:55:46.624382 28564 tablet_service.cc:1467] Processing CreateTablet for tablet e7b81dcbc96a4a32bb064f89216295c9 (DEFAULT_TABLE table=test-table [id=b26fccac17be4c31b3a54ed904881166]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:55:46.624533 28564 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7b81dcbc96a4a32bb064f89216295c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:46.624533 28324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7b81dcbc96a4a32bb064f89216295c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:46.625566 28994 tablet_replica.cc:330] T 65a168a54d234bc0a34b745ffdbcc563 P 06cdf1fe87894a70beb28a86a7f36534: stopping tablet replica
I20260811 00:55:46.625703 28994 raft_consensus.cc:2229] T 65a168a54d234bc0a34b745ffdbcc563 P 06cdf1fe87894a70beb28a86a7f36534 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:55:46.625820 28994 raft_consensus.cc:2258] T 65a168a54d234bc0a34b745ffdbcc563 P 06cdf1fe87894a70beb28a86a7f36534 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:55:46.626055 28948 tablet_bootstrap.cc:492] T e7b81dcbc96a4a32bb064f89216295c9 P a9f3759bcaa743f5aba85ea86ad9145d: Bootstrap starting.
I20260811 00:55:46.626117 28950 tablet_bootstrap.cc:492] T e7b81dcbc96a4a32bb064f89216295c9 P 06cdf1fe87894a70beb28a86a7f36534: Bootstrap starting.
I20260811 00:55:46.626410 28994 ts_tablet_manager.cc:1905] T 65a168a54d234bc0a34b745ffdbcc563 P 06cdf1fe87894a70beb28a86a7f36534: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:55:46.626549 28948 tablet_bootstrap.cc:654] T e7b81dcbc96a4a32bb064f89216295c9 P a9f3759bcaa743f5aba85ea86ad9145d: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:46.626580 28950 tablet_bootstrap.cc:654] T e7b81dcbc96a4a32bb064f89216295c9 P 06cdf1fe87894a70beb28a86a7f36534: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:46.627339 28798 tablet_service.cc:1467] Processing CreateTablet for tablet e7b81dcbc96a4a32bb064f89216295c9 (DEFAULT_TABLE table=test-table [id=b26fccac17be4c31b3a54ed904881166]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:55:46.627413 28950 tablet_bootstrap.cc:492] T e7b81dcbc96a4a32bb064f89216295c9 P 06cdf1fe87894a70beb28a86a7f36534: No bootstrap required, opened a new log
I20260811 00:55:46.627454 28950 ts_tablet_manager.cc:1397] T e7b81dcbc96a4a32bb064f89216295c9 P 06cdf1fe87894a70beb28a86a7f36534: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260811 00:55:46.627471 28798 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7b81dcbc96a4a32bb064f89216295c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:46.627627 28950 raft_consensus.cc:348] T e7b81dcbc96a4a32bb064f89216295c9 P 06cdf1fe87894a70beb28a86a7f36534 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } }
I20260811 00:55:46.627696 28950 raft_consensus.cc:374] T e7b81dcbc96a4a32bb064f89216295c9 P 06cdf1fe87894a70beb28a86a7f36534 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:46.627715 28950 raft_consensus.cc:729] T e7b81dcbc96a4a32bb064f89216295c9 P 06cdf1fe87894a70beb28a86a7f36534 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06cdf1fe87894a70beb28a86a7f36534, State: Initialized, Role: FOLLOWER
I20260811 00:55:46.627760 28950 consensus_queue.cc:260] T e7b81dcbc96a4a32bb064f89216295c9 P 06cdf1fe87894a70beb28a86a7f36534 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } }
I20260811 00:55:46.627882 28950 ts_tablet_manager.cc:1428] T e7b81dcbc96a4a32bb064f89216295c9 P 06cdf1fe87894a70beb28a86a7f36534: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:46.628103 28994 ts_tablet_manager.cc:1918] T 65a168a54d234bc0a34b745ffdbcc563 P 06cdf1fe87894a70beb28a86a7f36534: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:55:46.628173 28994 log.cc:1196] T 65a168a54d234bc0a34b745ffdbcc563 P 06cdf1fe87894a70beb28a86a7f36534: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-0/wal/wals/65a168a54d234bc0a34b745ffdbcc563
I20260811 00:55:46.628945 28994 ts_tablet_manager.cc:1939] T 65a168a54d234bc0a34b745ffdbcc563 P 06cdf1fe87894a70beb28a86a7f36534: Deleting consensus metadata
I20260811 00:55:46.628985 28948 tablet_bootstrap.cc:492] T e7b81dcbc96a4a32bb064f89216295c9 P a9f3759bcaa743f5aba85ea86ad9145d: No bootstrap required, opened a new log
I20260811 00:55:46.629062 28948 ts_tablet_manager.cc:1397] T e7b81dcbc96a4a32bb064f89216295c9 P a9f3759bcaa743f5aba85ea86ad9145d: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 00:55:46.629065 28946 tablet_bootstrap.cc:492] T e7b81dcbc96a4a32bb064f89216295c9 P b5c138fd875e47b1af3b586daaeec397: Bootstrap starting.
I20260811 00:55:46.629271 28948 raft_consensus.cc:348] T e7b81dcbc96a4a32bb064f89216295c9 P a9f3759bcaa743f5aba85ea86ad9145d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } }
I20260811 00:55:46.629362 28948 raft_consensus.cc:374] T e7b81dcbc96a4a32bb064f89216295c9 P a9f3759bcaa743f5aba85ea86ad9145d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:46.629381 28948 raft_consensus.cc:729] T e7b81dcbc96a4a32bb064f89216295c9 P a9f3759bcaa743f5aba85ea86ad9145d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9f3759bcaa743f5aba85ea86ad9145d, State: Initialized, Role: FOLLOWER
I20260811 00:55:46.629428 28948 consensus_queue.cc:260] T e7b81dcbc96a4a32bb064f89216295c9 P a9f3759bcaa743f5aba85ea86ad9145d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } }
I20260811 00:55:46.629558 28946 tablet_bootstrap.cc:654] T e7b81dcbc96a4a32bb064f89216295c9 P b5c138fd875e47b1af3b586daaeec397: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:46.629562 28948 ts_tablet_manager.cc:1428] T e7b81dcbc96a4a32bb064f89216295c9 P a9f3759bcaa743f5aba85ea86ad9145d: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 00:55:46.629575 28995 ts_tablet_manager.cc:1918] T 65a168a54d234bc0a34b745ffdbcc563 P b5c138fd875e47b1af3b586daaeec397: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:55:46.629650 28995 log.cc:1196] T 65a168a54d234bc0a34b745ffdbcc563 P b5c138fd875e47b1af3b586daaeec397: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-2/wal/wals/65a168a54d234bc0a34b745ffdbcc563
I20260811 00:55:46.629855 28074 catalog_manager.cc:4841] TS 06cdf1fe87894a70beb28a86a7f36534 (127.15.70.1:33573): tablet 65a168a54d234bc0a34b745ffdbcc563 (table test-table [id=f99fd9af52cf44e0bb3e1b994c1c6ce2]) successfully deleted
I20260811 00:55:46.629926 28995 ts_tablet_manager.cc:1939] T 65a168a54d234bc0a34b745ffdbcc563 P b5c138fd875e47b1af3b586daaeec397: Deleting consensus metadata
I20260811 00:55:46.630357 28996 tablet_replica.cc:330] T 65a168a54d234bc0a34b745ffdbcc563 P a9f3759bcaa743f5aba85ea86ad9145d: stopping tablet replica
I20260811 00:55:46.630378 28072 catalog_manager.cc:4841] TS b5c138fd875e47b1af3b586daaeec397 (127.15.70.3:38873): tablet 65a168a54d234bc0a34b745ffdbcc563 (table test-table [id=f99fd9af52cf44e0bb3e1b994c1c6ce2]) successfully deleted
I20260811 00:55:46.630493 28996 raft_consensus.cc:2229] T 65a168a54d234bc0a34b745ffdbcc563 P a9f3759bcaa743f5aba85ea86ad9145d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:55:46.630627 28996 raft_consensus.cc:2258] T 65a168a54d234bc0a34b745ffdbcc563 P a9f3759bcaa743f5aba85ea86ad9145d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:55:46.631189 28946 tablet_bootstrap.cc:492] T e7b81dcbc96a4a32bb064f89216295c9 P b5c138fd875e47b1af3b586daaeec397: No bootstrap required, opened a new log
I20260811 00:55:46.631199 28996 ts_tablet_manager.cc:1905] T 65a168a54d234bc0a34b745ffdbcc563 P a9f3759bcaa743f5aba85ea86ad9145d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:55:46.631265 28946 ts_tablet_manager.cc:1397] T e7b81dcbc96a4a32bb064f89216295c9 P b5c138fd875e47b1af3b586daaeec397: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20260811 00:55:46.631448 28946 raft_consensus.cc:348] T e7b81dcbc96a4a32bb064f89216295c9 P b5c138fd875e47b1af3b586daaeec397 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } }
I20260811 00:55:46.631532 28946 raft_consensus.cc:374] T e7b81dcbc96a4a32bb064f89216295c9 P b5c138fd875e47b1af3b586daaeec397 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:46.631560 28946 raft_consensus.cc:729] T e7b81dcbc96a4a32bb064f89216295c9 P b5c138fd875e47b1af3b586daaeec397 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5c138fd875e47b1af3b586daaeec397, State: Initialized, Role: FOLLOWER
I20260811 00:55:46.631603 28946 consensus_queue.cc:260] T e7b81dcbc96a4a32bb064f89216295c9 P b5c138fd875e47b1af3b586daaeec397 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } }
I20260811 00:55:46.631693 28946 ts_tablet_manager.cc:1428] T e7b81dcbc96a4a32bb064f89216295c9 P b5c138fd875e47b1af3b586daaeec397: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:46.633242 28996 ts_tablet_manager.cc:1918] T 65a168a54d234bc0a34b745ffdbcc563 P a9f3759bcaa743f5aba85ea86ad9145d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:55:46.633329 28996 log.cc:1196] T 65a168a54d234bc0a34b745ffdbcc563 P a9f3759bcaa743f5aba85ea86ad9145d: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-1/wal/wals/65a168a54d234bc0a34b745ffdbcc563
I20260811 00:55:46.633601 28996 ts_tablet_manager.cc:1939] T 65a168a54d234bc0a34b745ffdbcc563 P a9f3759bcaa743f5aba85ea86ad9145d: Deleting consensus metadata
I20260811 00:55:46.634080 28070 catalog_manager.cc:4841] TS a9f3759bcaa743f5aba85ea86ad9145d (127.15.70.2:46787): tablet 65a168a54d234bc0a34b745ffdbcc563 (table test-table [id=f99fd9af52cf44e0bb3e1b994c1c6ce2]) successfully deleted
I20260811 00:55:46.838683 28962 raft_consensus.cc:482] T e7b81dcbc96a4a32bb064f89216295c9 P a9f3759bcaa743f5aba85ea86ad9145d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:55:46.838858 28962 raft_consensus.cc:504] T e7b81dcbc96a4a32bb064f89216295c9 P a9f3759bcaa743f5aba85ea86ad9145d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } }
I20260811 00:55:46.839421 28962 leader_election.cc:288] T e7b81dcbc96a4a32bb064f89216295c9 P a9f3759bcaa743f5aba85ea86ad9145d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06cdf1fe87894a70beb28a86a7f36534 (127.15.70.1:33573), b5c138fd875e47b1af3b586daaeec397 (127.15.70.3:38873)
I20260811 00:55:46.843068 29002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:46.839686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:33573 (local address 127.15.70.2:53379)
0811 00:55:46.839864 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:46.839878 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:46.839984 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:46.840229 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:46.840230 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:46.840233 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:46.840340 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:46.840343 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.841045 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.841046 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:46.842000 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:46.842004 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.842697 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.842698 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:46.842785 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:46.842790 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 00:55:46.842874 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 00:55:46.842919 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"mutex_wait_us":52,"thread_start_us":92,"threads_started":1}
I20260811 00:55:46.843186 28944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:46.839802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:53379 (local address 127.15.70.1:33573)
0811 00:55:46.839865 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:46.839867 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:46.839968 (+ 101us) server_negotiation.cc:407] Connection header received
0811 00:55:46.840132 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:46.840133 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:46.840149 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:46.840223 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:46.840417 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.840943 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.842186 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.842600 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.842694 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:46.842709 (+ 15us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:46.842926 (+ 217us) server_negotiation.cc:299] Negotiation successful
0811 00:55:46.843036 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 00:55:46.843649 28362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7b81dcbc96a4a32bb064f89216295c9" candidate_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06cdf1fe87894a70beb28a86a7f36534" is_pre_election: true
I20260811 00:55:46.843806 28362 raft_consensus.cc:2454] T e7b81dcbc96a4a32bb064f89216295c9 P 06cdf1fe87894a70beb28a86a7f36534 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9f3759bcaa743f5aba85ea86ad9145d in term 0.
I20260811 00:55:46.843917 28943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:46.839769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:44387 (local address 127.15.70.3:38873)
0811 00:55:46.839840 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:46.839843 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:46.840067 (+ 224us) server_negotiation.cc:407] Connection header received
0811 00:55:46.840149 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:46.840151 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:46.840162 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:46.840239 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:46.840426 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.840959 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.842738 (+ 1779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.843388 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.843458 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:46.843469 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:46.843781 (+ 312us) server_negotiation.cc:299] Negotiation successful
0811 00:55:46.843834 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 00:55:46.844012 29003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:46.839690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:38873 (local address 127.15.70.2:44387)
0811 00:55:46.839985 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:46.839995 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:46.840082 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:46.840244 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:46.840245 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:46.840267 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:46.840352 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:46.840354 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.841059 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.841060 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:46.842056 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:46.842059 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.843522 (+ 1463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.843524 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:46.843672 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:46.843677 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 00:55:46.843772 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 00:55:46.843843 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"mutex_wait_us":58,"thread_start_us":91,"threads_started":1}
I20260811 00:55:46.844179 28487 leader_election.cc:302] T e7b81dcbc96a4a32bb064f89216295c9 P a9f3759bcaa743f5aba85ea86ad9145d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06cdf1fe87894a70beb28a86a7f36534, a9f3759bcaa743f5aba85ea86ad9145d; no voters:
I20260811 00:55:46.844390 28962 raft_consensus.cc:2781] T e7b81dcbc96a4a32bb064f89216295c9 P a9f3759bcaa743f5aba85ea86ad9145d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:55:46.844435 28962 raft_consensus.cc:482] T e7b81dcbc96a4a32bb064f89216295c9 P a9f3759bcaa743f5aba85ea86ad9145d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:55:46.844470 28962 raft_consensus.cc:3037] T e7b81dcbc96a4a32bb064f89216295c9 P a9f3759bcaa743f5aba85ea86ad9145d [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:46.845361 28962 raft_consensus.cc:504] T e7b81dcbc96a4a32bb064f89216295c9 P a9f3759bcaa743f5aba85ea86ad9145d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } }
I20260811 00:55:46.845533 28962 leader_election.cc:288] T e7b81dcbc96a4a32bb064f89216295c9 P a9f3759bcaa743f5aba85ea86ad9145d [CANDIDATE]: Term 1 election: Requested vote from peers 06cdf1fe87894a70beb28a86a7f36534 (127.15.70.1:33573), b5c138fd875e47b1af3b586daaeec397 (127.15.70.3:38873)
I20260811 00:55:46.845767 28362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7b81dcbc96a4a32bb064f89216295c9" candidate_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06cdf1fe87894a70beb28a86a7f36534"
I20260811 00:55:46.845889 28362 raft_consensus.cc:3037] T e7b81dcbc96a4a32bb064f89216295c9 P 06cdf1fe87894a70beb28a86a7f36534 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:46.847143 28362 raft_consensus.cc:2454] T e7b81dcbc96a4a32bb064f89216295c9 P 06cdf1fe87894a70beb28a86a7f36534 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9f3759bcaa743f5aba85ea86ad9145d in term 1.
I20260811 00:55:46.847324 28487 leader_election.cc:302] T e7b81dcbc96a4a32bb064f89216295c9 P a9f3759bcaa743f5aba85ea86ad9145d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06cdf1fe87894a70beb28a86a7f36534, a9f3759bcaa743f5aba85ea86ad9145d; no voters:
I20260811 00:55:46.847517 28962 raft_consensus.cc:2781] T e7b81dcbc96a4a32bb064f89216295c9 P a9f3759bcaa743f5aba85ea86ad9145d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:55:46.847498 28829 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7b81dcbc96a4a32bb064f89216295c9" candidate_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5c138fd875e47b1af3b586daaeec397" is_pre_election: true
I20260811 00:55:46.847590 28828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7b81dcbc96a4a32bb064f89216295c9" candidate_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5c138fd875e47b1af3b586daaeec397"
I20260811 00:55:46.847699 28962 raft_consensus.cc:686] T e7b81dcbc96a4a32bb064f89216295c9 P a9f3759bcaa743f5aba85ea86ad9145d [term 1 LEADER]: Becoming Leader. State: Replica: a9f3759bcaa743f5aba85ea86ad9145d, State: Running, Role: LEADER
I20260811 00:55:46.847673 28829 raft_consensus.cc:2454] T e7b81dcbc96a4a32bb064f89216295c9 P b5c138fd875e47b1af3b586daaeec397 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9f3759bcaa743f5aba85ea86ad9145d in term 0.
I20260811 00:55:46.847783 28962 consensus_queue.cc:237] T e7b81dcbc96a4a32bb064f89216295c9 P a9f3759bcaa743f5aba85ea86ad9145d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } }
I20260811 00:55:46.848749 28096 catalog_manager.cc:5495] T e7b81dcbc96a4a32bb064f89216295c9 P a9f3759bcaa743f5aba85ea86ad9145d reported cstate change: term changed from 0 to 1, leader changed from <none> to a9f3759bcaa743f5aba85ea86ad9145d (127.15.70.2). New cstate: current_term: 1 leader_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } health_report { overall_health: UNKNOWN } } }
Aug 11 00:55:46 dist-test-slave-h3ft krb5kdc[28020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409745, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.70.62@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM
I20260811 00:55:46.884974 29023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:46.876145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44336 (local address 127.15.70.62:40199)
0811 00:55:46.876356 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:46.876358 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:46.876416 (+ 58us) server_negotiation.cc:407] Connection header received
0811 00:55:46.876489 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:46.876490 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:46.876501 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:46.876591 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:46.877246 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.877815 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.878769 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.878964 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.879058 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:46.881838 (+ 2780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:46.881840 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:46.881840 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:46.881847 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:46.883636 (+ 1789us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:46.884068 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:46.884069 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:46.884069 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:46.884135 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:46.884356 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:46.884357 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:46.884357 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:46.884523 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:46.884595 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:46.884757 (+ 162us) server_negotiation.cc:299] Negotiation successful
0811 00:55:46.884881 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":184,"thread_start_us":147,"threads_started":1}
I20260811 00:55:46.885090 29012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:46.876085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:40199 (local address 127.0.0.1:44336)
0811 00:55:46.876310 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:46.876327 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:46.876432 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:46.876652 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:46.876653 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:46.877094 (+ 441us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:46.877170 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:46.877172 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.877900 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.877902 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:46.878685 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:46.878688 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:46.879109 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:46.879110 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:46.879177 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:46.879864 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:46.879870 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:46.881739 (+ 1869us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:46.883722 (+ 1983us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:46.883732 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:46.883735 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:46.883991 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:46.884196 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:46.884196 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:46.884197 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:46.884264 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:46.884591 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:46.884598 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:46.884645 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 00:55:46.884700 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 00:55:46.884822 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":107,"threads_started":1}
I20260811 00:55:46.887887 28096 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:44336:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 00:55:46.888177 28096 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:55:46.890285 28798 tablet_service.cc:1467] Processing CreateTablet for tablet 0421a88119b449188be1553905651192 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=1a71155e9040418e831f8b9ee26bf2ce]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 00:55:46.890271 28324 tablet_service.cc:1467] Processing CreateTablet for tablet 0421a88119b449188be1553905651192 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=1a71155e9040418e831f8b9ee26bf2ce]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 00:55:46.890291 28564 tablet_service.cc:1467] Processing CreateTablet for tablet 0421a88119b449188be1553905651192 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=1a71155e9040418e831f8b9ee26bf2ce]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 00:55:46.890527 28798 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0421a88119b449188be1553905651192. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:46.890527 28564 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0421a88119b449188be1553905651192. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:46.890551 28324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0421a88119b449188be1553905651192. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:46.892187 28946 tablet_bootstrap.cc:492] T 0421a88119b449188be1553905651192 P b5c138fd875e47b1af3b586daaeec397: Bootstrap starting.
I20260811 00:55:46.892470 28950 tablet_bootstrap.cc:492] T 0421a88119b449188be1553905651192 P 06cdf1fe87894a70beb28a86a7f36534: Bootstrap starting.
I20260811 00:55:46.892675 28946 tablet_bootstrap.cc:654] T 0421a88119b449188be1553905651192 P b5c138fd875e47b1af3b586daaeec397: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:46.893065 28950 tablet_bootstrap.cc:654] T 0421a88119b449188be1553905651192 P 06cdf1fe87894a70beb28a86a7f36534: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:46.893486 28948 tablet_bootstrap.cc:492] T 0421a88119b449188be1553905651192 P a9f3759bcaa743f5aba85ea86ad9145d: Bootstrap starting.
I20260811 00:55:46.893522 28946 tablet_bootstrap.cc:492] T 0421a88119b449188be1553905651192 P b5c138fd875e47b1af3b586daaeec397: No bootstrap required, opened a new log
I20260811 00:55:46.893564 28946 ts_tablet_manager.cc:1397] T 0421a88119b449188be1553905651192 P b5c138fd875e47b1af3b586daaeec397: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260811 00:55:46.893754 28950 tablet_bootstrap.cc:492] T 0421a88119b449188be1553905651192 P 06cdf1fe87894a70beb28a86a7f36534: No bootstrap required, opened a new log
I20260811 00:55:46.893707 28946 raft_consensus.cc:348] T 0421a88119b449188be1553905651192 P b5c138fd875e47b1af3b586daaeec397 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } }
I20260811 00:55:46.893795 28950 ts_tablet_manager.cc:1397] T 0421a88119b449188be1553905651192 P 06cdf1fe87894a70beb28a86a7f36534: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260811 00:55:46.893793 28946 raft_consensus.cc:374] T 0421a88119b449188be1553905651192 P b5c138fd875e47b1af3b586daaeec397 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:46.893815 28946 raft_consensus.cc:729] T 0421a88119b449188be1553905651192 P b5c138fd875e47b1af3b586daaeec397 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5c138fd875e47b1af3b586daaeec397, State: Initialized, Role: FOLLOWER
I20260811 00:55:46.893872 28946 consensus_queue.cc:260] T 0421a88119b449188be1553905651192 P b5c138fd875e47b1af3b586daaeec397 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } }
I20260811 00:55:46.893992 28948 tablet_bootstrap.cc:654] T 0421a88119b449188be1553905651192 P a9f3759bcaa743f5aba85ea86ad9145d: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:46.894002 28946 ts_tablet_manager.cc:1428] T 0421a88119b449188be1553905651192 P b5c138fd875e47b1af3b586daaeec397: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:46.893977 28950 raft_consensus.cc:348] T 0421a88119b449188be1553905651192 P 06cdf1fe87894a70beb28a86a7f36534 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } }
I20260811 00:55:46.894057 28950 raft_consensus.cc:374] T 0421a88119b449188be1553905651192 P 06cdf1fe87894a70beb28a86a7f36534 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:46.894080 28950 raft_consensus.cc:729] T 0421a88119b449188be1553905651192 P 06cdf1fe87894a70beb28a86a7f36534 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06cdf1fe87894a70beb28a86a7f36534, State: Initialized, Role: FOLLOWER
I20260811 00:55:46.894042 28985 tablet_replica.cc:439] T 0421a88119b449188be1553905651192 P b5c138fd875e47b1af3b586daaeec397: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } } }
I20260811 00:55:46.894127 28950 consensus_queue.cc:260] T 0421a88119b449188be1553905651192 P 06cdf1fe87894a70beb28a86a7f36534 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } }
I20260811 00:55:46.894141 28985 tablet_replica.cc:442] T 0421a88119b449188be1553905651192 P b5c138fd875e47b1af3b586daaeec397: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 00:55:46.894227 28950 ts_tablet_manager.cc:1428] T 0421a88119b449188be1553905651192 P 06cdf1fe87894a70beb28a86a7f36534: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:46.894423 28961 tablet_replica.cc:439] T 0421a88119b449188be1553905651192 P 06cdf1fe87894a70beb28a86a7f36534: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } } }
I20260811 00:55:46.894556 28961 tablet_replica.cc:442] T 0421a88119b449188be1553905651192 P 06cdf1fe87894a70beb28a86a7f36534: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 00:55:46.895140 28948 tablet_bootstrap.cc:492] T 0421a88119b449188be1553905651192 P a9f3759bcaa743f5aba85ea86ad9145d: No bootstrap required, opened a new log
I20260811 00:55:46.895185 28948 ts_tablet_manager.cc:1397] T 0421a88119b449188be1553905651192 P a9f3759bcaa743f5aba85ea86ad9145d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 00:55:46.895370 28948 raft_consensus.cc:348] T 0421a88119b449188be1553905651192 P a9f3759bcaa743f5aba85ea86ad9145d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } }
I20260811 00:55:46.895450 28948 raft_consensus.cc:374] T 0421a88119b449188be1553905651192 P a9f3759bcaa743f5aba85ea86ad9145d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:46.895465 28948 raft_consensus.cc:729] T 0421a88119b449188be1553905651192 P a9f3759bcaa743f5aba85ea86ad9145d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9f3759bcaa743f5aba85ea86ad9145d, State: Initialized, Role: FOLLOWER
I20260811 00:55:46.895547 28948 consensus_queue.cc:260] T 0421a88119b449188be1553905651192 P a9f3759bcaa743f5aba85ea86ad9145d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } }
I20260811 00:55:46.895677 28948 ts_tablet_manager.cc:1428] T 0421a88119b449188be1553905651192 P a9f3759bcaa743f5aba85ea86ad9145d: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 00:55:46.895877 29005 tablet_replica.cc:439] T 0421a88119b449188be1553905651192 P a9f3759bcaa743f5aba85ea86ad9145d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } } }
I20260811 00:55:46.895972 29005 tablet_replica.cc:442] T 0421a88119b449188be1553905651192 P a9f3759bcaa743f5aba85ea86ad9145d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 00:55:47.098851 28985 raft_consensus.cc:482] T 0421a88119b449188be1553905651192 P b5c138fd875e47b1af3b586daaeec397 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:55:47.098994 28985 raft_consensus.cc:504] T 0421a88119b449188be1553905651192 P b5c138fd875e47b1af3b586daaeec397 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } }
I20260811 00:55:47.099349 28985 leader_election.cc:288] T 0421a88119b449188be1553905651192 P b5c138fd875e47b1af3b586daaeec397 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06cdf1fe87894a70beb28a86a7f36534 (127.15.70.1:33573), a9f3759bcaa743f5aba85ea86ad9145d (127.15.70.2:46787)
I20260811 00:55:47.099674 28598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0421a88119b449188be1553905651192" candidate_uuid: "b5c138fd875e47b1af3b586daaeec397" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" is_pre_election: true
I20260811 00:55:47.099707 28362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0421a88119b449188be1553905651192" candidate_uuid: "b5c138fd875e47b1af3b586daaeec397" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06cdf1fe87894a70beb28a86a7f36534" is_pre_election: true
I20260811 00:55:47.099817 28598 raft_consensus.cc:2454] T 0421a88119b449188be1553905651192 P a9f3759bcaa743f5aba85ea86ad9145d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5c138fd875e47b1af3b586daaeec397 in term 0.
I20260811 00:55:47.099849 28362 raft_consensus.cc:2454] T 0421a88119b449188be1553905651192 P 06cdf1fe87894a70beb28a86a7f36534 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5c138fd875e47b1af3b586daaeec397 in term 0.
I20260811 00:55:47.100033 28714 leader_election.cc:302] T 0421a88119b449188be1553905651192 P b5c138fd875e47b1af3b586daaeec397 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9f3759bcaa743f5aba85ea86ad9145d, b5c138fd875e47b1af3b586daaeec397; no voters:
I20260811 00:55:47.100188 28985 raft_consensus.cc:2781] T 0421a88119b449188be1553905651192 P b5c138fd875e47b1af3b586daaeec397 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:55:47.100244 28985 raft_consensus.cc:482] T 0421a88119b449188be1553905651192 P b5c138fd875e47b1af3b586daaeec397 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:55:47.100270 28985 raft_consensus.cc:3037] T 0421a88119b449188be1553905651192 P b5c138fd875e47b1af3b586daaeec397 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:47.101285 28985 raft_consensus.cc:504] T 0421a88119b449188be1553905651192 P b5c138fd875e47b1af3b586daaeec397 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } }
I20260811 00:55:47.101500 28985 leader_election.cc:288] T 0421a88119b449188be1553905651192 P b5c138fd875e47b1af3b586daaeec397 [CANDIDATE]: Term 1 election: Requested vote from peers 06cdf1fe87894a70beb28a86a7f36534 (127.15.70.1:33573), a9f3759bcaa743f5aba85ea86ad9145d (127.15.70.2:46787)
I20260811 00:55:47.101722 28598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0421a88119b449188be1553905651192" candidate_uuid: "b5c138fd875e47b1af3b586daaeec397" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9f3759bcaa743f5aba85ea86ad9145d"
I20260811 00:55:47.101758 28362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0421a88119b449188be1553905651192" candidate_uuid: "b5c138fd875e47b1af3b586daaeec397" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06cdf1fe87894a70beb28a86a7f36534"
I20260811 00:55:47.101843 28362 raft_consensus.cc:3037] T 0421a88119b449188be1553905651192 P 06cdf1fe87894a70beb28a86a7f36534 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:47.101848 28598 raft_consensus.cc:3037] T 0421a88119b449188be1553905651192 P a9f3759bcaa743f5aba85ea86ad9145d [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:47.102681 28362 raft_consensus.cc:2454] T 0421a88119b449188be1553905651192 P 06cdf1fe87894a70beb28a86a7f36534 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5c138fd875e47b1af3b586daaeec397 in term 1.
I20260811 00:55:47.102906 28719 leader_election.cc:302] T 0421a88119b449188be1553905651192 P b5c138fd875e47b1af3b586daaeec397 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06cdf1fe87894a70beb28a86a7f36534, b5c138fd875e47b1af3b586daaeec397; no voters:
I20260811 00:55:47.102854 28598 raft_consensus.cc:2454] T 0421a88119b449188be1553905651192 P a9f3759bcaa743f5aba85ea86ad9145d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5c138fd875e47b1af3b586daaeec397 in term 1.
I20260811 00:55:47.103071 28985 raft_consensus.cc:2781] T 0421a88119b449188be1553905651192 P b5c138fd875e47b1af3b586daaeec397 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:55:47.103139 28985 raft_consensus.cc:686] T 0421a88119b449188be1553905651192 P b5c138fd875e47b1af3b586daaeec397 [term 1 LEADER]: Becoming Leader. State: Replica: b5c138fd875e47b1af3b586daaeec397, State: Running, Role: LEADER
I20260811 00:55:47.103212 28985 consensus_queue.cc:237] T 0421a88119b449188be1553905651192 P b5c138fd875e47b1af3b586daaeec397 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } }
I20260811 00:55:47.103637 28985 tablet_replica.cc:439] T 0421a88119b449188be1553905651192 P b5c138fd875e47b1af3b586daaeec397: TxnStatusTablet state changed. Reason: New leader b5c138fd875e47b1af3b586daaeec397. Latest consensus state: current_term: 1 leader_uuid: "b5c138fd875e47b1af3b586daaeec397" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } } }
I20260811 00:55:47.103722 28985 tablet_replica.cc:442] T 0421a88119b449188be1553905651192 P b5c138fd875e47b1af3b586daaeec397: This TxnStatusTablet replica's current role is: LEADER
I20260811 00:55:47.103955 29030 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 00:55:47.104132 29030 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 00:55:47.104305 28097 catalog_manager.cc:5495] T 0421a88119b449188be1553905651192 P b5c138fd875e47b1af3b586daaeec397 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5c138fd875e47b1af3b586daaeec397 (127.15.70.3). New cstate: current_term: 1 leader_uuid: "b5c138fd875e47b1af3b586daaeec397" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } health_report { overall_health: HEALTHY } } }
I20260811 00:55:47.126412 28943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:47.123579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52556 (local address 127.15.70.3:38873)
0811 00:55:47.123662 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:47.123664 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:47.123675 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:55:47.123813 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:47.123814 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:47.123836 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:47.123904 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:55:47.124127 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:47.124663 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:47.125531 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:47.125732 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:47.125871 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:47.126085 (+ 214us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:55:47.126132 (+ 47us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:55:47.126196 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:47.126272 (+ 76us) server_negotiation.cc:299] Negotiation successful
0811 00:55:47.126302 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 00:55:47.126412 29012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:47.123427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:38873 (local address 127.0.0.1:52556)
0811 00:55:47.123551 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:47.123568 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:47.123686 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:47.123913 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:47.123914 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:47.123916 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 00:55:47.124039 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:47.124043 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:47.124769 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:47.124770 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:47.125422 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:47.125425 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:47.125873 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:47.125874 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:47.125950 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:47.125972 (+ 22us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 00:55:47.126198 (+ 226us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 00:55:47.126210 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 00:55:47.126265 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 00:55:47.126333 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
I20260811 00:55:47.128011 28362 raft_consensus.cc:1261] T 0421a88119b449188be1553905651192 P 06cdf1fe87894a70beb28a86a7f36534 [term 1 FOLLOWER]: Refusing update from remote peer b5c138fd875e47b1af3b586daaeec397: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:55:47.128013 28598 raft_consensus.cc:1261] T 0421a88119b449188be1553905651192 P a9f3759bcaa743f5aba85ea86ad9145d [term 1 FOLLOWER]: Refusing update from remote peer b5c138fd875e47b1af3b586daaeec397: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:55:47.128304 28963 consensus_queue.cc:1035] T 0421a88119b449188be1553905651192 P b5c138fd875e47b1af3b586daaeec397 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:55:47.128451 28985 consensus_queue.cc:1035] T 0421a88119b449188be1553905651192 P b5c138fd875e47b1af3b586daaeec397 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:55:47.129184 28961 tablet_replica.cc:439] T 0421a88119b449188be1553905651192 P 06cdf1fe87894a70beb28a86a7f36534: TxnStatusTablet state changed. Reason: New leader b5c138fd875e47b1af3b586daaeec397. Latest consensus state: current_term: 1 leader_uuid: "b5c138fd875e47b1af3b586daaeec397" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } } }
I20260811 00:55:47.129207 29005 tablet_replica.cc:439] T 0421a88119b449188be1553905651192 P a9f3759bcaa743f5aba85ea86ad9145d: TxnStatusTablet state changed. Reason: New leader b5c138fd875e47b1af3b586daaeec397. Latest consensus state: current_term: 1 leader_uuid: "b5c138fd875e47b1af3b586daaeec397" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } } }
I20260811 00:55:47.129305 29005 tablet_replica.cc:442] T 0421a88119b449188be1553905651192 P a9f3759bcaa743f5aba85ea86ad9145d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 00:55:47.129308 28961 tablet_replica.cc:442] T 0421a88119b449188be1553905651192 P 06cdf1fe87894a70beb28a86a7f36534: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 00:55:47.130174 28963 tablet_replica.cc:439] T 0421a88119b449188be1553905651192 P b5c138fd875e47b1af3b586daaeec397: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b5c138fd875e47b1af3b586daaeec397" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } } }
I20260811 00:55:47.130285 28963 tablet_replica.cc:442] T 0421a88119b449188be1553905651192 P b5c138fd875e47b1af3b586daaeec397: This TxnStatusTablet replica's current role is: LEADER
I20260811 00:55:47.130384 28963 tablet_replica.cc:439] T 0421a88119b449188be1553905651192 P b5c138fd875e47b1af3b586daaeec397: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b5c138fd875e47b1af3b586daaeec397" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } } }
I20260811 00:55:47.130450 28963 tablet_replica.cc:442] T 0421a88119b449188be1553905651192 P b5c138fd875e47b1af3b586daaeec397: This TxnStatusTablet replica's current role is: LEADER
I20260811 00:55:47.130513 29033 mvcc.cc:205] Tried to move back new op lower bound from 7317134324233895936 to 7317134324135514112. Current Snapshot: MvccSnapshot[applied={T|T < 7317134324233895936}]
I20260811 00:55:47.130765 28961 tablet_replica.cc:439] T 0421a88119b449188be1553905651192 P 06cdf1fe87894a70beb28a86a7f36534: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b5c138fd875e47b1af3b586daaeec397" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } } }
I20260811 00:55:47.130865 28961 tablet_replica.cc:442] T 0421a88119b449188be1553905651192 P 06cdf1fe87894a70beb28a86a7f36534: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 00:55:47.132050 29005 tablet_replica.cc:439] T 0421a88119b449188be1553905651192 P a9f3759bcaa743f5aba85ea86ad9145d: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b5c138fd875e47b1af3b586daaeec397" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } } }
I20260811 00:55:47.132156 29005 tablet_replica.cc:442] T 0421a88119b449188be1553905651192 P a9f3759bcaa743f5aba85ea86ad9145d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 00:55:47.136308 29048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:47.133183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44758 (local address 127.15.70.2:46787)
0811 00:55:47.133297 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:47.133300 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:47.133367 (+ 67us) server_negotiation.cc:407] Connection header received
0811 00:55:47.133475 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:47.133476 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:47.133501 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:47.133617 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:55:47.133802 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:47.134351 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:47.135322 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:47.135553 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:47.135664 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:47.135856 (+ 192us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:55:47.136021 (+ 165us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:55:47.136116 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:47.136159 (+ 43us) server_negotiation.cc:299] Negotiation successful
0811 00:55:47.136184 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86,"thread_start_us":65,"threads_started":1}
I20260811 00:55:47.142171 29059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:47.139386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:38873 (local address 127.15.70.2:58075)
0811 00:55:47.139547 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:47.139559 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:47.139647 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:47.139780 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:47.139781 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:47.139783 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 00:55:47.139854 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:47.139855 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:47.140568 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:47.140569 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:47.141231 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:47.141233 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:47.141740 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:47.141741 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:47.141796 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:47.141812 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 00:55:47.142013 (+ 201us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 00:55:47.142015 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 00:55:47.142052 (+ 37us) client_negotiation.cc:240] Negotiation successful
0811 00:55:47.142096 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":83,"threads_started":1}
I20260811 00:55:47.142172 28943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:47.139459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:58075 (local address 127.15.70.3:38873)
0811 00:55:47.139521 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:47.139523 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:47.139629 (+ 106us) server_negotiation.cc:407] Connection header received
0811 00:55:47.139703 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:47.139704 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:47.139718 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:47.139777 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:55:47.139930 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:47.140468 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:47.141331 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:47.141656 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:47.141734 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:47.141900 (+ 166us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:55:47.141941 (+ 41us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:55:47.141998 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:47.142056 (+ 58us) server_negotiation.cc:299] Negotiation successful
0811 00:55:47.142081 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 00:55:47.145720 28362 raft_consensus.cc:1261] T e7b81dcbc96a4a32bb064f89216295c9 P 06cdf1fe87894a70beb28a86a7f36534 [term 1 FOLLOWER]: Refusing update from remote peer a9f3759bcaa743f5aba85ea86ad9145d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:55:47.145714 28828 raft_consensus.cc:3037] T e7b81dcbc96a4a32bb064f89216295c9 P b5c138fd875e47b1af3b586daaeec397 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:47.146073 28962 consensus_queue.cc:1035] T e7b81dcbc96a4a32bb064f89216295c9 P a9f3759bcaa743f5aba85ea86ad9145d [LEADER]: Connected to new peer: Peer: permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:55:47.147028 28828 raft_consensus.cc:1261] T e7b81dcbc96a4a32bb064f89216295c9 P b5c138fd875e47b1af3b586daaeec397 [term 1 FOLLOWER]: Refusing update from remote peer a9f3759bcaa743f5aba85ea86ad9145d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:55:47.147331 28962 consensus_queue.cc:1035] T e7b81dcbc96a4a32bb064f89216295c9 P a9f3759bcaa743f5aba85ea86ad9145d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:55:47.156739 29048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:47.153501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:41557 (local address 127.15.70.2:46787)
0811 00:55:47.153548 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:47.153550 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:47.153691 (+ 141us) server_negotiation.cc:407] Connection header received
0811 00:55:47.153748 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:47.153749 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:47.153762 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:47.153820 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:55:47.153919 (+ 99us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:47.154734 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:47.155734 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:47.156063 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:47.156131 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:47.156415 (+ 284us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:55:47.156456 (+ 41us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:55:47.156525 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:47.156635 (+ 110us) server_negotiation.cc:299] Negotiation successful
0811 00:55:47.156664 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 00:55:47.156773 29073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:47.153461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.2:46787 (local address 127.15.70.3:41557)
0811 00:55:47.153604 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:47.153617 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:47.153691 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:47.153821 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:47.153821 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:47.153823 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 00:55:47.153879 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:47.153881 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:47.154871 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:47.154873 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:47.155645 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:47.155648 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:47.156171 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:47.156172 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:47.156251 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:47.156271 (+ 20us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 00:55:47.156566 (+ 295us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 00:55:47.156569 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:55:47.156622 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 00:55:47.156680 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":81,"threads_started":1}
I20260811 00:55:47.167367 28096 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44324:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:55:47.167569 28096 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44324:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:55:47.168452 28096 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 802eda0d72274b71956fcba4925fd37a: Sending DeleteTablet for 3 replicas of tablet e7b81dcbc96a4a32bb064f89216295c9
I20260811 00:55:47.168871 28564 tablet_service.cc:1514] Processing DeleteTablet for tablet e7b81dcbc96a4a32bb064f89216295c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:55:47 UTC) from {username='oryx', principal='oryx/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:44752
I20260811 00:55:47.169013 28798 tablet_service.cc:1514] Processing DeleteTablet for tablet e7b81dcbc96a4a32bb064f89216295c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:55:47 UTC) from {username='oryx', principal='oryx/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:52536
I20260811 00:55:47.169412 28324 tablet_service.cc:1514] Processing DeleteTablet for tablet e7b81dcbc96a4a32bb064f89216295c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:55:47 UTC) from {username='oryx', principal='oryx/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:53576
I20260811 00:55:47.169721 29078 tablet_replica.cc:330] T e7b81dcbc96a4a32bb064f89216295c9 P 06cdf1fe87894a70beb28a86a7f36534: stopping tablet replica
I20260811 00:55:47.169842 29078 raft_consensus.cc:2229] T e7b81dcbc96a4a32bb064f89216295c9 P 06cdf1fe87894a70beb28a86a7f36534 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:55:47.169961 29078 raft_consensus.cc:2258] T e7b81dcbc96a4a32bb064f89216295c9 P 06cdf1fe87894a70beb28a86a7f36534 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:55:47.170367 29078 ts_tablet_manager.cc:1905] T e7b81dcbc96a4a32bb064f89216295c9 P 06cdf1fe87894a70beb28a86a7f36534: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:55:47.172864 29078 ts_tablet_manager.cc:1918] T e7b81dcbc96a4a32bb064f89216295c9 P 06cdf1fe87894a70beb28a86a7f36534: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 00:55:47.173026 29078 log.cc:1196] T e7b81dcbc96a4a32bb064f89216295c9 P 06cdf1fe87894a70beb28a86a7f36534: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-0/wal/wals/e7b81dcbc96a4a32bb064f89216295c9
I20260811 00:55:47.173363 29078 ts_tablet_manager.cc:1939] T e7b81dcbc96a4a32bb064f89216295c9 P 06cdf1fe87894a70beb28a86a7f36534: Deleting consensus metadata
I20260811 00:55:47.174873 28074 catalog_manager.cc:4841] TS 06cdf1fe87894a70beb28a86a7f36534 (127.15.70.1:33573): tablet e7b81dcbc96a4a32bb064f89216295c9 (table test-table [id=b26fccac17be4c31b3a54ed904881166]) successfully deleted
I20260811 00:55:47.175189 29077 tablet_replica.cc:330] T e7b81dcbc96a4a32bb064f89216295c9 P b5c138fd875e47b1af3b586daaeec397: stopping tablet replica
I20260811 00:55:47.175292 29077 raft_consensus.cc:2229] T e7b81dcbc96a4a32bb064f89216295c9 P b5c138fd875e47b1af3b586daaeec397 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:55:47.175364 29077 raft_consensus.cc:2258] T e7b81dcbc96a4a32bb064f89216295c9 P b5c138fd875e47b1af3b586daaeec397 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:55:47.175541 29076 tablet_replica.cc:330] T e7b81dcbc96a4a32bb064f89216295c9 P a9f3759bcaa743f5aba85ea86ad9145d: stopping tablet replica
I20260811 00:55:47.175637 29076 raft_consensus.cc:2229] T e7b81dcbc96a4a32bb064f89216295c9 P a9f3759bcaa743f5aba85ea86ad9145d [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:55:47.175851 29076 raft_consensus.cc:2258] T e7b81dcbc96a4a32bb064f89216295c9 P a9f3759bcaa743f5aba85ea86ad9145d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:55:47.175853 29077 ts_tablet_manager.cc:1905] T e7b81dcbc96a4a32bb064f89216295c9 P b5c138fd875e47b1af3b586daaeec397: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:55:47.176234 29076 ts_tablet_manager.cc:1905] T e7b81dcbc96a4a32bb064f89216295c9 P a9f3759bcaa743f5aba85ea86ad9145d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:55:47.178004 29077 ts_tablet_manager.cc:1918] T e7b81dcbc96a4a32bb064f89216295c9 P b5c138fd875e47b1af3b586daaeec397: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 00:55:47.178146 29077 log.cc:1196] T e7b81dcbc96a4a32bb064f89216295c9 P b5c138fd875e47b1af3b586daaeec397: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-2/wal/wals/e7b81dcbc96a4a32bb064f89216295c9
I20260811 00:55:47.178435 29077 ts_tablet_manager.cc:1939] T e7b81dcbc96a4a32bb064f89216295c9 P b5c138fd875e47b1af3b586daaeec397: Deleting consensus metadata
I20260811 00:55:47.178650 29076 ts_tablet_manager.cc:1918] T e7b81dcbc96a4a32bb064f89216295c9 P a9f3759bcaa743f5aba85ea86ad9145d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 00:55:47.178740 29076 log.cc:1196] T e7b81dcbc96a4a32bb064f89216295c9 P a9f3759bcaa743f5aba85ea86ad9145d: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-1/wal/wals/e7b81dcbc96a4a32bb064f89216295c9
I20260811 00:55:47.179059 29076 ts_tablet_manager.cc:1939] T e7b81dcbc96a4a32bb064f89216295c9 P a9f3759bcaa743f5aba85ea86ad9145d: Deleting consensus metadata
I20260811 00:55:47.179078 28072 catalog_manager.cc:4841] TS b5c138fd875e47b1af3b586daaeec397 (127.15.70.3:38873): tablet e7b81dcbc96a4a32bb064f89216295c9 (table test-table [id=b26fccac17be4c31b3a54ed904881166]) successfully deleted
I20260811 00:55:47.179479 28070 catalog_manager.cc:4841] TS a9f3759bcaa743f5aba85ea86ad9145d (127.15.70.2:46787): tablet e7b81dcbc96a4a32bb064f89216295c9 (table test-table [id=b26fccac17be4c31b3a54ed904881166]) successfully deleted
Aug 11 00:55:47 dist-test-slave-h3ft krb5kdc[28020](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409747, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 00:55:47 dist-test-slave-h3ft krb5kdc[28020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:55:47 dist-test-slave-h3ft krb5kdc[28020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
W20260811 00:55:47.214689 29023 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:55:47.205938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44338 (local address 127.15.70.62:40199)
0811 00:55:47.206030 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:47.206033 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:47.206173 (+ 140us) server_negotiation.cc:407] Connection header received
0811 00:55:47.206251 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:47.206252 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:47.206272 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:47.206365 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:47.207343 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:47.208248 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:47.209481 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:47.209867 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:47.209961 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:47.214582 (+ 4621us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44338: BlockingRecv error: recv got EOF from 127.0.0.1:44338 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 11 00:55:47 dist-test-slave-h3ft krb5kdc[28020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409747, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM
I20260811 00:55:47.227351 29023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:47.216343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44346 (local address 127.15.70.62:40199)
0811 00:55:47.216397 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:47.216400 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:47.216746 (+ 346us) server_negotiation.cc:407] Connection header received
0811 00:55:47.216830 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:47.216831 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:47.216851 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:47.216922 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:47.217665 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:47.218503 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:47.219629 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:47.219951 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:47.220039 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:47.223565 (+ 3526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:47.223567 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:47.223568 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:47.223580 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:47.225776 (+ 2196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:47.226269 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:47.226271 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:47.226271 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:47.226354 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:47.226631 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:47.226632 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:47.226632 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:47.226806 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:47.226942 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:47.227107 (+ 165us) server_negotiation.cc:299] Negotiation successful
0811 00:55:47.227223 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 00:55:47.229756 28096 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44346:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:55:47.230020 28096 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:55:47.232916 28564 tablet_service.cc:1467] Processing CreateTablet for tablet ec833a4972f0409499f136f1c8294c84 (DEFAULT_TABLE table=test-table [id=cc6cd700ef8842ffbf01ccc7b9541feb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:55:47.233240 28564 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec833a4972f0409499f136f1c8294c84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:47.233889 28324 tablet_service.cc:1467] Processing CreateTablet for tablet ec833a4972f0409499f136f1c8294c84 (DEFAULT_TABLE table=test-table [id=cc6cd700ef8842ffbf01ccc7b9541feb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:55:47.234138 28324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec833a4972f0409499f136f1c8294c84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:47.236657 28948 tablet_bootstrap.cc:492] T ec833a4972f0409499f136f1c8294c84 P a9f3759bcaa743f5aba85ea86ad9145d: Bootstrap starting.
I20260811 00:55:47.237206 28948 tablet_bootstrap.cc:654] T ec833a4972f0409499f136f1c8294c84 P a9f3759bcaa743f5aba85ea86ad9145d: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:47.238801 28950 tablet_bootstrap.cc:492] T ec833a4972f0409499f136f1c8294c84 P 06cdf1fe87894a70beb28a86a7f36534: Bootstrap starting.
I20260811 00:55:47.239437 28950 tablet_bootstrap.cc:654] T ec833a4972f0409499f136f1c8294c84 P 06cdf1fe87894a70beb28a86a7f36534: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:47.240159 28950 tablet_bootstrap.cc:492] T ec833a4972f0409499f136f1c8294c84 P 06cdf1fe87894a70beb28a86a7f36534: No bootstrap required, opened a new log
I20260811 00:55:47.240211 28950 ts_tablet_manager.cc:1397] T ec833a4972f0409499f136f1c8294c84 P 06cdf1fe87894a70beb28a86a7f36534: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 00:55:47.240414 28950 raft_consensus.cc:348] T ec833a4972f0409499f136f1c8294c84 P 06cdf1fe87894a70beb28a86a7f36534 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } }
I20260811 00:55:47.240509 28950 raft_consensus.cc:374] T ec833a4972f0409499f136f1c8294c84 P 06cdf1fe87894a70beb28a86a7f36534 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:47.240530 28950 raft_consensus.cc:729] T ec833a4972f0409499f136f1c8294c84 P 06cdf1fe87894a70beb28a86a7f36534 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06cdf1fe87894a70beb28a86a7f36534, State: Initialized, Role: FOLLOWER
I20260811 00:55:47.240579 28950 consensus_queue.cc:260] T ec833a4972f0409499f136f1c8294c84 P 06cdf1fe87894a70beb28a86a7f36534 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } }
I20260811 00:55:47.240698 28950 ts_tablet_manager.cc:1428] T ec833a4972f0409499f136f1c8294c84 P 06cdf1fe87894a70beb28a86a7f36534: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 00:55:47.245782 28798 tablet_service.cc:1467] Processing CreateTablet for tablet ec833a4972f0409499f136f1c8294c84 (DEFAULT_TABLE table=test-table [id=cc6cd700ef8842ffbf01ccc7b9541feb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:55:47.246058 28798 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec833a4972f0409499f136f1c8294c84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:47.246380 28948 tablet_bootstrap.cc:492] T ec833a4972f0409499f136f1c8294c84 P a9f3759bcaa743f5aba85ea86ad9145d: No bootstrap required, opened a new log
I20260811 00:55:47.246469 28948 ts_tablet_manager.cc:1397] T ec833a4972f0409499f136f1c8294c84 P a9f3759bcaa743f5aba85ea86ad9145d: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.001s
I20260811 00:55:47.246860 28948 raft_consensus.cc:348] T ec833a4972f0409499f136f1c8294c84 P a9f3759bcaa743f5aba85ea86ad9145d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } }
I20260811 00:55:47.246969 28948 raft_consensus.cc:374] T ec833a4972f0409499f136f1c8294c84 P a9f3759bcaa743f5aba85ea86ad9145d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:47.246994 28948 raft_consensus.cc:729] T ec833a4972f0409499f136f1c8294c84 P a9f3759bcaa743f5aba85ea86ad9145d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9f3759bcaa743f5aba85ea86ad9145d, State: Initialized, Role: FOLLOWER
I20260811 00:55:47.247112 28948 consensus_queue.cc:260] T ec833a4972f0409499f136f1c8294c84 P a9f3759bcaa743f5aba85ea86ad9145d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } }
I20260811 00:55:47.247252 28948 ts_tablet_manager.cc:1428] T ec833a4972f0409499f136f1c8294c84 P a9f3759bcaa743f5aba85ea86ad9145d: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260811 00:55:47.250408 28946 tablet_bootstrap.cc:492] T ec833a4972f0409499f136f1c8294c84 P b5c138fd875e47b1af3b586daaeec397: Bootstrap starting.
I20260811 00:55:47.251098 28946 tablet_bootstrap.cc:654] T ec833a4972f0409499f136f1c8294c84 P b5c138fd875e47b1af3b586daaeec397: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:47.254086 28946 tablet_bootstrap.cc:492] T ec833a4972f0409499f136f1c8294c84 P b5c138fd875e47b1af3b586daaeec397: No bootstrap required, opened a new log
I20260811 00:55:47.254179 28946 ts_tablet_manager.cc:1397] T ec833a4972f0409499f136f1c8294c84 P b5c138fd875e47b1af3b586daaeec397: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260811 00:55:47.254427 28946 raft_consensus.cc:348] T ec833a4972f0409499f136f1c8294c84 P b5c138fd875e47b1af3b586daaeec397 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } }
I20260811 00:55:47.254544 28946 raft_consensus.cc:374] T ec833a4972f0409499f136f1c8294c84 P b5c138fd875e47b1af3b586daaeec397 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:47.254575 28946 raft_consensus.cc:729] T ec833a4972f0409499f136f1c8294c84 P b5c138fd875e47b1af3b586daaeec397 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5c138fd875e47b1af3b586daaeec397, State: Initialized, Role: FOLLOWER
I20260811 00:55:47.254642 28946 consensus_queue.cc:260] T ec833a4972f0409499f136f1c8294c84 P b5c138fd875e47b1af3b586daaeec397 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } }
I20260811 00:55:47.254779 28946 ts_tablet_manager.cc:1428] T ec833a4972f0409499f136f1c8294c84 P b5c138fd875e47b1af3b586daaeec397: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260811 00:55:47.264192 29061 raft_consensus.cc:482] T ec833a4972f0409499f136f1c8294c84 P b5c138fd875e47b1af3b586daaeec397 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:55:47.264324 29061 raft_consensus.cc:504] T ec833a4972f0409499f136f1c8294c84 P b5c138fd875e47b1af3b586daaeec397 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } }
I20260811 00:55:47.264539 29061 leader_election.cc:288] T ec833a4972f0409499f136f1c8294c84 P b5c138fd875e47b1af3b586daaeec397 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06cdf1fe87894a70beb28a86a7f36534 (127.15.70.1:33573), a9f3759bcaa743f5aba85ea86ad9145d (127.15.70.2:46787)
I20260811 00:55:47.264854 28362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec833a4972f0409499f136f1c8294c84" candidate_uuid: "b5c138fd875e47b1af3b586daaeec397" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06cdf1fe87894a70beb28a86a7f36534" is_pre_election: true
I20260811 00:55:47.265053 28362 raft_consensus.cc:2454] T ec833a4972f0409499f136f1c8294c84 P 06cdf1fe87894a70beb28a86a7f36534 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5c138fd875e47b1af3b586daaeec397 in term 0.
I20260811 00:55:47.265296 28719 leader_election.cc:302] T ec833a4972f0409499f136f1c8294c84 P b5c138fd875e47b1af3b586daaeec397 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06cdf1fe87894a70beb28a86a7f36534, b5c138fd875e47b1af3b586daaeec397; no voters:
I20260811 00:55:47.265424 28598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec833a4972f0409499f136f1c8294c84" candidate_uuid: "b5c138fd875e47b1af3b586daaeec397" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" is_pre_election: true
I20260811 00:55:47.265554 28598 raft_consensus.cc:2454] T ec833a4972f0409499f136f1c8294c84 P a9f3759bcaa743f5aba85ea86ad9145d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5c138fd875e47b1af3b586daaeec397 in term 0.
I20260811 00:55:47.265753 29061 raft_consensus.cc:2781] T ec833a4972f0409499f136f1c8294c84 P b5c138fd875e47b1af3b586daaeec397 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:55:47.265802 29061 raft_consensus.cc:482] T ec833a4972f0409499f136f1c8294c84 P b5c138fd875e47b1af3b586daaeec397 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:55:47.265829 29061 raft_consensus.cc:3037] T ec833a4972f0409499f136f1c8294c84 P b5c138fd875e47b1af3b586daaeec397 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:47.267051 29061 raft_consensus.cc:504] T ec833a4972f0409499f136f1c8294c84 P b5c138fd875e47b1af3b586daaeec397 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } }
I20260811 00:55:47.267220 29061 leader_election.cc:288] T ec833a4972f0409499f136f1c8294c84 P b5c138fd875e47b1af3b586daaeec397 [CANDIDATE]: Term 1 election: Requested vote from peers 06cdf1fe87894a70beb28a86a7f36534 (127.15.70.1:33573), a9f3759bcaa743f5aba85ea86ad9145d (127.15.70.2:46787)
I20260811 00:55:47.267477 28598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec833a4972f0409499f136f1c8294c84" candidate_uuid: "b5c138fd875e47b1af3b586daaeec397" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9f3759bcaa743f5aba85ea86ad9145d"
I20260811 00:55:47.267570 28598 raft_consensus.cc:3037] T ec833a4972f0409499f136f1c8294c84 P a9f3759bcaa743f5aba85ea86ad9145d [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:47.267596 28362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec833a4972f0409499f136f1c8294c84" candidate_uuid: "b5c138fd875e47b1af3b586daaeec397" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06cdf1fe87894a70beb28a86a7f36534"
I20260811 00:55:47.267688 28362 raft_consensus.cc:3037] T ec833a4972f0409499f136f1c8294c84 P 06cdf1fe87894a70beb28a86a7f36534 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:47.268539 28598 raft_consensus.cc:2454] T ec833a4972f0409499f136f1c8294c84 P a9f3759bcaa743f5aba85ea86ad9145d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5c138fd875e47b1af3b586daaeec397 in term 1.
I20260811 00:55:47.268599 28362 raft_consensus.cc:2454] T ec833a4972f0409499f136f1c8294c84 P 06cdf1fe87894a70beb28a86a7f36534 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5c138fd875e47b1af3b586daaeec397 in term 1.
I20260811 00:55:47.268817 28714 leader_election.cc:302] T ec833a4972f0409499f136f1c8294c84 P b5c138fd875e47b1af3b586daaeec397 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9f3759bcaa743f5aba85ea86ad9145d, b5c138fd875e47b1af3b586daaeec397; no voters:
I20260811 00:55:47.268911 29061 raft_consensus.cc:2781] T ec833a4972f0409499f136f1c8294c84 P b5c138fd875e47b1af3b586daaeec397 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:55:47.268971 29061 raft_consensus.cc:686] T ec833a4972f0409499f136f1c8294c84 P b5c138fd875e47b1af3b586daaeec397 [term 1 LEADER]: Becoming Leader. State: Replica: b5c138fd875e47b1af3b586daaeec397, State: Running, Role: LEADER
I20260811 00:55:47.269030 29061 consensus_queue.cc:237] T ec833a4972f0409499f136f1c8294c84 P b5c138fd875e47b1af3b586daaeec397 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } }
I20260811 00:55:47.269793 28096 catalog_manager.cc:5495] T ec833a4972f0409499f136f1c8294c84 P b5c138fd875e47b1af3b586daaeec397 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5c138fd875e47b1af3b586daaeec397 (127.15.70.3). New cstate: current_term: 1 leader_uuid: "b5c138fd875e47b1af3b586daaeec397" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } health_report { overall_health: HEALTHY } } }
I20260811 00:55:47.279918 28943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:47.276949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52568 (local address 127.15.70.3:38873)
0811 00:55:47.277004 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:47.277007 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:47.277052 (+ 45us) server_negotiation.cc:407] Connection header received
0811 00:55:47.277151 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:47.277152 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:47.277166 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:47.277232 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:55:47.277422 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:47.277990 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:47.278928 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:47.279268 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:47.279374 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:47.279565 (+ 191us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:55:47.279611 (+ 46us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:55:47.279691 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:47.279762 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 00:55:47.279791 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 00:55:47.281026 28362 raft_consensus.cc:1261] T ec833a4972f0409499f136f1c8294c84 P 06cdf1fe87894a70beb28a86a7f36534 [term 1 FOLLOWER]: Refusing update from remote peer b5c138fd875e47b1af3b586daaeec397: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:55:47.281051 28598 raft_consensus.cc:1261] T ec833a4972f0409499f136f1c8294c84 P a9f3759bcaa743f5aba85ea86ad9145d [term 1 FOLLOWER]: Refusing update from remote peer b5c138fd875e47b1af3b586daaeec397: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:55:47.281328 28963 consensus_queue.cc:1035] T ec833a4972f0409499f136f1c8294c84 P b5c138fd875e47b1af3b586daaeec397 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:55:47.281519 28963 consensus_queue.cc:1035] T ec833a4972f0409499f136f1c8294c84 P b5c138fd875e47b1af3b586daaeec397 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:55:47.287180 28096 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44346:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:55:47.287324 28096 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44346:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:55:47.288221 28096 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 802eda0d72274b71956fcba4925fd37a: Sending DeleteTablet for 3 replicas of tablet ec833a4972f0409499f136f1c8294c84
I20260811 00:55:47.288579 28324 tablet_service.cc:1514] Processing DeleteTablet for tablet ec833a4972f0409499f136f1c8294c84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:55:47 UTC) from {username='oryx', principal='oryx/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:53576
I20260811 00:55:47.288589 28564 tablet_service.cc:1514] Processing DeleteTablet for tablet ec833a4972f0409499f136f1c8294c84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:55:47 UTC) from {username='oryx', principal='oryx/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:44752
I20260811 00:55:47.288666 28798 tablet_service.cc:1514] Processing DeleteTablet for tablet ec833a4972f0409499f136f1c8294c84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:55:47 UTC) from {username='oryx', principal='oryx/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:52536
I20260811 00:55:47.288908 29078 tablet_replica.cc:330] T ec833a4972f0409499f136f1c8294c84 P 06cdf1fe87894a70beb28a86a7f36534: stopping tablet replica
I20260811 00:55:47.288919 29076 tablet_replica.cc:330] T ec833a4972f0409499f136f1c8294c84 P a9f3759bcaa743f5aba85ea86ad9145d: stopping tablet replica
I20260811 00:55:47.288949 29077 tablet_replica.cc:330] T ec833a4972f0409499f136f1c8294c84 P b5c138fd875e47b1af3b586daaeec397: stopping tablet replica
I20260811 00:55:47.288985 29078 raft_consensus.cc:2229] T ec833a4972f0409499f136f1c8294c84 P 06cdf1fe87894a70beb28a86a7f36534 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:55:47.289009 29076 raft_consensus.cc:2229] T ec833a4972f0409499f136f1c8294c84 P a9f3759bcaa743f5aba85ea86ad9145d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:55:47.289018 29077 raft_consensus.cc:2229] T ec833a4972f0409499f136f1c8294c84 P b5c138fd875e47b1af3b586daaeec397 [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:55:47.289058 29078 raft_consensus.cc:2258] T ec833a4972f0409499f136f1c8294c84 P 06cdf1fe87894a70beb28a86a7f36534 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:55:47.289074 29076 raft_consensus.cc:2258] T ec833a4972f0409499f136f1c8294c84 P a9f3759bcaa743f5aba85ea86ad9145d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:55:47.289093 29077 raft_consensus.cc:2258] T ec833a4972f0409499f136f1c8294c84 P b5c138fd875e47b1af3b586daaeec397 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:55:47.289567 29078 ts_tablet_manager.cc:1905] T ec833a4972f0409499f136f1c8294c84 P 06cdf1fe87894a70beb28a86a7f36534: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:55:47.289568 29077 ts_tablet_manager.cc:1905] T ec833a4972f0409499f136f1c8294c84 P b5c138fd875e47b1af3b586daaeec397: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:55:47.289927 29076 ts_tablet_manager.cc:1905] T ec833a4972f0409499f136f1c8294c84 P a9f3759bcaa743f5aba85ea86ad9145d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:55:47.291709 29077 ts_tablet_manager.cc:1918] T ec833a4972f0409499f136f1c8294c84 P b5c138fd875e47b1af3b586daaeec397: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:55:47.291709 29078 ts_tablet_manager.cc:1918] T ec833a4972f0409499f136f1c8294c84 P 06cdf1fe87894a70beb28a86a7f36534: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:55:47.291779 29078 log.cc:1196] T ec833a4972f0409499f136f1c8294c84 P 06cdf1fe87894a70beb28a86a7f36534: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-0/wal/wals/ec833a4972f0409499f136f1c8294c84
I20260811 00:55:47.291779 29077 log.cc:1196] T ec833a4972f0409499f136f1c8294c84 P b5c138fd875e47b1af3b586daaeec397: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-2/wal/wals/ec833a4972f0409499f136f1c8294c84
I20260811 00:55:47.291915 29076 ts_tablet_manager.cc:1918] T ec833a4972f0409499f136f1c8294c84 P a9f3759bcaa743f5aba85ea86ad9145d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:55:47.291985 29076 log.cc:1196] T ec833a4972f0409499f136f1c8294c84 P a9f3759bcaa743f5aba85ea86ad9145d: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-1/wal/wals/ec833a4972f0409499f136f1c8294c84
I20260811 00:55:47.292054 29077 ts_tablet_manager.cc:1939] T ec833a4972f0409499f136f1c8294c84 P b5c138fd875e47b1af3b586daaeec397: Deleting consensus metadata
I20260811 00:55:47.292054 29078 ts_tablet_manager.cc:1939] T ec833a4972f0409499f136f1c8294c84 P 06cdf1fe87894a70beb28a86a7f36534: Deleting consensus metadata
I20260811 00:55:47.292230 29076 ts_tablet_manager.cc:1939] T ec833a4972f0409499f136f1c8294c84 P a9f3759bcaa743f5aba85ea86ad9145d: Deleting consensus metadata
I20260811 00:55:47.292654 28072 catalog_manager.cc:4841] TS b5c138fd875e47b1af3b586daaeec397 (127.15.70.3:38873): tablet ec833a4972f0409499f136f1c8294c84 (table test-table [id=cc6cd700ef8842ffbf01ccc7b9541feb]) successfully deleted
I20260811 00:55:47.292658 28070 catalog_manager.cc:4841] TS a9f3759bcaa743f5aba85ea86ad9145d (127.15.70.2:46787): tablet ec833a4972f0409499f136f1c8294c84 (table test-table [id=cc6cd700ef8842ffbf01ccc7b9541feb]) successfully deleted
I20260811 00:55:47.292685 28074 catalog_manager.cc:4841] TS 06cdf1fe87894a70beb28a86a7f36534 (127.15.70.1:33573): tablet ec833a4972f0409499f136f1c8294c84 (table test-table [id=cc6cd700ef8842ffbf01ccc7b9541feb]) successfully deleted
I20260811 00:55:47.292872 28096 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44346:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:55:47.293099 28096 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:55:47.294901 28324 tablet_service.cc:1467] Processing CreateTablet for tablet bd93288f1596418ebbac422637ad2b22 (DEFAULT_TABLE table=test-table [id=a4d93de2fecf4b4b9a9c7711f2b0e6dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:55:47.294893 28798 tablet_service.cc:1467] Processing CreateTablet for tablet bd93288f1596418ebbac422637ad2b22 (DEFAULT_TABLE table=test-table [id=a4d93de2fecf4b4b9a9c7711f2b0e6dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:55:47.294891 28564 tablet_service.cc:1467] Processing CreateTablet for tablet bd93288f1596418ebbac422637ad2b22 (DEFAULT_TABLE table=test-table [id=a4d93de2fecf4b4b9a9c7711f2b0e6dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:55:47.295068 28564 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd93288f1596418ebbac422637ad2b22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:47.295081 28324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd93288f1596418ebbac422637ad2b22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:47.295084 28798 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd93288f1596418ebbac422637ad2b22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:47.296576 28948 tablet_bootstrap.cc:492] T bd93288f1596418ebbac422637ad2b22 P a9f3759bcaa743f5aba85ea86ad9145d: Bootstrap starting.
I20260811 00:55:47.296720 28946 tablet_bootstrap.cc:492] T bd93288f1596418ebbac422637ad2b22 P b5c138fd875e47b1af3b586daaeec397: Bootstrap starting.
I20260811 00:55:47.296825 28950 tablet_bootstrap.cc:492] T bd93288f1596418ebbac422637ad2b22 P 06cdf1fe87894a70beb28a86a7f36534: Bootstrap starting.
I20260811 00:55:47.297130 28948 tablet_bootstrap.cc:654] T bd93288f1596418ebbac422637ad2b22 P a9f3759bcaa743f5aba85ea86ad9145d: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:47.297176 28946 tablet_bootstrap.cc:654] T bd93288f1596418ebbac422637ad2b22 P b5c138fd875e47b1af3b586daaeec397: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:47.297863 28950 tablet_bootstrap.cc:654] T bd93288f1596418ebbac422637ad2b22 P 06cdf1fe87894a70beb28a86a7f36534: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:47.298355 28946 tablet_bootstrap.cc:492] T bd93288f1596418ebbac422637ad2b22 P b5c138fd875e47b1af3b586daaeec397: No bootstrap required, opened a new log
I20260811 00:55:47.298432 28946 ts_tablet_manager.cc:1397] T bd93288f1596418ebbac422637ad2b22 P b5c138fd875e47b1af3b586daaeec397: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 00:55:47.298611 28946 raft_consensus.cc:348] T bd93288f1596418ebbac422637ad2b22 P b5c138fd875e47b1af3b586daaeec397 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } }
I20260811 00:55:47.298727 28946 raft_consensus.cc:374] T bd93288f1596418ebbac422637ad2b22 P b5c138fd875e47b1af3b586daaeec397 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:47.298755 28946 raft_consensus.cc:729] T bd93288f1596418ebbac422637ad2b22 P b5c138fd875e47b1af3b586daaeec397 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5c138fd875e47b1af3b586daaeec397, State: Initialized, Role: FOLLOWER
I20260811 00:55:47.298827 28950 tablet_bootstrap.cc:492] T bd93288f1596418ebbac422637ad2b22 P 06cdf1fe87894a70beb28a86a7f36534: No bootstrap required, opened a new log
I20260811 00:55:47.298815 28946 consensus_queue.cc:260] T bd93288f1596418ebbac422637ad2b22 P b5c138fd875e47b1af3b586daaeec397 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } }
I20260811 00:55:47.298877 28950 ts_tablet_manager.cc:1397] T bd93288f1596418ebbac422637ad2b22 P 06cdf1fe87894a70beb28a86a7f36534: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 00:55:47.298947 28946 ts_tablet_manager.cc:1428] T bd93288f1596418ebbac422637ad2b22 P b5c138fd875e47b1af3b586daaeec397: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:47.299069 28948 tablet_bootstrap.cc:492] T bd93288f1596418ebbac422637ad2b22 P a9f3759bcaa743f5aba85ea86ad9145d: No bootstrap required, opened a new log
I20260811 00:55:47.299120 28948 ts_tablet_manager.cc:1397] T bd93288f1596418ebbac422637ad2b22 P a9f3759bcaa743f5aba85ea86ad9145d: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260811 00:55:47.299085 28950 raft_consensus.cc:348] T bd93288f1596418ebbac422637ad2b22 P 06cdf1fe87894a70beb28a86a7f36534 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } }
I20260811 00:55:47.299162 28950 raft_consensus.cc:374] T bd93288f1596418ebbac422637ad2b22 P 06cdf1fe87894a70beb28a86a7f36534 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:47.299185 28950 raft_consensus.cc:729] T bd93288f1596418ebbac422637ad2b22 P 06cdf1fe87894a70beb28a86a7f36534 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06cdf1fe87894a70beb28a86a7f36534, State: Initialized, Role: FOLLOWER
I20260811 00:55:47.299232 28950 consensus_queue.cc:260] T bd93288f1596418ebbac422637ad2b22 P 06cdf1fe87894a70beb28a86a7f36534 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } }
I20260811 00:55:47.299346 28950 ts_tablet_manager.cc:1428] T bd93288f1596418ebbac422637ad2b22 P 06cdf1fe87894a70beb28a86a7f36534: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:47.299333 28948 raft_consensus.cc:348] T bd93288f1596418ebbac422637ad2b22 P a9f3759bcaa743f5aba85ea86ad9145d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } }
I20260811 00:55:47.299417 28948 raft_consensus.cc:374] T bd93288f1596418ebbac422637ad2b22 P a9f3759bcaa743f5aba85ea86ad9145d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:47.299439 28948 raft_consensus.cc:729] T bd93288f1596418ebbac422637ad2b22 P a9f3759bcaa743f5aba85ea86ad9145d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9f3759bcaa743f5aba85ea86ad9145d, State: Initialized, Role: FOLLOWER
I20260811 00:55:47.299487 28948 consensus_queue.cc:260] T bd93288f1596418ebbac422637ad2b22 P a9f3759bcaa743f5aba85ea86ad9145d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } }
I20260811 00:55:47.299604 28948 ts_tablet_manager.cc:1428] T bd93288f1596418ebbac422637ad2b22 P a9f3759bcaa743f5aba85ea86ad9145d: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 00:55:47.356166 28961 raft_consensus.cc:482] T bd93288f1596418ebbac422637ad2b22 P 06cdf1fe87894a70beb28a86a7f36534 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:55:47.356330 28961 raft_consensus.cc:504] T bd93288f1596418ebbac422637ad2b22 P 06cdf1fe87894a70beb28a86a7f36534 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } }
I20260811 00:55:47.356882 28961 leader_election.cc:288] T bd93288f1596418ebbac422637ad2b22 P 06cdf1fe87894a70beb28a86a7f36534 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9f3759bcaa743f5aba85ea86ad9145d (127.15.70.2:46787), b5c138fd875e47b1af3b586daaeec397 (127.15.70.3:38873)
I20260811 00:55:47.361963 29048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:47.357268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:53325 (local address 127.15.70.2:46787)
0811 00:55:47.357365 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:47.357368 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:47.357503 (+ 135us) server_negotiation.cc:407] Connection header received
0811 00:55:47.357597 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:47.357598 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:47.357611 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:47.357680 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:47.357995 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:47.358825 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:47.360755 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:47.361411 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:47.361506 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:47.361524 (+ 18us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:47.361808 (+ 284us) server_negotiation.cc:299] Negotiation successful
0811 00:55:47.361875 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 00:55:47.362012 28943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:47.357358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:33183 (local address 127.15.70.3:38873)
0811 00:55:47.357451 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:47.357453 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:47.357538 (+ 85us) server_negotiation.cc:407] Connection header received
0811 00:55:47.357614 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:47.357616 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:47.357627 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:47.357681 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:55:47.357995 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:47.358825 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:47.360754 (+ 1929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:47.361414 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:47.361505 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:47.361533 (+ 28us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:47.361809 (+ 276us) server_negotiation.cc:299] Negotiation successful
0811 00:55:47.361856 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 00:55:47.362063 29116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:47.357175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.2:46787 (local address 127.15.70.1:53325)
0811 00:55:47.357386 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:47.357400 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:47.357515 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:47.357705 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:47.357706 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:47.357713 (+ 7us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:47.357854 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:47.357858 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:47.358962 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:47.358964 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:47.360634 (+ 1670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:47.360639 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:47.361583 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:47.361584 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:47.361702 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:47.361708 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 00:55:47.361791 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 00:55:47.361869 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"mutex_wait_us":187,"spinlock_wait_cycles":896,"thread_start_us":98,"threads_started":1}
I20260811 00:55:47.362412 28598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd93288f1596418ebbac422637ad2b22" candidate_uuid: "06cdf1fe87894a70beb28a86a7f36534" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" is_pre_election: true
I20260811 00:55:47.362493 29115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:47.357175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:38873 (local address 127.15.70.1:33183)
0811 00:55:47.357437 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:47.357447 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:47.357537 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:47.357705 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:47.357706 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:47.357709 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:55:47.357855 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:47.357858 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:47.358963 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:47.358964 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:47.360638 (+ 1674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:47.360639 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:47.361582 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:47.361584 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:47.361699 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:47.361705 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 00:55:47.361791 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 00:55:47.361869 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"mutex_wait_us":151,"thread_start_us":94,"threads_started":1}
I20260811 00:55:47.362560 28598 raft_consensus.cc:2454] T bd93288f1596418ebbac422637ad2b22 P a9f3759bcaa743f5aba85ea86ad9145d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06cdf1fe87894a70beb28a86a7f36534 in term 0.
I20260811 00:55:47.362849 28828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd93288f1596418ebbac422637ad2b22" candidate_uuid: "06cdf1fe87894a70beb28a86a7f36534" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5c138fd875e47b1af3b586daaeec397" is_pre_election: true
I20260811 00:55:47.362888 28249 leader_election.cc:302] T bd93288f1596418ebbac422637ad2b22 P 06cdf1fe87894a70beb28a86a7f36534 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06cdf1fe87894a70beb28a86a7f36534, a9f3759bcaa743f5aba85ea86ad9145d; no voters:
I20260811 00:55:47.362957 28828 raft_consensus.cc:2454] T bd93288f1596418ebbac422637ad2b22 P b5c138fd875e47b1af3b586daaeec397 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06cdf1fe87894a70beb28a86a7f36534 in term 0.
I20260811 00:55:47.363106 28961 raft_consensus.cc:2781] T bd93288f1596418ebbac422637ad2b22 P 06cdf1fe87894a70beb28a86a7f36534 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:55:47.363161 28961 raft_consensus.cc:482] T bd93288f1596418ebbac422637ad2b22 P 06cdf1fe87894a70beb28a86a7f36534 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:55:47.363190 28961 raft_consensus.cc:3037] T bd93288f1596418ebbac422637ad2b22 P 06cdf1fe87894a70beb28a86a7f36534 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:47.364188 28961 raft_consensus.cc:504] T bd93288f1596418ebbac422637ad2b22 P 06cdf1fe87894a70beb28a86a7f36534 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } }
I20260811 00:55:47.364393 28961 leader_election.cc:288] T bd93288f1596418ebbac422637ad2b22 P 06cdf1fe87894a70beb28a86a7f36534 [CANDIDATE]: Term 1 election: Requested vote from peers a9f3759bcaa743f5aba85ea86ad9145d (127.15.70.2:46787), b5c138fd875e47b1af3b586daaeec397 (127.15.70.3:38873)
I20260811 00:55:47.364629 28828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd93288f1596418ebbac422637ad2b22" candidate_uuid: "06cdf1fe87894a70beb28a86a7f36534" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5c138fd875e47b1af3b586daaeec397"
I20260811 00:55:47.364629 28598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd93288f1596418ebbac422637ad2b22" candidate_uuid: "06cdf1fe87894a70beb28a86a7f36534" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9f3759bcaa743f5aba85ea86ad9145d"
I20260811 00:55:47.364746 28828 raft_consensus.cc:3037] T bd93288f1596418ebbac422637ad2b22 P b5c138fd875e47b1af3b586daaeec397 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:47.364746 28598 raft_consensus.cc:3037] T bd93288f1596418ebbac422637ad2b22 P a9f3759bcaa743f5aba85ea86ad9145d [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:47.365816 28598 raft_consensus.cc:2454] T bd93288f1596418ebbac422637ad2b22 P a9f3759bcaa743f5aba85ea86ad9145d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06cdf1fe87894a70beb28a86a7f36534 in term 1.
I20260811 00:55:47.365815 28828 raft_consensus.cc:2454] T bd93288f1596418ebbac422637ad2b22 P b5c138fd875e47b1af3b586daaeec397 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06cdf1fe87894a70beb28a86a7f36534 in term 1.
I20260811 00:55:47.366102 28250 leader_election.cc:302] T bd93288f1596418ebbac422637ad2b22 P 06cdf1fe87894a70beb28a86a7f36534 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06cdf1fe87894a70beb28a86a7f36534, b5c138fd875e47b1af3b586daaeec397; no voters:
I20260811 00:55:47.366212 28961 raft_consensus.cc:2781] T bd93288f1596418ebbac422637ad2b22 P 06cdf1fe87894a70beb28a86a7f36534 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:55:47.366420 28961 raft_consensus.cc:686] T bd93288f1596418ebbac422637ad2b22 P 06cdf1fe87894a70beb28a86a7f36534 [term 1 LEADER]: Becoming Leader. State: Replica: 06cdf1fe87894a70beb28a86a7f36534, State: Running, Role: LEADER
I20260811 00:55:47.366504 28961 consensus_queue.cc:237] T bd93288f1596418ebbac422637ad2b22 P 06cdf1fe87894a70beb28a86a7f36534 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } }
I20260811 00:55:47.367651 28096 catalog_manager.cc:5495] T bd93288f1596418ebbac422637ad2b22 P 06cdf1fe87894a70beb28a86a7f36534 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06cdf1fe87894a70beb28a86a7f36534 (127.15.70.1). New cstate: current_term: 1 leader_uuid: "06cdf1fe87894a70beb28a86a7f36534" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cdf1fe87894a70beb28a86a7f36534" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 } health_report { overall_health: UNKNOWN } } }
I20260811 00:55:47.384362 29121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:47.380946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53592 (local address 127.15.70.1:33573)
0811 00:55:47.381169 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:47.381171 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:47.381177 (+ 6us) server_negotiation.cc:407] Connection header received
0811 00:55:47.381231 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:47.381232 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:47.381261 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:47.381349 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:55:47.381548 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:47.382212 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:47.383309 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:47.383572 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:47.383640 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:47.383826 (+ 186us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:55:47.383986 (+ 160us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:55:47.384053 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:47.384140 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 00:55:47.384181 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":149,"threads_started":1}
I20260811 00:55:47.391587 28943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:47.388388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:57573 (local address 127.15.70.3:38873)
0811 00:55:47.388471 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:47.388474 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:47.388559 (+ 85us) server_negotiation.cc:407] Connection header received
0811 00:55:47.388670 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:47.388671 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:47.388688 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:47.388782 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:55:47.389049 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:47.389659 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:47.390586 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:47.390809 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:47.390905 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:47.391212 (+ 307us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:55:47.391261 (+ 49us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:55:47.391331 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:47.391472 (+ 141us) server_negotiation.cc:299] Negotiation successful
0811 00:55:47.391499 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 00:55:47.391623 29126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:47.388166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:38873 (local address 127.15.70.1:57573)
0811 00:55:47.388466 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:47.388482 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:47.388590 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:47.388788 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:47.388790 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:47.388792 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 00:55:47.388939 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:47.388941 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:47.389770 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:47.389772 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:47.390473 (+ 701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:47.390476 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:47.390905 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:47.390906 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:47.390994 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:47.391095 (+ 101us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 00:55:47.391377 (+ 282us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 00:55:47.391381 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:55:47.391459 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 00:55:47.391526 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":151,"threads_started":1}
I20260811 00:55:47.394632 28828 raft_consensus.cc:1261] T bd93288f1596418ebbac422637ad2b22 P b5c138fd875e47b1af3b586daaeec397 [term 1 FOLLOWER]: Refusing update from remote peer 06cdf1fe87894a70beb28a86a7f36534: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:55:47.394908 28598 raft_consensus.cc:1261] T bd93288f1596418ebbac422637ad2b22 P a9f3759bcaa743f5aba85ea86ad9145d [term 1 FOLLOWER]: Refusing update from remote peer 06cdf1fe87894a70beb28a86a7f36534: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:55:47.394963 28961 consensus_queue.cc:1035] T bd93288f1596418ebbac422637ad2b22 P 06cdf1fe87894a70beb28a86a7f36534 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5c138fd875e47b1af3b586daaeec397" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:55:47.395219 29118 consensus_queue.cc:1035] T bd93288f1596418ebbac422637ad2b22 P 06cdf1fe87894a70beb28a86a7f36534 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9f3759bcaa743f5aba85ea86ad9145d" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:55:47.404361 29073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:47.401182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:33573 (local address 127.15.70.3:34107)
0811 00:55:47.401245 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:47.401261 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:47.401302 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:47.401600 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:47.401601 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:47.401603 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 00:55:47.401671 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:47.401673 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:47.402398 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:47.402399 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:47.403437 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:47.403441 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:47.403871 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:47.403872 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:47.403928 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:47.403938 (+ 10us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 00:55:47.404149 (+ 211us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 00:55:47.404153 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:55:47.404209 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 00:55:47.404279 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 00:55:47.404347 29121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:47.401395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:34107 (local address 127.15.70.1:33573)
0811 00:55:47.401460 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:47.401463 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:47.401473 (+ 10us) server_negotiation.cc:407] Connection header received
0811 00:55:47.401501 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:47.401502 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:47.401514 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:47.401580 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:55:47.401740 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:47.402299 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:47.403534 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:47.403807 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:47.403892 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:47.404009 (+ 117us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:55:47.404052 (+ 43us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:55:47.404147 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:47.404214 (+ 67us) server_negotiation.cc:299] Negotiation successful
0811 00:55:47.404242 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 00:55:47.416143 28097 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44346:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:55:47.416385 28097 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44346:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:55:47.417500 28097 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 802eda0d72274b71956fcba4925fd37a: Sending DeleteTablet for 3 replicas of tablet bd93288f1596418ebbac422637ad2b22
I20260811 00:55:47.417855 28324 tablet_service.cc:1514] Processing DeleteTablet for tablet bd93288f1596418ebbac422637ad2b22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:55:47 UTC) from {username='oryx', principal='oryx/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:53576
I20260811 00:55:47.417905 28564 tablet_service.cc:1514] Processing DeleteTablet for tablet bd93288f1596418ebbac422637ad2b22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:55:47 UTC) from {username='oryx', principal='oryx/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:44752
I20260811 00:55:47.418071 29078 tablet_replica.cc:330] T bd93288f1596418ebbac422637ad2b22 P 06cdf1fe87894a70beb28a86a7f36534: stopping tablet replica
I20260811 00:55:47.418161 29078 raft_consensus.cc:2229] T bd93288f1596418ebbac422637ad2b22 P 06cdf1fe87894a70beb28a86a7f36534 [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:55:47.418308 29078 raft_consensus.cc:2258] T bd93288f1596418ebbac422637ad2b22 P 06cdf1fe87894a70beb28a86a7f36534 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:55:47.418433 29076 tablet_replica.cc:330] T bd93288f1596418ebbac422637ad2b22 P a9f3759bcaa743f5aba85ea86ad9145d: stopping tablet replica
I20260811 00:55:47.418527 29076 raft_consensus.cc:2229] T bd93288f1596418ebbac422637ad2b22 P a9f3759bcaa743f5aba85ea86ad9145d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:55:47.418588 29076 raft_consensus.cc:2258] T bd93288f1596418ebbac422637ad2b22 P a9f3759bcaa743f5aba85ea86ad9145d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:55:47.418962 29078 ts_tablet_manager.cc:1905] T bd93288f1596418ebbac422637ad2b22 P 06cdf1fe87894a70beb28a86a7f36534: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:55:47.419198 29076 ts_tablet_manager.cc:1905] T bd93288f1596418ebbac422637ad2b22 P a9f3759bcaa743f5aba85ea86ad9145d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:55:47.420809 29078 ts_tablet_manager.cc:1918] T bd93288f1596418ebbac422637ad2b22 P 06cdf1fe87894a70beb28a86a7f36534: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 00:55:47.420909 29078 log.cc:1196] T bd93288f1596418ebbac422637ad2b22 P 06cdf1fe87894a70beb28a86a7f36534: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-0/wal/wals/bd93288f1596418ebbac422637ad2b22
I20260811 00:55:47.421096 29076 ts_tablet_manager.cc:1918] T bd93288f1596418ebbac422637ad2b22 P a9f3759bcaa743f5aba85ea86ad9145d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 00:55:47.421170 29076 log.cc:1196] T bd93288f1596418ebbac422637ad2b22 P a9f3759bcaa743f5aba85ea86ad9145d: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-1/wal/wals/bd93288f1596418ebbac422637ad2b22
I20260811 00:55:47.421226 29078 ts_tablet_manager.cc:1939] T bd93288f1596418ebbac422637ad2b22 P 06cdf1fe87894a70beb28a86a7f36534: Deleting consensus metadata
I20260811 00:55:47.421412 29076 ts_tablet_manager.cc:1939] T bd93288f1596418ebbac422637ad2b22 P a9f3759bcaa743f5aba85ea86ad9145d: Deleting consensus metadata
I20260811 00:55:47.421710 28074 catalog_manager.cc:4841] TS 06cdf1fe87894a70beb28a86a7f36534 (127.15.70.1:33573): tablet bd93288f1596418ebbac422637ad2b22 (table test-table [id=a4d93de2fecf4b4b9a9c7711f2b0e6dd]) successfully deleted
I20260811 00:55:47.421948 28070 catalog_manager.cc:4841] TS a9f3759bcaa743f5aba85ea86ad9145d (127.15.70.2:46787): tablet bd93288f1596418ebbac422637ad2b22 (table test-table [id=a4d93de2fecf4b4b9a9c7711f2b0e6dd]) successfully deleted
I20260811 00:55:47.422209 28798 tablet_service.cc:1514] Processing DeleteTablet for tablet bd93288f1596418ebbac422637ad2b22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:55:47 UTC) from {username='oryx', principal='oryx/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:52536
I20260811 00:55:47.422349 29077 tablet_replica.cc:330] T bd93288f1596418ebbac422637ad2b22 P b5c138fd875e47b1af3b586daaeec397: stopping tablet replica
I20260811 00:55:47.422432 29077 raft_consensus.cc:2229] T bd93288f1596418ebbac422637ad2b22 P b5c138fd875e47b1af3b586daaeec397 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:55:47.422497 29077 raft_consensus.cc:2258] T bd93288f1596418ebbac422637ad2b22 P b5c138fd875e47b1af3b586daaeec397 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:55:47.422518 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 28216
I20260811 00:55:47.446661 29077 ts_tablet_manager.cc:1905] T bd93288f1596418ebbac422637ad2b22 P b5c138fd875e47b1af3b586daaeec397: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:55:47.448611 29077 ts_tablet_manager.cc:1918] T bd93288f1596418ebbac422637ad2b22 P b5c138fd875e47b1af3b586daaeec397: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 00:55:47.448729 29077 log.cc:1196] T bd93288f1596418ebbac422637ad2b22 P b5c138fd875e47b1af3b586daaeec397: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409704606556-15640-0/minicluster-data/ts-2/wal/wals/bd93288f1596418ebbac422637ad2b22
I20260811 00:55:47.448956 29077 ts_tablet_manager.cc:1939] T bd93288f1596418ebbac422637ad2b22 P b5c138fd875e47b1af3b586daaeec397: Deleting consensus metadata
I20260811 00:55:47.449582 28072 catalog_manager.cc:4841] TS b5c138fd875e47b1af3b586daaeec397 (127.15.70.3:38873): tablet bd93288f1596418ebbac422637ad2b22 (table test-table [id=a4d93de2fecf4b4b9a9c7711f2b0e6dd]) successfully deleted
I20260811 00:55:47.453437 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 28460
I20260811 00:55:47.476786 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 28691
I20260811 00:55:47.505236 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 28040
2026-08-11T00:55:47Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3694 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786409704606556-15640-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:55:47 dist-test-slave-h3ft krb5kdc[29139](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:55:47 dist-test-slave-h3ft krb5kdc[29139](info): set up 2 sockets
Aug 11 00:55:47 dist-test-slave-h3ft krb5kdc[29139](info): commencing operation
krb5kdc: starting...
W20260811 00:55:48.884318 15640 mini_kdc.cc:121] Time spent starting KDC: real 1.340s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Aug 11 00:55:48 dist-test-slave-h3ft krb5kdc[29139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409748, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:55:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:55:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.70.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
I20260811 00:55:49.039220 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:36737
--webserver_interface=127.15.70.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:46125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:36737
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:49.140784 29158 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:49.141093 29158 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:49.141120 29158 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:49.142372 29158 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:55:49.142421 29158 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:49.142436 29158 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:49.142449 29158 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:55:49.142462 29158 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:55:49.144179 29158 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:46125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:36737
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:36737
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29158
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:49.144456 29158 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:49.144742 29158 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:49.151105 29167 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:49.151165 29168 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:49.151125 29170 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:49.151257 29158 server_base.cc:1034] running on GCE node
I20260811 00:55:49.151943 29158 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:49.152346 29158 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:49.153538 29158 hybrid_clock.cc:648] HybridClock initialized: now 1786409749153513 us; error 44 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-11T00:55:49Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1648 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:55:49 dist-test-slave-h3ft krb5kdc[29175](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:55:49 dist-test-slave-h3ft krb5kdc[29175](info): set up 2 sockets
Aug 11 00:55:49 dist-test-slave-h3ft krb5kdc[29175](info): commencing operation
krb5kdc: starting...
W20260811 00:55:50.485404 15640 mini_kdc.cc:121] Time spent starting KDC: real 1.293s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Aug 11 00:55:50 dist-test-slave-h3ft krb5kdc[29175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409750, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:55:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:55:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.70.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
I20260811 00:55:50.647701 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:35921
--webserver_interface=127.15.70.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:41881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:35921
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:50.747465 29200 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:50.747758 29200 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:50.747788 29200 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:50.749092 29200 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:55:50.749143 29200 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:50.749159 29200 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:50.749172 29200 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:55:50.749186 29200 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:55:50.750960 29200 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:41881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:35921
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:35921
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29200
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:50.751421 29200 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:50.751726 29200 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:50.757498 29209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:50.757524 29210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:50.757772 29200 server_base.cc:1034] running on GCE node
W20260811 00:55:50.757507 29215 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:50.758174 29200 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:50.758483 29200 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:50.759634 29200 hybrid_clock.cc:648] HybridClock initialized: now 1786409750759617 us; error 34 us; skew 500 ppm
Aug 11 00:55:50 dist-test-slave-h3ft krb5kdc[29175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409750, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:50.768481 29200 init.cc:377] Logged in from keytab as kudu/127.15.70.62@KRBTEST.COM (short username kudu)
I20260811 00:55:50.769157 29200 webserver.cc:460] Webserver started at http://127.15.70.62:45173/ using document root <none> and password file <none>
I20260811 00:55:50.769497 29200 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:50.769585 29200 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:50.769779 29200 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:50.771332 29200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "ddf4e5c33afa43b6a7440c060c1513e5"
format_stamp: "Formatted at 2026-08-11 00:55:50 on dist-test-slave-h3ft"
server_key: "47fc93bca199b9a87fb5ae6b882ff8af"
server_key_iv: "01eb2b31c9bf2676c85ad9f4e426e11b"
server_key_version: "encryptionkey@0"
I20260811 00:55:50.771811 29200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "ddf4e5c33afa43b6a7440c060c1513e5"
format_stamp: "Formatted at 2026-08-11 00:55:50 on dist-test-slave-h3ft"
server_key: "47fc93bca199b9a87fb5ae6b882ff8af"
server_key_iv: "01eb2b31c9bf2676c85ad9f4e426e11b"
server_key_version: "encryptionkey@0"
I20260811 00:55:50.773593 29200 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 00:55:50.774732 29228 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:50.774972 29200 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:50.775159 29200 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "ddf4e5c33afa43b6a7440c060c1513e5"
format_stamp: "Formatted at 2026-08-11 00:55:50 on dist-test-slave-h3ft"
server_key: "47fc93bca199b9a87fb5ae6b882ff8af"
server_key_iv: "01eb2b31c9bf2676c85ad9f4e426e11b"
server_key_version: "encryptionkey@0"
I20260811 00:55:50.775260 29200 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:50.795501 29200 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:50.798096 29200 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:50.798314 29200 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:50.804382 29200 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:35921
I20260811 00:55:50.804412 29329 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:35921 every 8 connection(s)
I20260811 00:55:50.804951 29200 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:55:50.806268 29330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:55:50.806293 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 29200
I20260811 00:55:50.806448 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 00:55:50.806728 15640 external_mini_cluster.cc:1428] Setting key 6dd6b9968bb39382559f8441a205d285
I20260811 00:55:50.810635 29330 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ddf4e5c33afa43b6a7440c060c1513e5: Bootstrap starting.
I20260811 00:55:50.811496 29330 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ddf4e5c33afa43b6a7440c060c1513e5: Neither blocks nor log segments found. Creating new log.
I20260811 00:55:50.811861 29330 log.cc:824] T 00000000000000000000000000000000 P ddf4e5c33afa43b6a7440c060c1513e5: Log is configured to *not* fsync() on all Append() calls
I20260811 00:55:50.812800 29330 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ddf4e5c33afa43b6a7440c060c1513e5: No bootstrap required, opened a new log
Aug 11 00:55:50 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409750, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:50.815209 29330 raft_consensus.cc:348] T 00000000000000000000000000000000 P ddf4e5c33afa43b6a7440c060c1513e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddf4e5c33afa43b6a7440c060c1513e5" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 35921 } }
I20260811 00:55:50.815464 29330 raft_consensus.cc:374] T 00000000000000000000000000000000 P ddf4e5c33afa43b6a7440c060c1513e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:55:50.815546 29330 raft_consensus.cc:729] T 00000000000000000000000000000000 P ddf4e5c33afa43b6a7440c060c1513e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf4e5c33afa43b6a7440c060c1513e5, State: Initialized, Role: FOLLOWER
I20260811 00:55:50.815730 29330 consensus_queue.cc:260] T 00000000000000000000000000000000 P ddf4e5c33afa43b6a7440c060c1513e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddf4e5c33afa43b6a7440c060c1513e5" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 35921 } }
I20260811 00:55:50.815826 29330 raft_consensus.cc:388] T 00000000000000000000000000000000 P ddf4e5c33afa43b6a7440c060c1513e5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:55:50.815881 29330 raft_consensus.cc:482] T 00000000000000000000000000000000 P ddf4e5c33afa43b6a7440c060c1513e5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:55:50.815953 29330 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ddf4e5c33afa43b6a7440c060c1513e5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:55:50.816998 29330 raft_consensus.cc:504] T 00000000000000000000000000000000 P ddf4e5c33afa43b6a7440c060c1513e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddf4e5c33afa43b6a7440c060c1513e5" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 35921 } }
I20260811 00:55:50.817145 29330 leader_election.cc:302] T 00000000000000000000000000000000 P ddf4e5c33afa43b6a7440c060c1513e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ddf4e5c33afa43b6a7440c060c1513e5; no voters:
I20260811 00:55:50.817394 29330 leader_election.cc:288] T 00000000000000000000000000000000 P ddf4e5c33afa43b6a7440c060c1513e5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:55:50.817528 29335 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ddf4e5c33afa43b6a7440c060c1513e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:55:50.817737 29335 raft_consensus.cc:686] T 00000000000000000000000000000000 P ddf4e5c33afa43b6a7440c060c1513e5 [term 1 LEADER]: Becoming Leader. State: Replica: ddf4e5c33afa43b6a7440c060c1513e5, State: Running, Role: LEADER
I20260811 00:55:50.817745 29330 sys_catalog.cc:564] T 00000000000000000000000000000000 P ddf4e5c33afa43b6a7440c060c1513e5 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:55:50.817876 29335 consensus_queue.cc:237] T 00000000000000000000000000000000 P ddf4e5c33afa43b6a7440c060c1513e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddf4e5c33afa43b6a7440c060c1513e5" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 35921 } }
I20260811 00:55:50.818396 29337 sys_catalog.cc:455] T 00000000000000000000000000000000 P ddf4e5c33afa43b6a7440c060c1513e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ddf4e5c33afa43b6a7440c060c1513e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddf4e5c33afa43b6a7440c060c1513e5" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 35921 } } }
I20260811 00:55:50.818540 29337 sys_catalog.cc:458] T 00000000000000000000000000000000 P ddf4e5c33afa43b6a7440c060c1513e5 [sys.catalog]: This master's current role is: LEADER
I20260811 00:55:50.818961 29338 sys_catalog.cc:455] T 00000000000000000000000000000000 P ddf4e5c33afa43b6a7440c060c1513e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ddf4e5c33afa43b6a7440c060c1513e5. Latest consensus state: current_term: 1 leader_uuid: "ddf4e5c33afa43b6a7440c060c1513e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddf4e5c33afa43b6a7440c060c1513e5" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 35921 } } }
I20260811 00:55:50.819110 29338 sys_catalog.cc:458] T 00000000000000000000000000000000 P ddf4e5c33afa43b6a7440c060c1513e5 [sys.catalog]: This master's current role is: LEADER
I20260811 00:55:50.819294 29348 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:55:50.820019 29348 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:55:50.821214 29333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:50.807530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55518 (local address 127.15.70.62:35921)
0811 00:55:50.807752 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:50.807764 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:50.807811 (+ 47us) server_negotiation.cc:407] Connection header received
0811 00:55:50.808372 (+ 561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:50.808382 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:50.808447 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:50.808620 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:50.809610 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:50.810722 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:50.811795 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:50.812562 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:50.812731 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:50.815999 (+ 3268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:50.816006 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:50.816006 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:50.816023 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:50.818966 (+ 2943us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:50.819583 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:50.819587 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:50.819588 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:50.819723 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:50.820050 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:50.820051 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:50.820051 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:50.820444 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:50.820629 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:50.820767 (+ 138us) server_negotiation.cc:299] Negotiation successful
0811 00:55:50.820947 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":107,"threads_started":1}
I20260811 00:55:50.822403 29348 catalog_manager.cc:1347] Generated new cluster ID: 8b54c203fdff4684b8d093e0118eff47
I20260811 00:55:50.822459 29348 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:55:50.851367 29348 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:55:50.852056 29348 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:55:50.856060 29348 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ddf4e5c33afa43b6a7440c060c1513e5: Generated new TSK 0
I20260811 00:55:50.856348 29348 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.70.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab.
Entry for principal kudu/127.15.70.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab.
I20260811 00:55:50.895071 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.1:0
--local_ip_for_outbound_sockets=127.15.70.1
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:35921
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:41881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:50.998050 29368 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:50.998409 29368 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:50.998457 29368 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:51.000005 29368 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:51.000098 29368 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:51.000149 29368 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.1
I20260811 00:55:51.001982 29368 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:41881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:35921
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29368
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.1
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:51.002409 29368 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:51.002740 29368 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:51.009658 29379 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:51.009635 29384 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:51.009635 29378 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:51.009797 29368 server_base.cc:1034] running on GCE node
I20260811 00:55:51.010149 29368 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:51.010447 29368 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:51.011624 29368 hybrid_clock.cc:648] HybridClock initialized: now 1786409751011608 us; error 58 us; skew 500 ppm
Aug 11 00:55:51 dist-test-slave-h3ft krb5kdc[29175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409751, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:51.015125 29368 init.cc:377] Logged in from keytab as kudu/127.15.70.1@KRBTEST.COM (short username kudu)
I20260811 00:55:51.015666 29368 webserver.cc:460] Webserver started at http://127.15.70.1:43045/ using document root <none> and password file <none>
I20260811 00:55:51.015938 29368 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:51.015986 29368 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:51.016110 29368 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:51.017350 29368 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-0/data/instance:
uuid: "4d3770ff03cd4435861b4f7ca9a67852"
format_stamp: "Formatted at 2026-08-11 00:55:51 on dist-test-slave-h3ft"
server_key: "667f327179615b901b2c91cb29879c83"
server_key_iv: "cf2dfd7dd17759bf85424fbb39c1db20"
server_key_version: "encryptionkey@0"
I20260811 00:55:51.017715 29368 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance:
uuid: "4d3770ff03cd4435861b4f7ca9a67852"
format_stamp: "Formatted at 2026-08-11 00:55:51 on dist-test-slave-h3ft"
server_key: "667f327179615b901b2c91cb29879c83"
server_key_iv: "cf2dfd7dd17759bf85424fbb39c1db20"
server_key_version: "encryptionkey@0"
I20260811 00:55:51.019672 29368 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.001s
I20260811 00:55:51.020638 29391 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:51.020918 29368 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 00:55:51.021072 29368 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-0/wal
uuid: "4d3770ff03cd4435861b4f7ca9a67852"
format_stamp: "Formatted at 2026-08-11 00:55:51 on dist-test-slave-h3ft"
server_key: "667f327179615b901b2c91cb29879c83"
server_key_iv: "cf2dfd7dd17759bf85424fbb39c1db20"
server_key_version: "encryptionkey@0"
I20260811 00:55:51.021164 29368 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:51.046113 29368 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:51.049213 29368 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:51.049396 29368 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:51.049736 29368 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:55:51.050153 29368 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:55:51.050212 29368 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:51.050259 29368 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:55:51.050289 29368 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:51.057648 29368 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.1:34379
I20260811 00:55:51.057742 29571 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.1:34379 every 8 connection(s)
I20260811 00:55:51.058156 29368 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
I20260811 00:55:51.064142 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 29368
I20260811 00:55:51.064311 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance
I20260811 00:55:51.064594 15640 external_mini_cluster.cc:1428] Setting key 4c55185b534b71ba3106bbe103adb6a9
Aug 11 00:55:51 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409751, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:51.071163 29333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:51.059215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:56553 (local address 127.15.70.62:35921)
0811 00:55:51.059307 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:51.059309 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:51.059550 (+ 241us) server_negotiation.cc:407] Connection header received
0811 00:55:51.060202 (+ 652us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:51.060203 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:51.060218 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:51.060279 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:51.061590 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:51.062196 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:51.063656 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:51.064085 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:51.064191 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:51.067351 (+ 3160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:51.067354 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:51.067355 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:51.067366 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:51.069265 (+ 1899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:51.069833 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:51.069835 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:51.069836 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:51.069915 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:51.070245 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:51.070246 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:51.070247 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:51.070401 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:51.070489 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:51.070844 (+ 355us) server_negotiation.cc:299] Negotiation successful
0811 00:55:51.071041 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 00:55:51.071386 29587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:51.059218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.1:56553)
0811 00:55:51.059410 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:51.059459 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:51.060092 (+ 633us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:51.060351 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:51.060355 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:51.061195 (+ 840us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:51.061458 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:51.061464 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:51.062366 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:51.062367 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:51.063517 (+ 1150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:51.063521 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:51.064224 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:51.064226 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:51.064450 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:51.065279 (+ 829us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:51.065290 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:51.067225 (+ 1935us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:51.069393 (+ 2168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:51.069404 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:51.069408 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:51.069738 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:51.069997 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:51.069998 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:51.069998 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:51.070161 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:51.070475 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:51.070483 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:51.070680 (+ 197us) client_negotiation.cc:769] Sending connection context
0811 00:55:51.070810 (+ 130us) client_negotiation.cc:240] Negotiation successful
0811 00:55:51.071074 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":104,"threads_started":1}
I20260811 00:55:51.072147 29572 heartbeater.cc:347] Connected to a master server at 127.15.70.62:35921
I20260811 00:55:51.072310 29572 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:51.072628 29572 heartbeater.cc:511] Master 127.15.70.62:35921 requested a full tablet report, sending...
I20260811 00:55:51.073487 29261 ts_manager.cc:194] Registered new tserver with Master: 4d3770ff03cd4435861b4f7ca9a67852 (127.15.70.1:34379)
I20260811 00:55:51.074252 29261 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.1@KRBTEST.COM'} at 127.15.70.1:56553
WARNING: no policy specified for kudu/127.15.70.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab.
Entry for principal kudu/127.15.70.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab.
I20260811 00:55:51.103529 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.2:0
--local_ip_for_outbound_sockets=127.15.70.2
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:35921
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:41881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:51.204438 29591 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:51.204766 29591 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:51.204846 29591 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:51.206399 29591 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:51.206478 29591 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:51.206516 29591 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.2
I20260811 00:55:51.208369 29591 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:41881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:35921
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29591
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.2
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:51.208669 29591 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:51.208926 29591 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:51.215232 29602 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:51.215231 29605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:51.215286 29600 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:51.215698 29591 server_base.cc:1034] running on GCE node
I20260811 00:55:51.216035 29591 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:51.216329 29591 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:51.217525 29591 hybrid_clock.cc:648] HybridClock initialized: now 1786409751217502 us; error 47 us; skew 500 ppm
Aug 11 00:55:51 dist-test-slave-h3ft krb5kdc[29175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409751, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:51.221205 29591 init.cc:377] Logged in from keytab as kudu/127.15.70.2@KRBTEST.COM (short username kudu)
I20260811 00:55:51.221830 29591 webserver.cc:460] Webserver started at http://127.15.70.2:42395/ using document root <none> and password file <none>
I20260811 00:55:51.222127 29591 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:51.222204 29591 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:51.222394 29591 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:51.223868 29591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-1/data/instance:
uuid: "287bf68fa8e647e9b4ee31481b912f9c"
format_stamp: "Formatted at 2026-08-11 00:55:51 on dist-test-slave-h3ft"
server_key: "3ddf09b1fc1681adb7b7b2d82d3f74dd"
server_key_iv: "c1ae5edd027a429a46ff0ae9eb51aa43"
server_key_version: "encryptionkey@0"
I20260811 00:55:51.224378 29591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance:
uuid: "287bf68fa8e647e9b4ee31481b912f9c"
format_stamp: "Formatted at 2026-08-11 00:55:51 on dist-test-slave-h3ft"
server_key: "3ddf09b1fc1681adb7b7b2d82d3f74dd"
server_key_iv: "c1ae5edd027a429a46ff0ae9eb51aa43"
server_key_version: "encryptionkey@0"
I20260811 00:55:51.226229 29591 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 00:55:51.227186 29623 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:51.227623 29591 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:51.227780 29591 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-1/wal
uuid: "287bf68fa8e647e9b4ee31481b912f9c"
format_stamp: "Formatted at 2026-08-11 00:55:51 on dist-test-slave-h3ft"
server_key: "3ddf09b1fc1681adb7b7b2d82d3f74dd"
server_key_iv: "c1ae5edd027a429a46ff0ae9eb51aa43"
server_key_version: "encryptionkey@0"
I20260811 00:55:51.227881 29591 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:51.239825 29591 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:51.242710 29591 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:51.242954 29591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:51.243430 29591 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:55:51.243885 29591 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:55:51.243948 29591 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:51.244009 29591 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:55:51.244038 29591 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:51.251674 29591 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.2:46469
I20260811 00:55:51.251722 29812 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.2:46469 every 8 connection(s)
I20260811 00:55:51.252159 29591 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
Aug 11 00:55:51 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409751, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:51.262442 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 29591
I20260811 00:55:51.262583 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance
I20260811 00:55:51.262866 15640 external_mini_cluster.cc:1428] Setting key 17f5239bd63cab879d9d98f207155ef7
I20260811 00:55:51.264180 29333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:51.253177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:33501 (local address 127.15.70.62:35921)
0811 00:55:51.253243 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:51.253245 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:51.253455 (+ 210us) server_negotiation.cc:407] Connection header received
0811 00:55:51.254118 (+ 663us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:51.254120 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:51.254140 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:51.254201 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:51.255461 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:51.256050 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:51.257172 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:51.257389 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:51.257472 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:51.260319 (+ 2847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:51.260322 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:51.260322 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:51.260333 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:51.262079 (+ 1746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:51.262768 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:51.262769 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:51.262770 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:51.262841 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:51.263230 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:51.263231 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:51.263232 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:51.263412 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:51.263494 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:51.263917 (+ 423us) server_negotiation.cc:299] Negotiation successful
0811 00:55:51.264033 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 00:55:51.264392 29820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:51.253091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.2:33501)
0811 00:55:51.253286 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:51.253346 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:51.253990 (+ 644us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:51.254295 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:51.254300 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:51.255084 (+ 784us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:51.255349 (+ 265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:51.255355 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:51.256162 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:51.256164 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:51.257061 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:51.257063 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:51.257479 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:51.257480 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:51.257638 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:51.258271 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:51.258282 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:51.260177 (+ 1895us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:51.262231 (+ 2054us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:51.262243 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:51.262246 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:51.262681 (+ 435us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:51.262929 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:51.262930 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:51.262930 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:51.263145 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:51.263495 (+ 350us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:51.263504 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:51.263749 (+ 245us) client_negotiation.cc:769] Sending connection context
0811 00:55:51.263876 (+ 127us) client_negotiation.cc:240] Negotiation successful
0811 00:55:51.264089 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":93,"threads_started":1}
I20260811 00:55:51.264967 29813 heartbeater.cc:347] Connected to a master server at 127.15.70.62:35921
I20260811 00:55:51.265110 29813 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:51.265363 29813 heartbeater.cc:511] Master 127.15.70.62:35921 requested a full tablet report, sending...
I20260811 00:55:51.265865 29261 ts_manager.cc:194] Registered new tserver with Master: 287bf68fa8e647e9b4ee31481b912f9c (127.15.70.2:46469)
I20260811 00:55:51.266373 29261 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.2@KRBTEST.COM'} at 127.15.70.2:33501
WARNING: no policy specified for kudu/127.15.70.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab.
Entry for principal kudu/127.15.70.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab.
I20260811 00:55:51.298929 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.3:0
--local_ip_for_outbound_sockets=127.15.70.3
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:35921
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:41881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:51.397452 29826 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:51.397773 29826 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:51.397804 29826 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:51.399349 29826 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:51.399415 29826 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:51.399448 29826 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.3
I20260811 00:55:51.401459 29826 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:41881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:35921
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29826
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.3
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:51.401849 29826 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:51.402173 29826 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:51.408614 29838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:51.408535 29835 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:51.408771 29834 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:51.409070 29826 server_base.cc:1034] running on GCE node
I20260811 00:55:51.409330 29826 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:51.409647 29826 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:51.410833 29826 hybrid_clock.cc:648] HybridClock initialized: now 1786409751410795 us; error 61 us; skew 500 ppm
Aug 11 00:55:51 dist-test-slave-h3ft krb5kdc[29175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409751, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:51.413955 29826 init.cc:377] Logged in from keytab as kudu/127.15.70.3@KRBTEST.COM (short username kudu)
I20260811 00:55:51.414454 29826 webserver.cc:460] Webserver started at http://127.15.70.3:40427/ using document root <none> and password file <none>
I20260811 00:55:51.414700 29826 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:51.414745 29826 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:51.414852 29826 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:55:51.416307 29826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-2/data/instance:
uuid: "2cc79cadac7a45feb3221c289f62a2cf"
format_stamp: "Formatted at 2026-08-11 00:55:51 on dist-test-slave-h3ft"
server_key: "5a50e6851ed7584004c5bee33cfbd9cc"
server_key_iv: "7c2a24a0817f031bb9195075525a618b"
server_key_version: "encryptionkey@0"
I20260811 00:55:51.416838 29826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance:
uuid: "2cc79cadac7a45feb3221c289f62a2cf"
format_stamp: "Formatted at 2026-08-11 00:55:51 on dist-test-slave-h3ft"
server_key: "5a50e6851ed7584004c5bee33cfbd9cc"
server_key_iv: "7c2a24a0817f031bb9195075525a618b"
server_key_version: "encryptionkey@0"
I20260811 00:55:51.418620 29826 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.001s
I20260811 00:55:51.419672 29850 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:51.419886 29826 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 00:55:51.420017 29826 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-2/wal
uuid: "2cc79cadac7a45feb3221c289f62a2cf"
format_stamp: "Formatted at 2026-08-11 00:55:51 on dist-test-slave-h3ft"
server_key: "5a50e6851ed7584004c5bee33cfbd9cc"
server_key_iv: "7c2a24a0817f031bb9195075525a618b"
server_key_version: "encryptionkey@0"
I20260811 00:55:51.420090 29826 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:51.431077 29826 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:51.433796 29826 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:51.433984 29826 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:51.434326 29826 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:55:51.434731 29826 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:55:51.434767 29826 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:51.434818 29826 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:55:51.434844 29826 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:51.442040 29826 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.3:43857
I20260811 00:55:51.442137 30053 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.3:43857 every 8 connection(s)
I20260811 00:55:51.442548 29826 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
I20260811 00:55:51.447328 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 29826
I20260811 00:55:51.447453 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance
I20260811 00:55:51.447705 15640 external_mini_cluster.cc:1428] Setting key 707accaf34fd726a2eef94c916d1f3e6
Aug 11 00:55:51 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409751, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:55:51.454321 29333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:51.443574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:33157 (local address 127.15.70.62:35921)
0811 00:55:51.443693 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:51.443696 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:51.443916 (+ 220us) server_negotiation.cc:407] Connection header received
0811 00:55:51.444527 (+ 611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:51.444529 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:51.444546 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:51.444615 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:51.445820 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:51.446482 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:51.447873 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:51.448231 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:51.448306 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:51.451200 (+ 2894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:51.451202 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:51.451202 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:51.451210 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:51.452949 (+ 1739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:51.453375 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:51.453376 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:51.453376 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:51.453437 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:51.453681 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:51.453682 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:51.453682 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:51.453810 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:51.453866 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:51.454157 (+ 291us) server_negotiation.cc:299] Negotiation successful
0811 00:55:51.454236 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 00:55:51.454602 30058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:51.443523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.3:33157)
0811 00:55:51.443758 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:51.443804 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:51.444395 (+ 591us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:51.444720 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:51.444724 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:51.445428 (+ 704us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:51.445696 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:51.445702 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:51.446582 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:51.446584 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:51.447712 (+ 1128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:51.447715 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:51.448346 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:51.448348 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:51.448549 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:51.449337 (+ 788us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:51.449347 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:51.451081 (+ 1734us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:55:51.453043 (+ 1962us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:51.453051 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:51.453053 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:51.453305 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:51.453508 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:55:51.453508 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:55:51.453508 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:55:51.453625 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:55:51.453868 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:55:51.453873 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:55:51.454033 (+ 160us) client_negotiation.cc:769] Sending connection context
0811 00:55:51.454130 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 00:55:51.454279 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":143,"threads_started":1}
I20260811 00:55:51.455305 30054 heartbeater.cc:347] Connected to a master server at 127.15.70.62:35921
I20260811 00:55:51.455432 30054 heartbeater.cc:464] Registering TS with master...
I20260811 00:55:51.455657 30054 heartbeater.cc:511] Master 127.15.70.62:35921 requested a full tablet report, sending...
I20260811 00:55:51.456132 29261 ts_manager.cc:194] Registered new tserver with Master: 2cc79cadac7a45feb3221c289f62a2cf (127.15.70.3:43857)
I20260811 00:55:51.456581 29261 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.3@KRBTEST.COM'} at 127.15.70.3:33157
I20260811 00:55:51.459847 15640 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.15.70.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.70.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.70.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.1.keytab.
Entry for principal oryx/127.15.70.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.1.keytab.
WARNING: no policy specified for oryx/127.15.70.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.70.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.70.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.2.keytab.
Entry for principal oryx/127.15.70.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.2.keytab.
WARNING: no policy specified for oryx/127.15.70.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.70.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.70.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.3.keytab.
Entry for principal oryx/127.15.70.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.3.keytab.
I20260811 00:55:51.564805 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 29368
I20260811 00:55:51.587401 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 29591
I20260811 00:55:51.603055 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 29826
I20260811 00:55:51.639184 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 29200
I20260811 00:55:51.662180 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:35921
--webserver_interface=127.15.70.62
--webserver_port=45173
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:41881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:35921
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:55:51.764057 30070 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:51.764379 30070 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:51.764407 30070 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:51.765784 30070 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:55:51.765847 30070 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:51.765862 30070 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:51.765875 30070 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:55:51.765887 30070 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:55:51.767800 30070 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:41881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:35921
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:35921
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=45173
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30070
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:51.768169 30070 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:51.768484 30070 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:51.774888 30078 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:51.774952 30080 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:51.775107 30077 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:51.775189 30070 server_base.cc:1034] running on GCE node
I20260811 00:55:51.775516 30070 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:51.775863 30070 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:51.777029 30070 hybrid_clock.cc:648] HybridClock initialized: now 1786409751777013 us; error 35 us; skew 500 ppm
Aug 11 00:55:51 dist-test-slave-h3ft krb5kdc[29175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409751, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:51.780514 30070 init.cc:377] Logged in from keytab as kudu/127.15.70.62@KRBTEST.COM (short username kudu)
I20260811 00:55:51.781144 30070 webserver.cc:460] Webserver started at http://127.15.70.62:45173/ using document root <none> and password file <none>
I20260811 00:55:51.781528 30070 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:51.781631 30070 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:51.783489 30070 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:55:51.784514 30091 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:51.784817 30070 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:51.785035 30070 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "ddf4e5c33afa43b6a7440c060c1513e5"
format_stamp: "Formatted at 2026-08-11 00:55:50 on dist-test-slave-h3ft"
server_key: "47fc93bca199b9a87fb5ae6b882ff8af"
server_key_iv: "01eb2b31c9bf2676c85ad9f4e426e11b"
server_key_version: "encryptionkey@0"
I20260811 00:55:51.785576 30070 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:51.801249 30070 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:51.804391 30070 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:51.804621 30070 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:51.810300 30070 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:35921
I20260811 00:55:51.810400 30164 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:35921 every 8 connection(s)
I20260811 00:55:51.810895 30070 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:55:51.812867 30167 sys_catalog.cc:263] Verifying existing consensus state
I20260811 00:55:51.813865 30167 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ddf4e5c33afa43b6a7440c060c1513e5: Bootstrap starting.
I20260811 00:55:51.820530 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 30070
I20260811 00:55:51.820971 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.1:34379
--local_ip_for_outbound_sockets=127.15.70.1
--tserver_master_addrs=127.15.70.62:35921
--webserver_port=43045
--webserver_interface=127.15.70.1
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:41881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.15.70.1
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.1.keytab with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 00:55:51.826951 30167 log.cc:824] T 00000000000000000000000000000000 P ddf4e5c33afa43b6a7440c060c1513e5: Log is configured to *not* fsync() on all Append() calls
I20260811 00:55:51.830016 30167 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ddf4e5c33afa43b6a7440c060c1513e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 00:55:51.830473 30167 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ddf4e5c33afa43b6a7440c060c1513e5: Bootstrap complete.
I20260811 00:55:51.835529 30167 raft_consensus.cc:348] T 00000000000000000000000000000000 P ddf4e5c33afa43b6a7440c060c1513e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddf4e5c33afa43b6a7440c060c1513e5" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 35921 } }
I20260811 00:55:51.836022 30167 raft_consensus.cc:729] T 00000000000000000000000000000000 P ddf4e5c33afa43b6a7440c060c1513e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf4e5c33afa43b6a7440c060c1513e5, State: Initialized, Role: FOLLOWER
I20260811 00:55:51.836261 30167 consensus_queue.cc:260] T 00000000000000000000000000000000 P ddf4e5c33afa43b6a7440c060c1513e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddf4e5c33afa43b6a7440c060c1513e5" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 35921 } }
I20260811 00:55:51.836362 30167 raft_consensus.cc:388] T 00000000000000000000000000000000 P ddf4e5c33afa43b6a7440c060c1513e5 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:55:51.836439 30167 raft_consensus.cc:482] T 00000000000000000000000000000000 P ddf4e5c33afa43b6a7440c060c1513e5 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:55:51.836510 30167 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ddf4e5c33afa43b6a7440c060c1513e5 [term 1 FOLLOWER]: Advancing to term 2
I20260811 00:55:51.838171 30167 raft_consensus.cc:504] T 00000000000000000000000000000000 P ddf4e5c33afa43b6a7440c060c1513e5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddf4e5c33afa43b6a7440c060c1513e5" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 35921 } }
I20260811 00:55:51.838303 30167 leader_election.cc:302] T 00000000000000000000000000000000 P ddf4e5c33afa43b6a7440c060c1513e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ddf4e5c33afa43b6a7440c060c1513e5; no voters:
I20260811 00:55:51.838529 30167 leader_election.cc:288] T 00000000000000000000000000000000 P ddf4e5c33afa43b6a7440c060c1513e5 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 00:55:51.838627 30174 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ddf4e5c33afa43b6a7440c060c1513e5 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 00:55:51.838817 30174 raft_consensus.cc:686] T 00000000000000000000000000000000 P ddf4e5c33afa43b6a7440c060c1513e5 [term 2 LEADER]: Becoming Leader. State: Replica: ddf4e5c33afa43b6a7440c060c1513e5, State: Running, Role: LEADER
I20260811 00:55:51.838842 30167 sys_catalog.cc:564] T 00000000000000000000000000000000 P ddf4e5c33afa43b6a7440c060c1513e5 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:55:51.838956 30174 consensus_queue.cc:237] T 00000000000000000000000000000000 P ddf4e5c33afa43b6a7440c060c1513e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddf4e5c33afa43b6a7440c060c1513e5" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 35921 } }
I20260811 00:55:51.839303 30175 sys_catalog.cc:455] T 00000000000000000000000000000000 P ddf4e5c33afa43b6a7440c060c1513e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "ddf4e5c33afa43b6a7440c060c1513e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddf4e5c33afa43b6a7440c060c1513e5" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 35921 } } }
I20260811 00:55:51.839393 30175 sys_catalog.cc:458] T 00000000000000000000000000000000 P ddf4e5c33afa43b6a7440c060c1513e5 [sys.catalog]: This master's current role is: LEADER
I20260811 00:55:51.839704 30177 sys_catalog.cc:455] T 00000000000000000000000000000000 P ddf4e5c33afa43b6a7440c060c1513e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ddf4e5c33afa43b6a7440c060c1513e5. Latest consensus state: current_term: 2 leader_uuid: "ddf4e5c33afa43b6a7440c060c1513e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddf4e5c33afa43b6a7440c060c1513e5" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 35921 } } }
I20260811 00:55:51.839854 30177 sys_catalog.cc:458] T 00000000000000000000000000000000 P ddf4e5c33afa43b6a7440c060c1513e5 [sys.catalog]: This master's current role is: LEADER
I20260811 00:55:51.839875 30188 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:55:51.840621 30188 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:55:51.840771 30188 catalog_manager.cc:1259] Loaded cluster ID: 8b54c203fdff4684b8d093e0118eff47
I20260811 00:55:51.840811 30188 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:55:51.842221 30188 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:55:51.842458 30188 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ddf4e5c33afa43b6a7440c060c1513e5: Loaded TSK: 0
I20260811 00:55:51.842721 30188 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 00:55:51.927708 30172 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:51.928047 30172 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:51.928092 30172 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:51.929426 30172 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:51.929512 30172 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:51.929566 30172 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.1
I20260811 00:55:51.931336 30172 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:41881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.1.keytab
--principal=oryx/127.15.70.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.1:34379
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.70.1
--webserver_port=43045
--tserver_master_addrs=127.15.70.62:35921
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30172
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.1
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:51.931666 30172 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:51.931967 30172 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:51.939136 30213 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:51.939145 30215 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:51.939564 30172 server_base.cc:1034] running on GCE node
W20260811 00:55:51.939273 30212 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:51.939926 30172 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:51.940325 30172 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:51.941498 30172 hybrid_clock.cc:648] HybridClock initialized: now 1786409751941504 us; error 88 us; skew 500 ppm
Aug 11 00:55:51 dist-test-slave-h3ft krb5kdc[29175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409751, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.70.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:51.945531 30172 init.cc:377] Logged in from keytab as oryx/127.15.70.1@KRBTEST.COM (short username oryx)
I20260811 00:55:51.946273 30172 webserver.cc:460] Webserver started at http://127.15.70.1:43045/ using document root <none> and password file <none>
I20260811 00:55:51.946614 30172 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:51.946713 30172 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:51.948885 30172 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:55:51.949744 30227 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:51.950039 30172 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:51.950182 30172 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-0/wal
uuid: "4d3770ff03cd4435861b4f7ca9a67852"
format_stamp: "Formatted at 2026-08-11 00:55:51 on dist-test-slave-h3ft"
server_key: "667f327179615b901b2c91cb29879c83"
server_key_iv: "cf2dfd7dd17759bf85424fbb39c1db20"
server_key_version: "encryptionkey@0"
I20260811 00:55:51.950664 30172 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:51.964303 30172 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:51.967193 30172 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:51.967398 30172 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:51.967720 30172 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:55:51.968119 30172 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:55:51.968179 30172 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:51.968232 30172 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:55:51.968264 30172 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:51.976059 30172 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.1:34379
I20260811 00:55:51.976138 30402 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.1:34379 every 8 connection(s)
I20260811 00:55:51.976594 30172 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
I20260811 00:55:51.980304 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 30172
I20260811 00:55:51.980703 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.2:46469
--local_ip_for_outbound_sockets=127.15.70.2
--tserver_master_addrs=127.15.70.62:35921
--webserver_port=42395
--webserver_interface=127.15.70.2
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:41881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.15.70.2
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.2.keytab with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 00:55:51 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.1@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:55:51 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.1@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:55:51.988487 30409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:51.977536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.1:52427)
0811 00:55:51.977810 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:51.977880 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:51.978709 (+ 829us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:51.979617 (+ 908us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:51.979621 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:51.980422 (+ 801us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:51.980714 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:51.980721 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:51.982142 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:51.982143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:51.983323 (+ 1180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:51.983327 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:51.984275 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:51.984276 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:51.984431 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:51.985209 (+ 778us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:51.985221 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:51.988185 (+ 2964us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":114,"threads_started":1}
W20260811 00:55:51.988595 30410 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:55:51.977686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:52427 (local address 127.15.70.62:35921)
0811 00:55:51.979040 (+ 1354us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:51.979052 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:51.979111 (+ 59us) server_negotiation.cc:407] Connection header received
0811 00:55:51.979268 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:51.979277 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:51.979354 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:51.979560 (+ 206us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:51.980926 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:51.982006 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:51.983445 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:51.984155 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:51.984285 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:51.988406 (+ 4121us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.1:52427: BlockingRecv error: recv got EOF from 127.15.70.1:52427 (error 108)
Metrics: {"server-negotiator.queue_time_us":1234,"thread_start_us":95,"threads_started":1}
W20260811 00:55:51.988837 30406 heartbeater.cc:644] Failed to heartbeat to 127.15.70.62:35921 (0 consecutive failures): Not authorized: Failed to ping master at 127.15.70.62:35921: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Aug 11 00:55:51 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.1@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:55:51 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.1@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:55:51.995494 30409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:51.989144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.1:32827)
0811 00:55:51.989263 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:51.989277 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:51.989333 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:51.989530 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:51.989531 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:51.989760 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:51.989857 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:51.989861 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:51.990665 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:51.990666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:51.991400 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:51.991404 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:51.991903 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:51.991904 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:51.991987 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:51.992606 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:51.992611 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:51.995383 (+ 2772us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":93}
W20260811 00:55:51.995579 30410 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:55:51.989273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:32827 (local address 127.15.70.62:35921)
0811 00:55:51.989318 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:51.989321 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:51.989331 (+ 10us) server_negotiation.cc:407] Connection header received
0811 00:55:51.989410 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:51.989411 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:51.989441 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:51.989523 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:51.989958 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:51.990577 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:51.991521 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:51.991790 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:51.991886 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:51.995503 (+ 3617us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.1:32827: BlockingRecv error: recv got EOF from 127.15.70.1:32827 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
Aug 11 00:55:51 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.1@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:55:51 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.1@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:55:52.000986 30409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:51.996120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.1:53099)
0811 00:55:51.996177 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:51.996189 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:51.996236 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:51.996406 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:51.996408 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:51.996559 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:51.996603 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:51.996604 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:51.997388 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:51.997390 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:51.997938 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:51.997939 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:51.998313 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:51.998314 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:51.998388 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:51.998913 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:51.998920 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:52.000874 (+ 1954us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 00:55:52.001053 30410 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:55:51.996172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:53099 (local address 127.15.70.62:35921)
0811 00:55:51.996215 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:51.996217 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:51.996228 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:55:51.996304 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:51.996305 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:51.996318 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:51.996398 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:51.996687 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:51.997295 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:51.998029 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:51.998227 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:51.998303 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:52.000976 (+ 2673us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.1:53099: BlockingRecv error: recv got EOF from 127.15.70.1:53099 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 00:55:52.001505 30406 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 00:55:52.081622 30412 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:52.081930 30412 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:52.081961 30412 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:52.083288 30412 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:52.083339 30412 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:52.083369 30412 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.2
I20260811 00:55:52.085067 30412 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:41881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.2.keytab
--principal=oryx/127.15.70.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.2:46469
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.70.2
--webserver_port=42395
--tserver_master_addrs=127.15.70.62:35921
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30412
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.2
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:52.085357 30412 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:52.085618 30412 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:52.091930 30421 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:52.091974 30426 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:52.092185 30412 server_base.cc:1034] running on GCE node
W20260811 00:55:52.092232 30422 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:52.092564 30412 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:52.092906 30412 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:52.094098 30412 hybrid_clock.cc:648] HybridClock initialized: now 1786409752094112 us; error 65 us; skew 500 ppm
Aug 11 00:55:52 dist-test-slave-h3ft krb5kdc[29175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409752, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.70.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:52.097565 30412 init.cc:377] Logged in from keytab as oryx/127.15.70.2@KRBTEST.COM (short username oryx)
I20260811 00:55:52.098177 30412 webserver.cc:460] Webserver started at http://127.15.70.2:42395/ using document root <none> and password file <none>
I20260811 00:55:52.098462 30412 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:52.098554 30412 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:52.100508 30412 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:52.101511 30438 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:52.101805 30412 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:52.101914 30412 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-1/wal
uuid: "287bf68fa8e647e9b4ee31481b912f9c"
format_stamp: "Formatted at 2026-08-11 00:55:51 on dist-test-slave-h3ft"
server_key: "3ddf09b1fc1681adb7b7b2d82d3f74dd"
server_key_iv: "c1ae5edd027a429a46ff0ae9eb51aa43"
server_key_version: "encryptionkey@0"
I20260811 00:55:52.102550 30412 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:52.119513 30412 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:52.122565 30412 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:52.122794 30412 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:52.123162 30412 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:55:52.123594 30412 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:55:52.123656 30412 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:52.123709 30412 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:55:52.123739 30412 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:52.131219 30412 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.2:46469
I20260811 00:55:52.131316 30620 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.2:46469 every 8 connection(s)
I20260811 00:55:52.131871 30412 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
Aug 11 00:55:52 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.2@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:55:52 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.2@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:55:52.140115 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 30412
I20260811 00:55:52.140511 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.3:43857
--local_ip_for_outbound_sockets=127.15.70.3
--tserver_master_addrs=127.15.70.62:35921
--webserver_port=40427
--webserver_interface=127.15.70.3
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:41881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.15.70.3
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.3.keytab with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 00:55:52.141238 30624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:52.132927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.2:40237)
0811 00:55:52.133107 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:52.133158 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:52.133853 (+ 695us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:52.134159 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:52.134163 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:52.134873 (+ 710us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:52.135203 (+ 330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:52.135209 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:52.136020 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:52.136020 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:52.136888 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:52.136890 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:52.137279 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:52.137280 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:52.137395 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:52.138174 (+ 779us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:52.138184 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:52.141047 (+ 2863us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":93,"threads_started":1}
W20260811 00:55:52.141317 30410 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:55:52.132950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:40237 (local address 127.15.70.62:35921)
0811 00:55:52.133031 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:52.133033 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:52.133272 (+ 239us) server_negotiation.cc:407] Connection header received
0811 00:55:52.133990 (+ 718us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:52.133991 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:52.134011 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:52.134065 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:52.135298 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:52.135910 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:52.136969 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:52.137198 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:52.137265 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:52.141206 (+ 3941us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.2:40237: BlockingRecv error: recv got EOF from 127.15.70.2:40237 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260811 00:55:52.142979 30621 heartbeater.cc:644] Failed to heartbeat to 127.15.70.62:35921 (0 consecutive failures): Not authorized: Failed to ping master at 127.15.70.62:35921: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Aug 11 00:55:52 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.2@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:55:52 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.2@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:55:52.149003 30624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:52.143476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.2:53973)
0811 00:55:52.143543 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:52.143558 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:52.143608 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:52.143783 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:52.143784 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:52.144002 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:52.144087 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:52.144089 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:52.144955 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:52.144956 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:52.145531 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:52.145533 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:52.146123 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:52.146124 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:52.146190 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:52.146822 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:52.146827 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:52.148921 (+ 2094us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":43}
W20260811 00:55:52.149179 30410 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:55:52.143563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:53973 (local address 127.15.70.62:35921)
0811 00:55:52.143634 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:52.143636 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:52.143655 (+ 19us) server_negotiation.cc:407] Connection header received
0811 00:55:52.143686 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:52.143687 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:52.143696 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:52.143754 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:52.144175 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:52.144845 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:52.145634 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:52.145999 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:52.146126 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:52.149091 (+ 2965us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.2:53973: BlockingRecv error: recv got EOF from 127.15.70.2:53973 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 11 00:55:52 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.2@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:55:52 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.2@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:55:52.155215 30624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:52.149373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.2:44949)
0811 00:55:52.149429 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:52.149442 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:52.149485 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:52.149730 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:52.149731 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:52.149905 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:52.149952 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:52.149954 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:52.151130 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:52.151131 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:52.151665 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:52.151667 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:52.152255 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:52.152257 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:52.152312 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:52.152907 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:52.152914 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:52.155144 (+ 2230us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":38}
W20260811 00:55:52.155414 30410 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:55:52.149483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:44949 (local address 127.15.70.62:35921)
0811 00:55:52.149553 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:52.149556 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:52.149566 (+ 10us) server_negotiation.cc:407] Connection header received
0811 00:55:52.149598 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:52.149600 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:52.149613 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:52.149724 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:52.150037 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:52.150956 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:52.151768 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:52.152150 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:52.152241 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:52.155307 (+ 3066us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.2:44949: BlockingRecv error: recv got EOF from 127.15.70.2:44949 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260811 00:55:52.155431 30621 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 00:55:52.243139 30625 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:55:52.243404 30625 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:55:52.243433 30625 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:55:52.244633 30625 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:55:52.244673 30625 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:55:52.244699 30625 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.3
I20260811 00:55:52.246182 30625 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:41881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/krb5kdc/oryx_127.15.70.3.keytab
--principal=oryx/127.15.70.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.3:43857
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.70.3
--webserver_port=40427
--tserver_master_addrs=127.15.70.62:35921
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30625
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.3
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:55:52.246430 30625 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:55:52.246663 30625 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:55:52.252839 30631 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:52.252905 30632 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:55:52.252815 30634 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:55:52.253108 30625 server_base.cc:1034] running on GCE node
I20260811 00:55:52.253412 30625 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:55:52.253700 30625 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:55:52.254868 30625 hybrid_clock.cc:648] HybridClock initialized: now 1786409752254891 us; error 79 us; skew 500 ppm
Aug 11 00:55:52 dist-test-slave-h3ft krb5kdc[29175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409752, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.70.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:55:52.258011 30625 init.cc:377] Logged in from keytab as oryx/127.15.70.3@KRBTEST.COM (short username oryx)
I20260811 00:55:52.258561 30625 webserver.cc:460] Webserver started at http://127.15.70.3:40427/ using document root <none> and password file <none>
I20260811 00:55:52.258852 30625 fs_manager.cc:359] Metadata directory not provided
I20260811 00:55:52.258949 30625 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:55:52.260706 30625 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:52.261439 30645 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:52.261657 30625 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:55:52.261775 30625 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-2/wal
uuid: "2cc79cadac7a45feb3221c289f62a2cf"
format_stamp: "Formatted at 2026-08-11 00:55:51 on dist-test-slave-h3ft"
server_key: "5a50e6851ed7584004c5bee33cfbd9cc"
server_key_iv: "7c2a24a0817f031bb9195075525a618b"
server_key_version: "encryptionkey@0"
I20260811 00:55:52.262245 30625 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:55:52.274430 30625 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:55:52.278340 30625 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:55:52.278560 30625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:55:52.278862 30625 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:55:52.279347 30625 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:55:52.279409 30625 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:52.279460 30625 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:55:52.279487 30625 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:55:52.287184 30625 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.3:43857
I20260811 00:55:52.287235 30820 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.3:43857 every 8 connection(s)
I20260811 00:55:52.287731 30625 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
I20260811 00:55:52.289556 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 30625
Aug 11 00:55:52 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.3@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:55:52 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.3@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
W20260811 00:55:52.297078 30410 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:55:52.288756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:59401 (local address 127.15.70.62:35921)
0811 00:55:52.288840 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:52.288843 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:52.289066 (+ 223us) server_negotiation.cc:407] Connection header received
0811 00:55:52.289699 (+ 633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:52.289700 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:52.289718 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:52.289789 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:52.291225 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:52.291838 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:52.293004 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:52.293214 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:52.293290 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:52.297007 (+ 3717us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.3:59401: BlockingRecv error: recv got EOF from 127.15.70.3:59401 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 00:55:52.297176 30825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:52.288665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.3:59401)
0811 00:55:52.288876 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:52.288951 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:52.289570 (+ 619us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:52.289877 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:52.289882 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:52.290751 (+ 869us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:52.291104 (+ 353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:52.291113 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:52.291962 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:52.291963 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:52.292887 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:52.292889 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:52.293317 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:52.293318 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:52.293479 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:52.294173 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:52.294183 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:52.296913 (+ 2730us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":125,"threads_started":1}
W20260811 00:55:52.297461 30823 heartbeater.cc:644] Failed to heartbeat to 127.15.70.62:35921 (0 consecutive failures): Not authorized: Failed to ping master at 127.15.70.62:35921: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
I20260811 00:55:52.298840 30831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:52.290266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55528 (local address 127.15.70.62:35921)
0811 00:55:52.290427 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:52.290430 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:52.290437 (+ 7us) server_negotiation.cc:407] Connection header received
0811 00:55:52.290464 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:52.290465 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:52.290484 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:52.290603 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:52.291533 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:52.292053 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:52.292933 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:52.293182 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:52.293276 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:52.294801 (+ 1525us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:55:52.294807 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:55:52.294808 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:55:52.294829 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:55:52.296911 (+ 2082us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:52.297509 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:52.297520 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:52.297521 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:52.297682 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:55:52.297970 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:55:52.297971 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:55:52.297971 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:55:52.298271 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:55:52.298394 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 00:55:52.298589 (+ 195us) server_negotiation.cc:299] Negotiation successful
0811 00:55:52.298724 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":87,"threads_started":1}
Aug 11 00:55:52 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.3@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:55:52 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.3@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:55:52.303838 30825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:52.297725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.3:53751)
0811 00:55:52.297972 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:52.297983 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:52.298043 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:52.298176 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:52.298177 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:52.298354 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:52.298427 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:52.298429 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:52.299441 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:52.299442 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:52.300332 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:52.300335 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:52.300847 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:52.300848 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:52.300920 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:52.301520 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:52.301525 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:52.303763 (+ 2238us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":230}
W20260811 00:55:52.304149 30410 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:55:52.297796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:53751 (local address 127.15.70.62:35921)
0811 00:55:52.297869 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:52.297871 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:52.298028 (+ 157us) server_negotiation.cc:407] Connection header received
0811 00:55:52.298103 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:52.298104 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:52.298116 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:52.298172 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:52.298497 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:52.299319 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:52.300484 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:52.300747 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:52.300809 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:52.304086 (+ 3277us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.3:53751: BlockingRecv error: recv got EOF from 127.15.70.3:53751 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 11 00:55:52 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.3@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:55:52 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.3@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:55:52.309604 30825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:52.304197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.3:37493)
0811 00:55:52.304256 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:52.304269 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:52.304347 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:52.304509 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:52.304511 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:52.304664 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:52.304709 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:52.304710 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:52.305438 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:52.305439 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:52.306026 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:52.306028 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:52.306470 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:52.306471 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:52.306546 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:52.307256 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:52.307262 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:52.309470 (+ 2208us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 00:55:52.309659 30410 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:55:52.304285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:37493 (local address 127.15.70.62:35921)
0811 00:55:52.304361 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:52.304364 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:52.304374 (+ 10us) server_negotiation.cc:407] Connection header received
0811 00:55:52.304409 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:52.304410 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:52.304421 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:52.304496 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:52.304806 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:52.305348 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:52.306120 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:52.306395 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:52.306475 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:52.309580 (+ 3105us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.3:37493: BlockingRecv error: recv got EOF from 127.15.70.3:37493 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260811 00:55:52.309855 30823 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 11 00:55:53 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.1@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:55:53 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.1@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:55:53.008445 30832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:53.002186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.1:58839)
0811 00:55:53.002445 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:53.002459 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:53.002541 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:53.002732 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:53.002733 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:53.002958 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:53.003071 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:53.003074 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:53.003901 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:53.003902 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:53.004603 (+ 701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:53.004606 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:53.005109 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:53.005110 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:53.005174 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:53.005812 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:53.005817 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:53.008352 (+ 2535us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":148,"threads_started":1}
W20260811 00:55:53.008603 30835 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:55:53.002337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:58839 (local address 127.15.70.62:35921)
0811 00:55:53.002510 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:53.002512 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:53.002525 (+ 13us) server_negotiation.cc:407] Connection header received
0811 00:55:53.002622 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:53.002623 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:53.002635 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:53.002708 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:53.003151 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:53.003797 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:53.004723 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:53.005023 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:53.005111 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:53.008468 (+ 3357us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.1:58839: BlockingRecv error: recv got EOF from 127.15.70.1:58839 (error 108)
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":77,"threads_started":1}
Aug 11 00:55:53 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.2@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:55:53 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.2@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:55:53.161726 30838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:53.155945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.2:54327)
0811 00:55:53.156126 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:53.156139 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:53.156222 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:53.156438 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:53.156439 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:53.156690 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:53.156766 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:53.156769 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:53.157648 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:53.157650 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:53.158339 (+ 689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:53.158342 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:53.158725 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:53.158726 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:53.158780 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:53.159437 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:53.159442 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:53.161623 (+ 2181us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":97,"threads_started":1}
W20260811 00:55:53.161844 30835 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:55:53.156016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:54327 (local address 127.15.70.62:35921)
0811 00:55:53.156134 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:53.156136 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:53.156200 (+ 64us) server_negotiation.cc:407] Connection header received
0811 00:55:53.156282 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:53.156283 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:53.156297 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:53.156341 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:53.156849 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:53.157536 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:53.158425 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:53.158629 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:53.158687 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:53.161736 (+ 3049us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.2:54327: BlockingRecv error: recv got EOF from 127.15.70.2:54327 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 11 00:55:53 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.3@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:55:53 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.3@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:55:53.317071 30839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:53.310427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.3:55861)
0811 00:55:53.310686 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:53.310703 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:53.310839 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:53.311224 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:53.311226 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:53.311619 (+ 393us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:53.311708 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:53.311712 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:53.312695 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:53.312697 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:53.313345 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:53.313349 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:53.313759 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:53.313760 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:53.313809 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:53.314469 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:53.314482 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:53.316967 (+ 2485us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":131,"threads_started":1}
W20260811 00:55:53.317256 30835 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:55:53.310553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:55861 (local address 127.15.70.62:35921)
0811 00:55:53.310685 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:53.310688 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:53.310807 (+ 119us) server_negotiation.cc:407] Connection header received
0811 00:55:53.310944 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:53.310946 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:53.310965 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:53.311082 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:53.311828 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:53.312612 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:53.313447 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:53.313680 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:53.313747 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:53.317149 (+ 3402us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.3:55861: BlockingRecv error: recv got EOF from 127.15.70.3:55861 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 11 00:55:54 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.1@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:55:54 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.1@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:55:54.015141 30841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:54.009075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.1:35163)
0811 00:55:54.009348 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:54.009363 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:54.009464 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:54.009669 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:54.009669 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:54.009901 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:54.009976 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:54.009978 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:54.010820 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:54.010821 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:54.011539 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:54.011542 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:54.011980 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:54.011980 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:54.012043 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:54.012700 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:54.012705 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:54.014989 (+ 2284us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":163,"threads_started":1}
W20260811 00:55:54.015208 30843 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:55:54.009197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:35163 (local address 127.15.70.62:35921)
0811 00:55:54.009361 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:54.009363 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:54.009472 (+ 109us) server_negotiation.cc:407] Connection header received
0811 00:55:54.009523 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:54.009524 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:54.009540 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:54.009645 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:54.010071 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:54.010717 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:54.011653 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:54.011902 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:54.011970 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:54.015140 (+ 3170us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.1:35163: BlockingRecv error: recv got EOF from 127.15.70.1:35163 (error 108)
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":79,"threads_started":1}
Aug 11 00:55:54 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.2@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:55:54 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.2@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:55:54.168335 30844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:54.162365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.2:52769)
0811 00:55:54.162562 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:54.162577 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:54.162663 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:54.162824 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:54.162825 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:54.163156 (+ 331us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:54.163232 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:54.163235 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:54.163957 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:54.163958 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:54.164590 (+ 632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:54.164591 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:54.165093 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:54.165094 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:54.165181 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:54.165882 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:54.165890 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:54.168234 (+ 2344us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":118,"threads_started":1}
W20260811 00:55:54.168476 30843 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:55:54.162443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:52769 (local address 127.15.70.62:35921)
0811 00:55:54.162549 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:54.162552 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:54.162660 (+ 108us) server_negotiation.cc:407] Connection header received
0811 00:55:54.162722 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:54.162722 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:54.162736 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:54.162793 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:54.163306 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:54.163871 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:54.164674 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:54.165008 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:54.165087 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:54.168366 (+ 3279us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.2:52769: BlockingRecv error: recv got EOF from 127.15.70.2:52769 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 11 00:55:54 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.3@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:55:54 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.3@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:55:54.324873 30846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:54.317845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.3:44535)
0811 00:55:54.318112 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:54.318132 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:54.318226 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:54.318478 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:54.318480 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:54.318734 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:54.318806 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:54.318808 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:54.319713 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:54.319714 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:54.320369 (+ 655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:54.320373 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:54.320804 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:54.320806 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:54.320917 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:54.321775 (+ 858us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:54.321783 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:54.324776 (+ 2993us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":117,"threads_started":1}
W20260811 00:55:54.325234 30843 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:55:54.318163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:44535 (local address 127.15.70.62:35921)
0811 00:55:54.318279 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:54.318281 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:54.318292 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:55:54.318330 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:54.318331 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:54.318351 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:54.318426 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:54.318918 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:54.319595 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:54.320481 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:54.320704 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:54.320768 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:54.325153 (+ 4385us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.3:44535: BlockingRecv error: recv got EOF from 127.15.70.3:44535 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 11 00:55:55 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.1@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:55:55 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.1@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:55:55.022337 30847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:55.016044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.1:46251)
0811 00:55:55.016314 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:55.016327 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:55.016432 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:55.016697 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:55.016698 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:55.016966 (+ 268us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:55.017040 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:55.017050 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:55.017858 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:55.017859 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:55.018560 (+ 701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:55.018564 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:55.019133 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:55.019134 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:55.019200 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:55.019889 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:55.019895 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:55.022244 (+ 2349us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":127,"threads_started":1}
W20260811 00:55:55.022578 30850 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:55:55.016069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:46251 (local address 127.15.70.62:35921)
0811 00:55:55.016292 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:55.016295 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:55.016426 (+ 131us) server_negotiation.cc:407] Connection header received
0811 00:55:55.016555 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:55.016555 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:55.016571 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:55.016660 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:55.017147 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:55.017732 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:55.018680 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:55.018948 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:55.019119 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:55.022451 (+ 3332us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.1:46251: BlockingRecv error: recv got EOF from 127.15.70.1:46251 (error 108)
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":97,"threads_started":1}
Aug 11 00:55:55 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.2@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:55:55 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.2@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:55:55.175138 30852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:55.168975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.2:55621)
0811 00:55:55.169225 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:55.169239 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:55.169352 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:55.169542 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:55.169544 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:55.169787 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:55.169854 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:55.169856 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:55.170654 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:55.170655 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:55.171338 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:55.171341 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:55.171776 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:55.171777 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:55.171840 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:55.172454 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:55.172460 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:55.174948 (+ 2488us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":134,"threads_started":1}
W20260811 00:55:55.175177 30850 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:55:55.169110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:55621 (local address 127.15.70.62:35921)
0811 00:55:55.169208 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:55.169212 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:55.169327 (+ 115us) server_negotiation.cc:407] Connection header received
0811 00:55:55.169431 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:55.169432 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:55.169452 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:55.169529 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:55.169997 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:55.170555 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:55.171433 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:55.171661 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:55.171778 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:55.175099 (+ 3321us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.2:55621: BlockingRecv error: recv got EOF from 127.15.70.2:55621 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 11 00:55:55 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.3@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:55:55 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.3@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:55:55.331851 30854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:55.325578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.3:56695)
0811 00:55:55.325791 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:55.325805 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:55.325903 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:55.326148 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:55.326150 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:55.326380 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:55.326482 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:55.326485 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:55.327515 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:55.327516 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:55.328157 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:55.328159 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:55.328624 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:55.328625 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:55.328694 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:55.329331 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:55.329337 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:55.331709 (+ 2372us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":138,"threads_started":1}
W20260811 00:55:55.332230 30850 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:55:55.325705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:56695 (local address 127.15.70.62:35921)
0811 00:55:55.325784 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:55.325787 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:55.325956 (+ 169us) server_negotiation.cc:407] Connection header received
0811 00:55:55.325998 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:55.325999 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:55.326022 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:55.326093 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:55.326595 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:55.327415 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:55.328270 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:55.328509 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:55.328576 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:55.331885 (+ 3309us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.3:56695: BlockingRecv error: recv got EOF from 127.15.70.3:56695 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 11 00:55:56 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.1@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:55:56 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.1@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:55:56.035702 30855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:56.023192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.1:33911)
0811 00:55:56.023480 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:56.023496 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:56.023583 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:56.023821 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:56.023822 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:56.024062 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:56.024157 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:56.024160 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:56.025183 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:56.025185 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:56.025890 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:56.025893 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:56.026414 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:56.026415 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:56.026483 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:56.032807 (+ 6324us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:56.032815 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:56.035611 (+ 2796us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":144,"threads_started":1}
W20260811 00:55:56.035969 30856 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:55:56.023411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:33911 (local address 127.15.70.62:35921)
0811 00:55:56.023633 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:56.023636 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:56.023646 (+ 10us) server_negotiation.cc:407] Connection header received
0811 00:55:56.023683 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:56.023684 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:56.023698 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:56.023769 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:56.024262 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:56.025062 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:56.026029 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:56.026269 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:56.026339 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:56.035873 (+ 9534us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.1:33911: BlockingRecv error: recv got EOF from 127.15.70.1:33911 (error 108)
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":120,"threads_started":1}
Aug 11 00:55:56 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.2@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:55:56 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.2@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:55:56.181665 30859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:56.175791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.2:57359)
0811 00:55:56.176050 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:56.176067 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:56.176187 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:56.176337 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:56.176338 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:56.176579 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:56.176646 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:56.176648 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:56.177400 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:56.177402 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:56.178029 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:56.178033 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:56.178482 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:56.178484 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:56.178554 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:56.179304 (+ 750us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:56.179310 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:56.181555 (+ 2245us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":188,"threads_started":1}
W20260811 00:55:56.181777 30856 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:55:56.175936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:57359 (local address 127.15.70.62:35921)
0811 00:55:56.176057 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:56.176059 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:56.176160 (+ 101us) server_negotiation.cc:407] Connection header received
0811 00:55:56.176254 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:56.176256 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:56.176274 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:56.176332 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:56.176739 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:56.177307 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:56.178159 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:56.178380 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:56.178482 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:56.181697 (+ 3215us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.2:57359: BlockingRecv error: recv got EOF from 127.15.70.2:57359 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 11 00:55:56 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.3@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:55:56 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.3@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:55:56.338622 30860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:56.332582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.3:39131)
0811 00:55:56.332826 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:56.332839 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:56.332911 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:56.333061 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:56.333062 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:56.333300 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:56.333369 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:56.333371 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:56.334196 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:56.334197 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:56.334782 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:56.334784 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:56.335293 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:56.335295 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:56.335370 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:56.336104 (+ 734us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:56.336112 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:56.338465 (+ 2353us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":149,"threads_started":1}
W20260811 00:55:56.338822 30856 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:55:56.332716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:39131 (local address 127.15.70.62:35921)
0811 00:55:56.332802 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:56.332804 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:56.332906 (+ 102us) server_negotiation.cc:407] Connection header received
0811 00:55:56.332979 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:56.332979 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:56.332996 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:56.333055 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:56.333468 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:56.334092 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:56.334895 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:56.335153 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:56.335246 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:56.338719 (+ 3473us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.3:39131: BlockingRecv error: recv got EOF from 127.15.70.3:39131 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 11 00:55:57 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.1@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:55:57 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.1@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:55:57.042599 30861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:57.036594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.1:34839)
0811 00:55:57.036812 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:57.036826 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:57.036893 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:57.037076 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:57.037077 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:57.037311 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:57.037382 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:57.037385 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:57.038166 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:57.038167 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:57.038919 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:57.038921 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:57.039423 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:57.039425 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:57.039519 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:57.040184 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:57.040194 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:57.042520 (+ 2326us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":132,"threads_started":1}
W20260811 00:55:57.042804 30862 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:55:57.036720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:34839 (local address 127.15.70.62:35921)
0811 00:55:57.036899 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:57.036902 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:57.036936 (+ 34us) server_negotiation.cc:407] Connection header received
0811 00:55:57.036968 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:57.036968 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:57.036982 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:57.037046 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:57.037465 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:57.038040 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:57.039027 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:57.039296 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:57.039362 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:57.042697 (+ 3335us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.1:34839: BlockingRecv error: recv got EOF from 127.15.70.1:34839 (error 108)
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":112,"threads_started":1}
Aug 11 00:55:57 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.2@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:55:57 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.2@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:55:57.188232 30863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:57.182339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.2:39043)
0811 00:55:57.182583 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:57.182600 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:57.182699 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:57.182896 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:57.182897 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:57.183229 (+ 332us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:57.183299 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:57.183301 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:57.184149 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:57.184150 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:57.184734 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:57.184736 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:57.185145 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:57.185146 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:57.185224 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:57.185872 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:57.185877 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:57.188106 (+ 2229us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":139,"threads_started":1}
W20260811 00:55:57.188301 30862 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:55:57.182533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:39043 (local address 127.15.70.62:35921)
0811 00:55:57.182637 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:57.182640 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:57.182669 (+ 29us) server_negotiation.cc:407] Connection header received
0811 00:55:57.182791 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:57.182793 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:57.182814 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:57.182886 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:57.183391 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:57.184045 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:57.184830 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:57.185049 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:57.185130 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:57.188227 (+ 3097us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.2:39043: BlockingRecv error: recv got EOF from 127.15.70.2:39043 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 11 00:55:57 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.3@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:55:57 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.3@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:55:57.345100 30864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:57.339432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.3:55645)
0811 00:55:57.339636 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:57.339651 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:57.339766 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:57.339972 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:57.339973 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:57.340225 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:57.340296 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:57.340299 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:57.341095 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:57.341097 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:57.341699 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:57.341701 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:57.342124 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:57.342126 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:57.342206 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:57.342782 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:57.342788 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:57.344977 (+ 2189us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":100,"threads_started":1}
W20260811 00:55:57.345197 30862 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:55:57.339508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:55645 (local address 127.15.70.62:35921)
0811 00:55:57.339583 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:57.339588 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:57.339723 (+ 135us) server_negotiation.cc:407] Connection header received
0811 00:55:57.339851 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:57.339852 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:57.339871 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:57.339948 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:57.340412 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:57.340981 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:57.341801 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:57.342019 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:57.342120 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:57.345119 (+ 2999us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.3:55645: BlockingRecv error: recv got EOF from 127.15.70.3:55645 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 11 00:55:58 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.1@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:55:58 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.1@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:55:58.049749 30865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:58.043309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.1:38949)
0811 00:55:58.043525 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:58.043540 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:58.043612 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:58.043807 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:58.043808 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:58.044089 (+ 281us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:58.044163 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:58.044166 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:58.045006 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:58.045008 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:58.045623 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:58.045626 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:58.046060 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:58.046062 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:58.046130 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:58.046831 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:58.046838 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:58.049633 (+ 2795us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":127,"threads_started":1}
W20260811 00:55:58.049902 30866 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:55:58.043454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:38949 (local address 127.15.70.62:35921)
0811 00:55:58.043642 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:58.043644 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:58.043654 (+ 10us) server_negotiation.cc:407] Connection header received
0811 00:55:58.043687 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:58.043688 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:58.043702 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:58.043782 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:58.044254 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:58.044862 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:58.045726 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:58.045951 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:58.046015 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:58.049770 (+ 3755us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.1:38949: BlockingRecv error: recv got EOF from 127.15.70.1:38949 (error 108)
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":100,"threads_started":1}
Aug 11 00:55:58 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.2@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:55:58 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.2@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:55:58.194839 30867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:58.188966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.2:35131)
0811 00:55:58.189176 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:58.189189 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:58.189268 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:58.189447 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:58.189448 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:58.189677 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:58.189748 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:58.189749 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:58.190715 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:58.190718 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:58.191398 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:58.191403 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:58.191881 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:58.191882 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:58.191934 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:58.192553 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:58.192559 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:58.194716 (+ 2157us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":136,"threads_started":1}
W20260811 00:55:58.194917 30866 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:55:58.189128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:35131 (local address 127.15.70.62:35921)
0811 00:55:58.189206 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:58.189208 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:58.189247 (+ 39us) server_negotiation.cc:407] Connection header received
0811 00:55:58.189361 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:58.189361 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:58.189377 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:58.189439 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:58.189933 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:58.190613 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:58.191510 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:58.191734 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:58.191876 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:58.194836 (+ 2960us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.2:35131: BlockingRecv error: recv got EOF from 127.15.70.2:35131 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 11 00:55:58 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.3@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:55:58 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.3@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:55:58.351994 30868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:58.345834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.3:34975)
0811 00:55:58.346076 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:58.346090 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:58.346205 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:58.346406 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:58.346407 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:58.346639 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:58.346705 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:58.346707 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:58.347595 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:58.347597 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:58.348173 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:58.348175 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:58.348576 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:58.348577 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:58.348638 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:58.349285 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:58.349291 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:58.351810 (+ 2519us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":167,"threads_started":1}
W20260811 00:55:58.351991 30866 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:55:58.345931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:34975 (local address 127.15.70.62:35921)
0811 00:55:58.346035 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:58.346038 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:58.346179 (+ 141us) server_negotiation.cc:407] Connection header received
0811 00:55:58.346275 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:58.346277 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:58.346296 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:58.346357 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:58.346798 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:58.347492 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:58.348266 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:58.348480 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:58.348574 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:58.351912 (+ 3338us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.3:34975: BlockingRecv error: recv got EOF from 127.15.70.3:34975 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 11 00:55:59 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.1@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:55:59 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.1@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:55:59.056583 30869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:59.050526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.1:56121)
0811 00:55:59.050752 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:59.050767 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:59.050850 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:59.051047 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:59.051048 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:59.051275 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:59.051347 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:59.051350 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:59.052122 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:59.052124 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:59.052714 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:59.052716 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:59.053235 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:59.053236 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:59.053309 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:59.054042 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:59.054049 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:59.056469 (+ 2420us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":133,"threads_started":1}
W20260811 00:55:59.056772 30870 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:55:59.050675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:56121 (local address 127.15.70.62:35921)
0811 00:55:59.050856 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:59.050858 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:59.050873 (+ 15us) server_negotiation.cc:407] Connection header received
0811 00:55:59.050909 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:59.050909 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:59.050923 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:59.051052 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:59.051444 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:59.052023 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:59.052814 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:59.053130 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:59.053196 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:59.056677 (+ 3481us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.1:56121: BlockingRecv error: recv got EOF from 127.15.70.1:56121 (error 108)
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":103,"threads_started":1}
Aug 11 00:55:59 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.2@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:55:59 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.2@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:55:59.201790 30871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:59.195438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.2:36527)
0811 00:55:59.195739 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:59.195754 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:59.195880 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:59.196125 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:59.196126 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:59.196411 (+ 285us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:59.196483 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:59.196486 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:59.197407 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:59.197408 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:59.198054 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:59.198057 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:59.198523 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:59.198525 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:59.198597 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:59.199249 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:59.199256 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:59.201709 (+ 2453us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":184,"threads_started":1}
W20260811 00:55:59.202052 30870 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:55:59.195581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:36527 (local address 127.15.70.62:35921)
0811 00:55:59.195713 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:59.195716 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:59.195853 (+ 137us) server_negotiation.cc:407] Connection header received
0811 00:55:59.195992 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:59.195994 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:59.196020 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:59.196101 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:59.196596 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:59.197275 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:59.198160 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:59.198415 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:59.198521 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:59.201991 (+ 3470us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.2:36527: BlockingRecv error: recv got EOF from 127.15.70.2:36527 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 11 00:55:59 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.3@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:55:59 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.3@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:55:59.358654 30872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:55:59.352636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.3:44457)
0811 00:55:59.352915 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0811 00:55:59.352932 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 00:55:59.353027 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:55:59.353216 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:55:59.353237 (+ 21us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:55:59.353565 (+ 328us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:55:59.353639 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:59.353643 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:59.354444 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:59.354450 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:59.355187 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:55:59.355191 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:55:59.355549 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:55:59.355550 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:55:59.355600 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:59.356194 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:55:59.356199 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:55:59.358575 (+ 2376us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":206,"threads_started":1}
W20260811 00:55:59.358790 30870 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:55:59.352744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:44457 (local address 127.15.70.62:35921)
0811 00:55:59.352836 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0811 00:55:59.352840 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:55:59.353080 (+ 240us) server_negotiation.cc:407] Connection header received
0811 00:55:59.353118 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:55:59.353119 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:55:59.353138 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:55:59.353194 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:55:59.353725 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:59.354311 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:59.355276 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:55:59.355479 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:55:59.355532 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:55:59.358698 (+ 3166us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.3:44457: BlockingRecv error: recv got EOF from 127.15.70.3:44457 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 11 00:56:00 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.1@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:56:00 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.1@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:56:00.063472 30874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:00.057391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.1:35299)
0811 00:56:00.057661 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0811 00:56:00.057682 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 00:56:00.057782 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:56:00.058015 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:56:00.058017 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:56:00.058250 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:56:00.058322 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:00.058324 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:00.059138 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:00.059139 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:00.059726 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:00.059728 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:00.060410 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:00.060412 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:00.060480 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:00.061131 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:56:00.061137 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:56:00.063388 (+ 2251us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":110,"threads_started":1}
W20260811 00:56:00.063707 30875 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:56:00.057642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:35299 (local address 127.15.70.62:35921)
0811 00:56:00.057825 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 00:56:00.057828 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:56:00.057837 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:56:00.057870 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:56:00.057870 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:56:00.057884 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:56:00.057995 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:56:00.058407 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:00.059046 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:00.059954 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:00.060290 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:00.060371 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:00.063617 (+ 3246us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.1:35299: BlockingRecv error: recv got EOF from 127.15.70.1:35299 (error 108)
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":99,"threads_started":1}
Aug 11 00:56:00 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.2@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:56:00 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.2@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:56:00.208689 30876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:00.202383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.2:51165)
0811 00:56:00.202600 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0811 00:56:00.202611 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:56:00.202683 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:56:00.202934 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:56:00.202935 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:56:00.203209 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:56:00.203283 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:00.203286 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:00.204248 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:00.204249 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:00.204848 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:00.204850 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:00.205254 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:00.205255 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:00.205302 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:00.205945 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:56:00.205951 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:56:00.208601 (+ 2650us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":125,"threads_started":1}
W20260811 00:56:00.208837 30875 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:56:00.202485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:51165 (local address 127.15.70.62:35921)
0811 00:56:00.202564 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 00:56:00.202566 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:56:00.202666 (+ 100us) server_negotiation.cc:407] Connection header received
0811 00:56:00.202755 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:56:00.202756 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:56:00.202770 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:56:00.202818 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:56:00.203382 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:00.204143 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:00.204943 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:00.205179 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:00.205240 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:00.208746 (+ 3506us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.2:51165: BlockingRecv error: recv got EOF from 127.15.70.2:51165 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 11 00:56:00 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.3@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:56:00 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.3@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:56:00.365134 30877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:00.359227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.3:38315)
0811 00:56:00.359422 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 00:56:00.359434 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 00:56:00.359521 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:56:00.359718 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:56:00.359719 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:56:00.359954 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:56:00.360024 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:00.360026 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:00.360851 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:00.360852 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:00.361552 (+ 700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:00.361559 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:00.361985 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:00.361986 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:00.362034 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:00.362644 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:56:00.362650 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:56:00.365017 (+ 2367us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":101,"threads_started":1}
W20260811 00:56:00.365206 30875 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:56:00.359285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:38315 (local address 127.15.70.62:35921)
0811 00:56:00.359365 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 00:56:00.359367 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:56:00.359584 (+ 217us) server_negotiation.cc:407] Connection header received
0811 00:56:00.359623 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:56:00.359624 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:56:00.359642 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:56:00.359695 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:56:00.360162 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:00.360761 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:00.361650 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:00.361858 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:00.361968 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:00.365131 (+ 3163us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.3:38315: BlockingRecv error: recv got EOF from 127.15.70.3:38315 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 11 00:56:01 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.1@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:56:01 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.1@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:56:01.075244 30882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:01.064186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.1:40691)
0811 00:56:01.064384 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 00:56:01.064398 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 00:56:01.064479 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:56:01.064758 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:56:01.064759 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:56:01.065023 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:56:01.065097 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:01.065101 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:01.065983 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:01.065985 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:01.066680 (+ 695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:01.066683 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:01.067195 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:01.067196 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:01.067280 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:01.072513 (+ 5233us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:56:01.072522 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:56:01.075159 (+ 2637us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":113,"threads_started":1}
W20260811 00:56:01.075505 30885 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:56:01.064284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:40691 (local address 127.15.70.62:35921)
0811 00:56:01.064592 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0811 00:56:01.064594 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:56:01.064605 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:56:01.064643 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:56:01.064644 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:56:01.064658 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:56:01.064739 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:56:01.065263 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:01.065858 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:01.066797 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:01.067076 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:01.067193 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:01.075418 (+ 8225us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.1:40691: BlockingRecv error: recv got EOF from 127.15.70.1:40691 (error 108)
Metrics: {"server-negotiator.queue_time_us":261,"thread_start_us":206,"threads_started":1}
Aug 11 00:56:01 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.2@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:56:01 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.2@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:56:01.216113 30890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:01.209409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.2:47005)
0811 00:56:01.209701 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0811 00:56:01.209718 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 00:56:01.209859 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:56:01.210079 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:56:01.210080 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:56:01.210370 (+ 290us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:56:01.210444 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:01.210448 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:01.211362 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:01.211363 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:01.211957 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:01.211960 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:01.212399 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:01.212400 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:01.212486 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:01.213146 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:56:01.213152 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:56:01.216013 (+ 2861us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":154,"threads_started":1}
W20260811 00:56:01.216288 30885 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:56:01.209556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:47005 (local address 127.15.70.62:35921)
0811 00:56:01.209683 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 00:56:01.209687 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:56:01.209823 (+ 136us) server_negotiation.cc:407] Connection header received
0811 00:56:01.209954 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:56:01.209956 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:56:01.209982 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:56:01.210069 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:56:01.210552 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:01.211242 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:01.212074 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:01.212293 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:01.212383 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:01.216169 (+ 3786us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.2:47005: BlockingRecv error: recv got EOF from 127.15.70.2:47005 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 11 00:56:01 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.3@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:56:01 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.3@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:56:01.372185 30891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:01.365915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.3:56503)
0811 00:56:01.366171 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0811 00:56:01.366188 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 00:56:01.366296 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:56:01.366496 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:56:01.366498 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:56:01.366750 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:56:01.366818 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:01.366820 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:01.367762 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:01.367763 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:01.368373 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:01.368376 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:01.368787 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:01.368788 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:01.368851 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:01.369476 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:56:01.369482 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:56:01.372037 (+ 2555us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":152,"threads_started":1}
W20260811 00:56:01.372311 30885 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:56:01.366031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:56503 (local address 127.15.70.62:35921)
0811 00:56:01.366151 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 00:56:01.366154 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:56:01.366270 (+ 116us) server_negotiation.cc:407] Connection header received
0811 00:56:01.366390 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:56:01.366391 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:56:01.366416 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:56:01.366483 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:56:01.366912 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:01.367662 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:01.368483 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:01.368706 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:01.368789 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:01.372200 (+ 3411us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.3:56503: BlockingRecv error: recv got EOF from 127.15.70.3:56503 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 11 00:56:02 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.1@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:56:02 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.1@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:56:02.082932 30892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:02.075876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.1:56793)
0811 00:56:02.076120 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0811 00:56:02.076137 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 00:56:02.076221 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:56:02.076449 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:56:02.076451 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:56:02.076694 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:56:02.076768 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:02.076770 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:02.077630 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:02.077632 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:02.078273 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:02.078275 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:02.078899 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:02.078901 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:02.078966 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:02.079787 (+ 821us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:56:02.079794 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:56:02.082828 (+ 3034us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":157,"threads_started":1}
W20260811 00:56:02.083233 30894 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:56:02.076030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:56793 (local address 127.15.70.62:35921)
0811 00:56:02.076188 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 00:56:02.076190 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:56:02.076202 (+ 12us) server_negotiation.cc:407] Connection header received
0811 00:56:02.076296 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:56:02.076296 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:56:02.076310 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:56:02.076379 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:56:02.076878 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:02.077479 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:02.078384 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:02.078645 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:02.078930 (+ 285us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:02.083140 (+ 4210us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.1:56793: BlockingRecv error: recv got EOF from 127.15.70.1:56793 (error 108)
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":95,"threads_started":1}
Aug 11 00:56:02 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.2@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:56:02 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.2@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:56:02.223663 30896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:02.217074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.2:46497)
0811 00:56:02.217302 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0811 00:56:02.217317 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 00:56:02.217405 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:56:02.217638 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:56:02.217639 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:56:02.217877 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:56:02.217999 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:02.218001 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:02.218857 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:02.218858 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:02.219685 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:02.219688 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:02.220210 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:02.220211 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:02.220286 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:02.221025 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:56:02.221031 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:56:02.223568 (+ 2537us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":121,"threads_started":1}
W20260811 00:56:02.223932 30894 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:56:02.217227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:46497 (local address 127.15.70.62:35921)
0811 00:56:02.217359 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 00:56:02.217362 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:56:02.217385 (+ 23us) server_negotiation.cc:407] Connection header received
0811 00:56:02.217486 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:56:02.217487 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:56:02.217504 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:56:02.217577 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:56:02.218118 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:02.218757 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:02.219792 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:02.220082 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:02.220186 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:02.223783 (+ 3597us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.2:46497: BlockingRecv error: recv got EOF from 127.15.70.2:46497 (error 108)
Metrics: {"server-negotiator.queue_time_us":94}
Aug 11 00:56:02 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.3@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:56:02 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.3@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:56:02.379168 30900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:02.373016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.3:36581)
0811 00:56:02.373236 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0811 00:56:02.373254 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 00:56:02.373349 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:56:02.373638 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:56:02.373640 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:56:02.373883 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:56:02.373956 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:02.373958 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:02.374731 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:02.374733 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:02.375433 (+ 700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:02.375437 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:02.375817 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:02.375818 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:02.375867 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:02.376511 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:56:02.376517 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:56:02.379070 (+ 2553us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":112,"threads_started":1}
W20260811 00:56:02.379289 30894 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:56:02.373208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:36581 (local address 127.15.70.62:35921)
0811 00:56:02.373313 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0811 00:56:02.373315 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:56:02.373332 (+ 17us) server_negotiation.cc:407] Connection header received
0811 00:56:02.373480 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:56:02.373482 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:56:02.373500 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:56:02.373587 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:56:02.374081 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:02.374645 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:02.375516 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:02.375734 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:02.375795 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:02.379182 (+ 3387us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.3:36581: BlockingRecv error: recv got EOF from 127.15.70.3:36581 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 11 00:56:03 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.1@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:56:03 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.1@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:56:03.090456 30901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:03.083724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.1:37361)
0811 00:56:03.083917 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 00:56:03.083939 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 00:56:03.084045 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:56:03.084241 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:56:03.084242 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:56:03.084491 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:56:03.084560 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:03.084563 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:03.085375 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:03.085377 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:03.086135 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:03.086141 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:03.086750 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:03.086752 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:03.086840 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:03.087552 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:56:03.087559 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:56:03.090312 (+ 2753us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":121,"threads_started":1}
W20260811 00:56:03.090540 30903 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:56:03.083838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:37361 (local address 127.15.70.62:35921)
0811 00:56:03.084034 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 00:56:03.084037 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:56:03.084052 (+ 15us) server_negotiation.cc:407] Connection header received
0811 00:56:03.084118 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:56:03.084119 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:56:03.084134 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:56:03.084218 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:56:03.084651 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:03.085230 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:03.086304 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:03.086648 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:03.086744 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:03.090450 (+ 3706us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.1:37361: BlockingRecv error: recv got EOF from 127.15.70.1:37361 (error 108)
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":117,"threads_started":1}
Aug 11 00:56:03 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.2@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:56:03 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.2@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:56:03.230592 30904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:03.224345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.2:46145)
0811 00:56:03.224610 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0811 00:56:03.224625 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 00:56:03.224743 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:56:03.224957 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:56:03.224959 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:56:03.225235 (+ 276us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:56:03.225301 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:03.225304 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:03.226164 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:03.226166 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:03.226804 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:03.226807 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:03.227353 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:03.227354 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:03.227424 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:03.228082 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:56:03.228088 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:56:03.230465 (+ 2377us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":144,"threads_started":1}
W20260811 00:56:03.230697 30903 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:56:03.224482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:46145 (local address 127.15.70.62:35921)
0811 00:56:03.224602 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 00:56:03.224605 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:56:03.224718 (+ 113us) server_negotiation.cc:407] Connection header received
0811 00:56:03.224840 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:56:03.224841 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:56:03.224860 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:56:03.224946 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:56:03.225434 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:03.226065 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:03.226918 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:03.227247 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:03.227357 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:03.230620 (+ 3263us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.2:46145: BlockingRecv error: recv got EOF from 127.15.70.2:46145 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 11 00:56:03 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.3@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:56:03 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.3@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:56:03.385381 30907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:03.379759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.3:34391)
0811 00:56:03.379974 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0811 00:56:03.379988 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 00:56:03.380104 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:56:03.380281 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:56:03.380282 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:56:03.380544 (+ 262us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:56:03.380607 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:03.380610 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:03.381383 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:03.381384 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:03.381991 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:03.381994 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:03.382382 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:03.382383 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:03.382450 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:03.383088 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:56:03.383101 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:56:03.385282 (+ 2181us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":117,"threads_started":1}
W20260811 00:56:03.385577 30903 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:56:03.379851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:34391 (local address 127.15.70.62:35921)
0811 00:56:03.379922 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 00:56:03.379925 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:56:03.380076 (+ 151us) server_negotiation.cc:407] Connection header received
0811 00:56:03.380174 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:56:03.380175 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:56:03.380201 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:56:03.380270 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:56:03.380701 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:03.381278 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:03.382091 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:03.382298 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:03.382382 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:03.385469 (+ 3087us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.3:34391: BlockingRecv error: recv got EOF from 127.15.70.3:34391 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 11 00:56:04 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.1@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:56:04 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.1@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:56:04.097316 30908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:04.091186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.1:48147)
0811 00:56:04.091389 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 00:56:04.091403 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 00:56:04.091492 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:56:04.091687 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:56:04.091688 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:56:04.091923 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:56:04.091989 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:04.091990 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:04.092774 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:04.092775 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:04.093519 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:04.093523 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:04.094019 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:04.094021 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:04.094093 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:04.094743 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:56:04.094749 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:56:04.097233 (+ 2484us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":116,"threads_started":1}
W20260811 00:56:04.097536 30912 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:56:04.091289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:48147 (local address 127.15.70.62:35921)
0811 00:56:04.091432 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 00:56:04.091434 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:56:04.091484 (+ 50us) server_negotiation.cc:407] Connection header received
0811 00:56:04.091583 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:56:04.091584 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:56:04.091598 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:56:04.091666 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:56:04.092065 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:04.092654 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:04.093657 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:04.093902 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:04.093993 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:04.097445 (+ 3452us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.1:48147: BlockingRecv error: recv got EOF from 127.15.70.1:48147 (error 108)
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":69,"threads_started":1}
Aug 11 00:56:04 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.2@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:56:04 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.2@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:56:04.237705 30913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:04.231380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.2:49387)
0811 00:56:04.231663 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0811 00:56:04.231677 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 00:56:04.231775 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:56:04.231965 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:56:04.231966 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:56:04.232227 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:56:04.232293 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:04.232295 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:04.233103 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:04.233104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:04.233693 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:04.233695 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:04.234107 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:04.234108 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:04.234178 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:04.234808 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:56:04.234813 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:56:04.237583 (+ 2770us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":188,"threads_started":1}
W20260811 00:56:04.237807 30912 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:56:04.231563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:49387 (local address 127.15.70.62:35921)
0811 00:56:04.231665 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0811 00:56:04.231667 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:56:04.231763 (+ 96us) server_negotiation.cc:407] Connection header received
0811 00:56:04.231857 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:56:04.231858 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:56:04.231882 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:56:04.231957 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:56:04.232386 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:04.232978 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:04.233808 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:04.234024 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:04.234110 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:04.237714 (+ 3604us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.2:49387: BlockingRecv error: recv got EOF from 127.15.70.2:49387 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 11 00:56:04 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.3@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:56:04 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.3@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:56:04.392198 30915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:04.385984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.3:48903)
0811 00:56:04.386218 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0811 00:56:04.386230 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 00:56:04.386317 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:56:04.386508 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:56:04.386509 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:56:04.386749 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:56:04.386815 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:04.386817 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:04.387684 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:04.387685 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:04.388317 (+ 632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:04.388319 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:04.388728 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:04.388729 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:04.388783 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:04.389467 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:56:04.389473 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:56:04.392063 (+ 2590us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":150,"threads_started":1}
W20260811 00:56:04.392325 30912 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:56:04.386123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:48903 (local address 127.15.70.62:35921)
0811 00:56:04.386200 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 00:56:04.386203 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:56:04.386369 (+ 166us) server_negotiation.cc:407] Connection header received
0811 00:56:04.386408 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:56:04.386409 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:56:04.386429 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:56:04.386483 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:56:04.386900 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:04.387592 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:04.388418 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:04.388644 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:04.388726 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:04.392213 (+ 3487us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.3:48903: BlockingRecv error: recv got EOF from 127.15.70.3:48903 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 11 00:56:05 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.1@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:56:05 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.1@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:56:05.105479 30917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:05.098334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.1:52633)
0811 00:56:05.098593 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0811 00:56:05.098608 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 00:56:05.098691 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:56:05.098938 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:56:05.098940 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:56:05.099204 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:56:05.099275 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:05.099278 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:05.100234 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:05.100235 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:05.100936 (+ 701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:05.100939 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:05.101438 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:05.101439 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:05.101543 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:05.102364 (+ 821us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:56:05.102370 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:56:05.105359 (+ 2989us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":131,"threads_started":1}
W20260811 00:56:05.105742 30918 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:56:05.098435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:52633 (local address 127.15.70.62:35921)
0811 00:56:05.098719 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0811 00:56:05.098721 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:56:05.098733 (+ 12us) server_negotiation.cc:407] Connection header received
0811 00:56:05.098769 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:56:05.098770 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:56:05.098786 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:56:05.098865 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:56:05.099405 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:05.100103 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:05.101057 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:05.101301 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:05.101381 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:05.105648 (+ 4267us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.1:52633: BlockingRecv error: recv got EOF from 127.15.70.1:52633 (error 108)
Metrics: {"server-negotiator.queue_time_us":243,"thread_start_us":196,"threads_started":1}
Aug 11 00:56:05 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.2@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:56:05 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.2@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:56:05.245555 30920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:05.238427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.2:56271)
0811 00:56:05.238757 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0811 00:56:05.238778 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 00:56:05.238852 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:56:05.239097 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:56:05.239098 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:56:05.239372 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:56:05.239440 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:05.239442 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:05.240526 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:05.240527 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:05.241234 (+ 707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:05.241237 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:05.241783 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:05.241785 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:05.241864 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:05.242558 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:56:05.242565 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:56:05.245440 (+ 2875us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":185,"threads_started":1}
W20260811 00:56:05.245710 30918 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:56:05.238708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:56271 (local address 127.15.70.62:35921)
0811 00:56:05.238799 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0811 00:56:05.238801 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:56:05.238831 (+ 30us) server_negotiation.cc:407] Connection header received
0811 00:56:05.238924 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:56:05.238927 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:56:05.238946 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:56:05.239072 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:56:05.239546 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:05.240394 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:05.241383 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:05.241674 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:05.241771 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:05.245624 (+ 3853us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.2:56271: BlockingRecv error: recv got EOF from 127.15.70.2:56271 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 11 00:56:05 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.3@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:56:05 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.3@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:56:05.399183 30921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:05.392868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.3:37167)
0811 00:56:05.393130 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0811 00:56:05.393144 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 00:56:05.393271 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:56:05.393457 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:56:05.393458 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:56:05.393695 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:56:05.393760 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:05.393762 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:05.394584 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:05.394585 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:05.395307 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:05.395310 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:05.395751 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:05.395752 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:05.395809 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:05.396489 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:56:05.396495 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:56:05.399049 (+ 2554us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":190,"threads_started":1}
W20260811 00:56:05.399302 30918 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:56:05.392892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:37167 (local address 127.15.70.62:35921)
0811 00:56:05.393004 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0811 00:56:05.393007 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:56:05.393291 (+ 284us) server_negotiation.cc:407] Connection header received
0811 00:56:05.393350 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:56:05.393351 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:56:05.393374 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:56:05.393428 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:56:05.393846 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:05.394487 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:05.395420 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:05.395662 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:05.395737 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:05.399215 (+ 3478us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.3:37167: BlockingRecv error: recv got EOF from 127.15.70.3:37167 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 11 00:56:06 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.1@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:56:06 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.1@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:56:06.117785 30924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:06.106228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.1:42809)
0811 00:56:06.106448 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0811 00:56:06.106464 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 00:56:06.106712 (+ 248us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:56:06.106923 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:56:06.106925 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:56:06.107258 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:56:06.107332 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:06.107335 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:06.108180 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:06.108182 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:06.108780 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:06.108783 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:06.109239 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:06.109241 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:06.109325 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:06.114684 (+ 5359us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:56:06.114694 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:56:06.117609 (+ 2915us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":118,"threads_started":1}
W20260811 00:56:06.117846 30923 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:56:06.106239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:42809 (local address 127.15.70.62:35921)
0811 00:56:06.106454 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0811 00:56:06.106458 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:56:06.106680 (+ 222us) server_negotiation.cc:407] Connection header received
0811 00:56:06.106791 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:56:06.106792 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:56:06.106814 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:56:06.106910 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:56:06.107446 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:06.108066 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:06.108899 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:06.109136 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:06.109219 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:06.117749 (+ 8530us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.1:42809: BlockingRecv error: recv got EOF from 127.15.70.1:42809 (error 108)
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":125,"threads_started":1}
Aug 11 00:56:06 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.2@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:56:06 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.2@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:56:06.252417 30925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:06.246359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.2:49331)
0811 00:56:06.246561 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0811 00:56:06.246583 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 00:56:06.246669 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:56:06.246877 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:56:06.246879 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:56:06.247213 (+ 334us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:56:06.247284 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:06.247288 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:06.248090 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:06.248091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:06.248815 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:06.248819 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:06.249234 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:06.249235 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:06.249315 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:06.249991 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:56:06.249998 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:56:06.252289 (+ 2291us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":124,"threads_started":1}
W20260811 00:56:06.252514 30923 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:56:06.246522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:49331 (local address 127.15.70.62:35921)
0811 00:56:06.246696 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0811 00:56:06.246699 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:56:06.246709 (+ 10us) server_negotiation.cc:407] Connection header received
0811 00:56:06.246747 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:56:06.246748 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:56:06.246764 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:56:06.246839 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:56:06.247380 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:06.247981 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:06.248911 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:06.249147 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:06.249235 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:06.252436 (+ 3201us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.2:49331: BlockingRecv error: recv got EOF from 127.15.70.2:49331 (error 108)
Metrics: {"server-negotiator.queue_time_us":141}
Aug 11 00:56:06 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.3@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:56:06 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.3@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:56:06.406584 30926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:06.399968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.3:51335)
0811 00:56:06.400226 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0811 00:56:06.400243 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 00:56:06.400378 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:56:06.400608 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:56:06.400610 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:56:06.400876 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:56:06.400945 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:06.400947 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:06.401775 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:06.401777 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:06.402384 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:06.402386 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:06.402810 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:06.402812 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:06.402881 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:06.403631 (+ 750us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:56:06.403637 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:56:06.406440 (+ 2803us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":114,"threads_started":1}
W20260811 00:56:06.406800 30923 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:56:06.400109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:51335 (local address 127.15.70.62:35921)
0811 00:56:06.400232 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0811 00:56:06.400236 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:56:06.400349 (+ 113us) server_negotiation.cc:407] Connection header received
0811 00:56:06.400464 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:56:06.400465 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:56:06.400493 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:56:06.400567 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:56:06.401055 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:06.401654 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:06.402489 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:06.402719 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:06.402808 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:06.406683 (+ 3875us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.3:51335: BlockingRecv error: recv got EOF from 127.15.70.3:51335 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 11 00:56:07 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.1@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:56:07 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.1@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:56:07.124953 30927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:07.118763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.1:46907)
0811 00:56:07.118947 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 00:56:07.118964 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 00:56:07.119146 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:56:07.119338 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:56:07.119339 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:56:07.119565 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:56:07.119636 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:07.119639 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:07.120447 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:07.120449 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:07.121098 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:07.121101 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:07.121523 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:07.121524 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:07.121584 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:07.122243 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:56:07.122250 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:56:07.124867 (+ 2617us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":102,"threads_started":1}
W20260811 00:56:07.125197 30929 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:56:07.118869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:46907 (local address 127.15.70.62:35921)
0811 00:56:07.119080 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 00:56:07.119090 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 00:56:07.119122 (+ 32us) server_negotiation.cc:407] Connection header received
0811 00:56:07.119216 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:56:07.119217 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:56:07.119232 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:56:07.119314 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:56:07.119746 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:07.120335 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:07.121194 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:07.121420 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:07.121486 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:07.125097 (+ 3611us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.1:46907: BlockingRecv error: recv got EOF from 127.15.70.1:46907 (error 108)
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":93,"threads_started":1}
Aug 11 00:56:07 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.2@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:56:07 dist-test-slave-h3ft krb5kdc[29175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.70.2@KRBTEST.COM for oryx/127.15.70.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:56:07.259240 30930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:07.253270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35921 (local address 127.15.70.2:54429)
0811 00:56:07.253575 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0811 00:56:07.253589 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 00:56:07.253667 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:56:07.253879 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:56:07.253880 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:56:07.254184 (+ 304us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:56:07.254256 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:07.254259 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:07.255188 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:07.255189 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:07.255776 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:07.255778 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:07.256237 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:07.256238 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:07.256296 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:07.256986 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:56:07.256991 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:56:07.259157 (+ 2166us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.70.62:35921: Server oryx/127.15.70.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":154,"threads_started":1}
W20260811 00:56:07.259428 30929 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:56:07.253407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:54429 (local address 127.15.70.62:35921)
0811 00:56:07.253580 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 00:56:07.253583 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:56:07.253671 (+ 88us) server_negotiation.cc:407] Connection header received
0811 00:56:07.253743 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:56:07.253744 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:56:07.253759 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:56:07.253824 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:56:07.254357 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:07.255055 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:07.255888 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:07.256147 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:07.256217 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:07.259334 (+ 3117us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.70.2:54429: BlockingRecv error: recv got EOF from 127.15.70.2:54429 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
I20260811 00:56:07.298184 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 30172
I20260811 00:56:07.343436 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 30412
I20260811 00:56:07.369175 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 30625
I20260811 00:56:07.406189 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 30070
2026-08-11T00:56:07Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18259 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-11T00:56:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:56:07Z Disabled control of system clock
I20260811 00:56:07.465010 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:35069
--webserver_interface=127.15.70.62
--webserver_port=0
--builtin_ntp_servers=127.15.70.20:35799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:35069
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 00:56:07.576094 30939 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:56:07.576834 30939 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:56:07.576876 30939 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:56:07.578764 30939 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:56:07.578848 30939 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:56:07.578862 30939 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:56:07.578878 30939 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:56:07.578892 30939 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:56:07.581013 30939 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:35799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:35069
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:35069
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30939
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:56:07.581453 30939 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:56:07.581907 30939 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:56:07.589488 30960 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:56:07.589365 30959 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:56:07.589365 30963 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:56:07.589592 30939 server_base.cc:1034] running on GCE node
I20260811 00:56:07.590400 30939 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:56:07.590919 30939 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:56:07.592118 30939 hybrid_clock.cc:648] HybridClock initialized: now 1786409767592065 us; error 69 us; skew 500 ppm
I20260811 00:56:07.594125 30939 webserver.cc:460] Webserver started at http://127.15.70.62:43681/ using document root <none> and password file <none>
I20260811 00:56:07.594492 30939 fs_manager.cc:359] Metadata directory not provided
I20260811 00:56:07.594584 30939 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:56:07.594779 30939 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:56:07.596333 30939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "22ebec59fdb94c0780d85f81bb4add80"
format_stamp: "Formatted at 2026-08-11 00:56:07 on dist-test-slave-h3ft"
server_key: "62fdb7ce38f7793f8e8255430ee4ce45"
server_key_iv: "20d4ea924196031b1b5371bea21e4873"
server_key_version: "encryptionkey@0"
I20260811 00:56:07.596855 30939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "22ebec59fdb94c0780d85f81bb4add80"
format_stamp: "Formatted at 2026-08-11 00:56:07 on dist-test-slave-h3ft"
server_key: "62fdb7ce38f7793f8e8255430ee4ce45"
server_key_iv: "20d4ea924196031b1b5371bea21e4873"
server_key_version: "encryptionkey@0"
I20260811 00:56:07.598809 30939 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 00:56:07.600033 30975 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:56:07.600322 30939 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 00:56:07.600484 30939 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "22ebec59fdb94c0780d85f81bb4add80"
format_stamp: "Formatted at 2026-08-11 00:56:07 on dist-test-slave-h3ft"
server_key: "62fdb7ce38f7793f8e8255430ee4ce45"
server_key_iv: "20d4ea924196031b1b5371bea21e4873"
server_key_version: "encryptionkey@0"
I20260811 00:56:07.600603 30939 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:56:07.625427 30939 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:56:07.625985 30939 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:56:07.626197 30939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:56:07.631896 30939 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:35069
I20260811 00:56:07.632092 31062 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:35069 every 8 connection(s)
I20260811 00:56:07.632477 30939 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:56:07.633507 31063 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:56:07.633594 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 30939
I20260811 00:56:07.633723 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 00:56:07.634044 15640 external_mini_cluster.cc:1428] Setting key 48d79de412dd5315a4a87f6924cee46f
I20260811 00:56:07.638520 31063 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22ebec59fdb94c0780d85f81bb4add80: Bootstrap starting.
I20260811 00:56:07.639557 31063 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 22ebec59fdb94c0780d85f81bb4add80: Neither blocks nor log segments found. Creating new log.
I20260811 00:56:07.640004 31063 log.cc:824] T 00000000000000000000000000000000 P 22ebec59fdb94c0780d85f81bb4add80: Log is configured to *not* fsync() on all Append() calls
I20260811 00:56:07.641028 31063 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22ebec59fdb94c0780d85f81bb4add80: No bootstrap required, opened a new log
I20260811 00:56:07.641324 31066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:07.634862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58534 (local address 127.15.70.62:35069)
0811 00:56:07.635148 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0811 00:56:07.635163 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 00:56:07.635198 (+ 35us) server_negotiation.cc:407] Connection header received
0811 00:56:07.635667 (+ 469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:56:07.635676 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:56:07.635756 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:56:07.635899 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:56:07.636258 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:07.637268 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:07.638432 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:07.638973 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:07.639192 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:07.640242 (+ 1050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:56:07.640253 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:56:07.640253 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:56:07.640588 (+ 335us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:56:07.640638 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:56:07.640653 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:56:07.640715 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 00:56:07.640852 (+ 137us) server_negotiation.cc:299] Negotiation successful
0811 00:56:07.641026 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":90,"threads_started":1}
I20260811 00:56:07.643656 31063 raft_consensus.cc:348] T 00000000000000000000000000000000 P 22ebec59fdb94c0780d85f81bb4add80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22ebec59fdb94c0780d85f81bb4add80" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 35069 } }
I20260811 00:56:07.643880 31063 raft_consensus.cc:374] T 00000000000000000000000000000000 P 22ebec59fdb94c0780d85f81bb4add80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:56:07.643934 31063 raft_consensus.cc:729] T 00000000000000000000000000000000 P 22ebec59fdb94c0780d85f81bb4add80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ebec59fdb94c0780d85f81bb4add80, State: Initialized, Role: FOLLOWER
I20260811 00:56:07.644117 31063 consensus_queue.cc:260] T 00000000000000000000000000000000 P 22ebec59fdb94c0780d85f81bb4add80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22ebec59fdb94c0780d85f81bb4add80" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 35069 } }
I20260811 00:56:07.644241 31063 raft_consensus.cc:388] T 00000000000000000000000000000000 P 22ebec59fdb94c0780d85f81bb4add80 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:56:07.644294 31063 raft_consensus.cc:482] T 00000000000000000000000000000000 P 22ebec59fdb94c0780d85f81bb4add80 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:56:07.644356 31063 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 22ebec59fdb94c0780d85f81bb4add80 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:56:07.645367 31063 raft_consensus.cc:504] T 00000000000000000000000000000000 P 22ebec59fdb94c0780d85f81bb4add80 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22ebec59fdb94c0780d85f81bb4add80" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 35069 } }
I20260811 00:56:07.645534 31063 leader_election.cc:302] T 00000000000000000000000000000000 P 22ebec59fdb94c0780d85f81bb4add80 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 22ebec59fdb94c0780d85f81bb4add80; no voters:
I20260811 00:56:07.645782 31063 leader_election.cc:288] T 00000000000000000000000000000000 P 22ebec59fdb94c0780d85f81bb4add80 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:56:07.645900 31068 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 22ebec59fdb94c0780d85f81bb4add80 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:56:07.646205 31068 raft_consensus.cc:686] T 00000000000000000000000000000000 P 22ebec59fdb94c0780d85f81bb4add80 [term 1 LEADER]: Becoming Leader. State: Replica: 22ebec59fdb94c0780d85f81bb4add80, State: Running, Role: LEADER
I20260811 00:56:07.646216 31063 sys_catalog.cc:564] T 00000000000000000000000000000000 P 22ebec59fdb94c0780d85f81bb4add80 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:56:07.646363 31068 consensus_queue.cc:237] T 00000000000000000000000000000000 P 22ebec59fdb94c0780d85f81bb4add80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22ebec59fdb94c0780d85f81bb4add80" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 35069 } }
I20260811 00:56:07.646850 31070 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22ebec59fdb94c0780d85f81bb4add80 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 22ebec59fdb94c0780d85f81bb4add80. Latest consensus state: current_term: 1 leader_uuid: "22ebec59fdb94c0780d85f81bb4add80" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22ebec59fdb94c0780d85f81bb4add80" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 35069 } } }
I20260811 00:56:07.647044 31070 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22ebec59fdb94c0780d85f81bb4add80 [sys.catalog]: This master's current role is: LEADER
I20260811 00:56:07.647224 31069 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22ebec59fdb94c0780d85f81bb4add80 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "22ebec59fdb94c0780d85f81bb4add80" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22ebec59fdb94c0780d85f81bb4add80" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 35069 } } }
I20260811 00:56:07.647461 31069 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22ebec59fdb94c0780d85f81bb4add80 [sys.catalog]: This master's current role is: LEADER
I20260811 00:56:07.647811 31079 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:56:07.648540 31079 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:56:07.650713 31079 catalog_manager.cc:1347] Generated new cluster ID: 24cd12c1a027475494eebbfa1b0f4a0e
I20260811 00:56:07.650810 31079 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:56:07.659354 31079 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:56:07.660055 31079 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:56:07.669124 31079 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 22ebec59fdb94c0780d85f81bb4add80: Generated new TSK 0
I20260811 00:56:07.669445 31079 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:56:07.672533 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.1:0
--local_ip_for_outbound_sockets=127.15.70.1
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:35069
--builtin_ntp_servers=127.15.70.20:35799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260811 00:56:07.790488 31094 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:56:07.790880 31094 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:56:07.790933 31094 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:56:07.792610 31094 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:56:07.792701 31094 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:56:07.792753 31094 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.1
I20260811 00:56:07.794512 31094 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:35799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:35069
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31094
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.1
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:56:07.794881 31094 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:56:07.795372 31094 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:56:07.802881 31100 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:56:07.802893 31099 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:56:07.802902 31102 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:56:07.803408 31094 server_base.cc:1034] running on GCE node
I20260811 00:56:07.803802 31094 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:56:07.804243 31094 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:56:07.805523 31094 hybrid_clock.cc:648] HybridClock initialized: now 1786409767805489 us; error 80 us; skew 500 ppm
I20260811 00:56:07.807572 31094 webserver.cc:460] Webserver started at http://127.15.70.1:38567/ using document root <none> and password file <none>
I20260811 00:56:07.807917 31094 fs_manager.cc:359] Metadata directory not provided
I20260811 00:56:07.808003 31094 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:56:07.808190 31094 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:56:07.809580 31094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/data/instance:
uuid: "dfb98c48daa140b8ba95396eaac3d644"
format_stamp: "Formatted at 2026-08-11 00:56:07 on dist-test-slave-h3ft"
server_key: "b71925555cc773804e795a50b6aeb046"
server_key_iv: "f2bba6b0e85927edc7d8e6adc98bd81f"
server_key_version: "encryptionkey@0"
I20260811 00:56:07.810040 31094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance:
uuid: "dfb98c48daa140b8ba95396eaac3d644"
format_stamp: "Formatted at 2026-08-11 00:56:07 on dist-test-slave-h3ft"
server_key: "b71925555cc773804e795a50b6aeb046"
server_key_iv: "f2bba6b0e85927edc7d8e6adc98bd81f"
server_key_version: "encryptionkey@0"
I20260811 00:56:07.811950 31094 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260811 00:56:07.813100 31112 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:56:07.813416 31094 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:56:07.813542 31094 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/wal
uuid: "dfb98c48daa140b8ba95396eaac3d644"
format_stamp: "Formatted at 2026-08-11 00:56:07 on dist-test-slave-h3ft"
server_key: "b71925555cc773804e795a50b6aeb046"
server_key_iv: "f2bba6b0e85927edc7d8e6adc98bd81f"
server_key_version: "encryptionkey@0"
I20260811 00:56:07.813642 31094 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:56:07.859524 31094 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:56:07.860029 31094 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:56:07.860231 31094 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:56:07.860596 31094 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:56:07.861230 31094 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:56:07.861327 31094 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:56:07.861382 31094 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:56:07.861413 31094 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:56:07.869765 31094 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.1:41669
I20260811 00:56:07.869863 31301 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.1:41669 every 8 connection(s)
I20260811 00:56:07.870360 31094 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
I20260811 00:56:07.875694 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 31094
I20260811 00:56:07.875842 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance
I20260811 00:56:07.876116 15640 external_mini_cluster.cc:1428] Setting key 9d330f7f76ed59aa6453707a9c849a6c
I20260811 00:56:07.877638 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.2:0
--local_ip_for_outbound_sockets=127.15.70.2
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:35069
--builtin_ntp_servers=127.15.70.20:35799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 00:56:07.877842 31066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:07.871537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:34383 (local address 127.15.70.62:35069)
0811 00:56:07.871630 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0811 00:56:07.871633 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:56:07.871892 (+ 259us) server_negotiation.cc:407] Connection header received
0811 00:56:07.872528 (+ 636us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:56:07.872530 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:56:07.872553 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:56:07.872641 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:56:07.873533 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:07.874160 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:07.875587 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:07.875821 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:07.875953 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:07.877418 (+ 1465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:56:07.877420 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:56:07.877421 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:56:07.877428 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:56:07.877453 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:56:07.877459 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:56:07.877534 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 00:56:07.877640 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 00:56:07.877703 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 00:56:07.878154 31309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:07.871450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35069 (local address 127.15.70.1:34383)
0811 00:56:07.871707 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0811 00:56:07.871759 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 00:56:07.872396 (+ 637us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:56:07.872751 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:56:07.872756 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:56:07.872769 (+ 13us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:56:07.873404 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:07.873409 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:07.874293 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:07.874294 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:07.875434 (+ 1140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:07.875440 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:07.875974 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:07.875976 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:07.876199 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:07.877194 (+ 995us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:56:07.877194 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:56:07.877245 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:56:07.877287 (+ 42us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:56:07.877555 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:56:07.877562 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:56:07.877566 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:56:07.877632 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 00:56:07.877795 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":117,"threads_started":1}
I20260811 00:56:07.878863 31302 heartbeater.cc:347] Connected to a master server at 127.15.70.62:35069
I20260811 00:56:07.879076 31302 heartbeater.cc:464] Registering TS with master...
I20260811 00:56:07.879374 31302 heartbeater.cc:511] Master 127.15.70.62:35069 requested a full tablet report, sending...
I20260811 00:56:07.880190 31000 ts_manager.cc:194] Registered new tserver with Master: dfb98c48daa140b8ba95396eaac3d644 (127.15.70.1:41669)
I20260811 00:56:07.881031 31000 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.70.1:34383
W20260811 00:56:07.988772 31310 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:56:07.989118 31310 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:56:07.989151 31310 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:56:07.990927 31310 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:56:07.991092 31310 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:56:07.991178 31310 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.2
I20260811 00:56:07.993253 31310 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:35799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:35069
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31310
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.2
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:56:07.993667 31310 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:56:07.994125 31310 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:56:08.001345 31326 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:56:08.001361 31322 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:56:08.001394 31310 server_base.cc:1034] running on GCE node
W20260811 00:56:08.001345 31329 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:56:08.002126 31310 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:56:08.002430 31310 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:56:08.003647 31310 hybrid_clock.cc:648] HybridClock initialized: now 1786409768003630 us; error 41 us; skew 500 ppm
I20260811 00:56:08.005875 31310 webserver.cc:460] Webserver started at http://127.15.70.2:45099/ using document root <none> and password file <none>
I20260811 00:56:08.006243 31310 fs_manager.cc:359] Metadata directory not provided
I20260811 00:56:08.006559 31310 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:56:08.006964 31310 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:56:08.008669 31310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/data/instance:
uuid: "1b62d488fd86464e8a705d24cdd0ae3d"
format_stamp: "Formatted at 2026-08-11 00:56:08 on dist-test-slave-h3ft"
server_key: "e8aac3b888846a453850db451e747f33"
server_key_iv: "060af850828650f4197bf2acbd698d31"
server_key_version: "encryptionkey@0"
I20260811 00:56:08.009265 31310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance:
uuid: "1b62d488fd86464e8a705d24cdd0ae3d"
format_stamp: "Formatted at 2026-08-11 00:56:08 on dist-test-slave-h3ft"
server_key: "e8aac3b888846a453850db451e747f33"
server_key_iv: "060af850828650f4197bf2acbd698d31"
server_key_version: "encryptionkey@0"
I20260811 00:56:08.011343 31310 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 00:56:08.012676 31335 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:56:08.013181 31310 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:56:08.013329 31310 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/wal
uuid: "1b62d488fd86464e8a705d24cdd0ae3d"
format_stamp: "Formatted at 2026-08-11 00:56:08 on dist-test-slave-h3ft"
server_key: "e8aac3b888846a453850db451e747f33"
server_key_iv: "060af850828650f4197bf2acbd698d31"
server_key_version: "encryptionkey@0"
I20260811 00:56:08.013434 31310 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:56:08.021873 31310 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:56:08.022339 31310 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:56:08.022528 31310 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:56:08.022851 31310 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:56:08.023370 31310 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:56:08.023433 31310 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:56:08.023504 31310 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:56:08.023553 31310 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:56:08.031529 31310 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.2:46511
I20260811 00:56:08.031622 31520 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.2:46511 every 8 connection(s)
I20260811 00:56:08.032060 31310 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
I20260811 00:56:08.037565 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 31310
I20260811 00:56:08.037707 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance
I20260811 00:56:08.037989 15640 external_mini_cluster.cc:1428] Setting key c280e992a2ae406f127af16f345e5519
I20260811 00:56:08.038888 31066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:08.033102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:59867 (local address 127.15.70.62:35069)
0811 00:56:08.033224 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0811 00:56:08.033227 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:56:08.033425 (+ 198us) server_negotiation.cc:407] Connection header received
0811 00:56:08.034135 (+ 710us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:56:08.034136 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:56:08.034150 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:56:08.034212 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:56:08.035181 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:08.035760 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:08.036966 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:08.037175 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:08.037239 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:08.038559 (+ 1320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:56:08.038561 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:56:08.038561 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:56:08.038567 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:56:08.038588 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:56:08.038592 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:56:08.038669 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 00:56:08.038754 (+ 85us) server_negotiation.cc:299] Negotiation successful
0811 00:56:08.038790 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 00:56:08.039194 31524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:08.033006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35069 (local address 127.15.70.2:59867)
0811 00:56:08.033269 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0811 00:56:08.033316 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 00:56:08.034017 (+ 701us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:56:08.034304 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:56:08.034308 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:56:08.034319 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:56:08.035064 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:08.035070 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:08.035871 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:08.035873 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:08.036864 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:08.036868 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:08.037343 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:08.037345 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:08.037564 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:08.038378 (+ 814us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:56:08.038379 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:56:08.038415 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:56:08.038451 (+ 36us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:56:08.038671 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:56:08.038679 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:56:08.038682 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:56:08.038758 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 00:56:08.038885 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":90,"threads_started":1}
I20260811 00:56:08.039312 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.3:0
--local_ip_for_outbound_sockets=127.15.70.3
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:35069
--builtin_ntp_servers=127.15.70.20:35799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 00:56:08.039755 31521 heartbeater.cc:347] Connected to a master server at 127.15.70.62:35069
I20260811 00:56:08.039873 31521 heartbeater.cc:464] Registering TS with master...
I20260811 00:56:08.040135 31521 heartbeater.cc:511] Master 127.15.70.62:35069 requested a full tablet report, sending...
I20260811 00:56:08.040688 31000 ts_manager.cc:194] Registered new tserver with Master: 1b62d488fd86464e8a705d24cdd0ae3d (127.15.70.2:46511)
I20260811 00:56:08.041180 31000 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.70.2:59867
W20260811 00:56:08.149158 31525 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:56:08.149487 31525 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:56:08.149519 31525 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:56:08.151176 31525 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:56:08.151237 31525 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:56:08.151273 31525 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.3
I20260811 00:56:08.153159 31525 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:35799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:35069
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31525
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.3
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:56:08.153553 31525 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:56:08.154029 31525 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:56:08.161023 31536 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:56:08.161023 31538 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:56:08.161048 31535 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:56:08.161506 31525 server_base.cc:1034] running on GCE node
I20260811 00:56:08.161788 31525 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:56:08.162112 31525 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:56:08.163268 31525 hybrid_clock.cc:648] HybridClock initialized: now 1786409768163252 us; error 32 us; skew 500 ppm
I20260811 00:56:08.165108 31525 webserver.cc:460] Webserver started at http://127.15.70.3:39403/ using document root <none> and password file <none>
I20260811 00:56:08.165438 31525 fs_manager.cc:359] Metadata directory not provided
I20260811 00:56:08.165519 31525 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:56:08.165709 31525 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:56:08.167215 31525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/data/instance:
uuid: "d3aa06ab0d394da982f49e8406f1010e"
format_stamp: "Formatted at 2026-08-11 00:56:08 on dist-test-slave-h3ft"
server_key: "bae19bdb320b0efd55dde65733a9ff7b"
server_key_iv: "a894e6ee0a528670621a869224921dfc"
server_key_version: "encryptionkey@0"
I20260811 00:56:08.167672 31525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance:
uuid: "d3aa06ab0d394da982f49e8406f1010e"
format_stamp: "Formatted at 2026-08-11 00:56:08 on dist-test-slave-h3ft"
server_key: "bae19bdb320b0efd55dde65733a9ff7b"
server_key_iv: "a894e6ee0a528670621a869224921dfc"
server_key_version: "encryptionkey@0"
I20260811 00:56:08.169502 31525 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 00:56:08.170835 31547 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:56:08.171221 31525 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:56:08.171342 31525 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/wal
uuid: "d3aa06ab0d394da982f49e8406f1010e"
format_stamp: "Formatted at 2026-08-11 00:56:08 on dist-test-slave-h3ft"
server_key: "bae19bdb320b0efd55dde65733a9ff7b"
server_key_iv: "a894e6ee0a528670621a869224921dfc"
server_key_version: "encryptionkey@0"
I20260811 00:56:08.171470 31525 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:56:08.181660 31525 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:56:08.182279 31525 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:56:08.182500 31525 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:56:08.182930 31525 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:56:08.183480 31525 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:56:08.183524 31525 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:56:08.183555 31525 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:56:08.183570 31525 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:56:08.191745 31525 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.3:42343
I20260811 00:56:08.191829 31729 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.3:42343 every 8 connection(s)
I20260811 00:56:08.192305 31525 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
I20260811 00:56:08.198313 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 31525
I20260811 00:56:08.198455 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance
I20260811 00:56:08.198741 15640 external_mini_cluster.cc:1428] Setting key 90cbb1f1182124d77ff7cc7d1983d551
I20260811 00:56:08.200240 31066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:08.193355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:53245 (local address 127.15.70.62:35069)
0811 00:56:08.193433 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 00:56:08.193435 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:56:08.193784 (+ 349us) server_negotiation.cc:407] Connection header received
0811 00:56:08.194482 (+ 698us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:56:08.194484 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:56:08.194511 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:56:08.194571 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:56:08.195963 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:08.196621 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:08.197918 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:08.198168 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:08.198244 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:08.199767 (+ 1523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:56:08.199768 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:56:08.199769 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:56:08.199776 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:56:08.199799 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:56:08.199804 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:56:08.199869 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 00:56:08.200084 (+ 215us) server_negotiation.cc:299] Negotiation successful
0811 00:56:08.200123 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 00:56:08.200572 31733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:08.193352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35069 (local address 127.15.70.3:53245)
0811 00:56:08.193622 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0811 00:56:08.193667 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 00:56:08.194348 (+ 681us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:56:08.194729 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:56:08.194735 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:56:08.194747 (+ 12us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:56:08.195811 (+ 1064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:08.195821 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:08.196733 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:08.196734 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:08.197795 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:08.197798 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:08.198291 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:08.198292 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:08.198496 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:08.199535 (+ 1039us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:56:08.199536 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:56:08.199587 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:56:08.199639 (+ 52us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:56:08.199901 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:56:08.199910 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:56:08.199914 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:56:08.200050 (+ 136us) client_negotiation.cc:240] Negotiation successful
0811 00:56:08.200239 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":121,"threads_started":1}
I20260811 00:56:08.201272 31730 heartbeater.cc:347] Connected to a master server at 127.15.70.62:35069
I20260811 00:56:08.201433 31730 heartbeater.cc:464] Registering TS with master...
I20260811 00:56:08.201725 31730 heartbeater.cc:511] Master 127.15.70.62:35069 requested a full tablet report, sending...
I20260811 00:56:08.202256 31000 ts_manager.cc:194] Registered new tserver with Master: d3aa06ab0d394da982f49e8406f1010e (127.15.70.3:42343)
I20260811 00:56:08.202735 31000 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.70.3:53245
I20260811 00:56:08.211941 15640 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 00:56:08.214485 31066 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:56:08.213900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58538 (local address 127.15.70.62:35069)
0811 00:56:08.213974 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 00:56:08.213976 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:56:08.214037 (+ 61us) server_negotiation.cc:407] Connection header received
0811 00:56:08.214097 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:56:08.214098 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:56:08.214110 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:56:08.214175 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:56:08.214365 (+ 190us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58538: BlockingRecv error: recv got EOF from 127.0.0.1:58538 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 00:56:08.214566 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 31094
I20260811 00:56:08.250524 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 31310
I20260811 00:56:08.276782 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 31525
I20260811 00:56:08.299835 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 30939
2026-08-11T00:56:08Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (892 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-11T00:56:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:56:08Z Disabled control of system clock
I20260811 00:56:08.356194 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:40453
--webserver_interface=127.15.70.62
--webserver_port=0
--builtin_ntp_servers=127.15.70.20:39055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:40453
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 00:56:08.465946 31750 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:56:08.466286 31750 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:56:08.466317 31750 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:56:08.468050 31750 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:56:08.468142 31750 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:56:08.468158 31750 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:56:08.468175 31750 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:56:08.468201 31750 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:56:08.470538 31750 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:39055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:40453
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:40453
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31750
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:56:08.471091 31750 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:56:08.471597 31750 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:56:08.478854 31757 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:56:08.478930 31758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:56:08.478863 31761 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:56:08.479622 31750 server_base.cc:1034] running on GCE node
I20260811 00:56:08.479969 31750 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:56:08.480398 31750 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:56:08.481593 31750 hybrid_clock.cc:648] HybridClock initialized: now 1786409768481569 us; error 52 us; skew 500 ppm
I20260811 00:56:08.483618 31750 webserver.cc:460] Webserver started at http://127.15.70.62:38339/ using document root <none> and password file <none>
I20260811 00:56:08.483979 31750 fs_manager.cc:359] Metadata directory not provided
I20260811 00:56:08.484038 31750 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:56:08.484259 31750 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:56:08.485853 31750 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "79be4e56d68949e7847e5b56fbf4d266"
format_stamp: "Formatted at 2026-08-11 00:56:08 on dist-test-slave-h3ft"
server_key: "e00f3bfb71cab238f00c3546db761cb0"
server_key_iv: "2b398acdeb04d59f7c81c4ac3aa1aced"
server_key_version: "encryptionkey@0"
I20260811 00:56:08.486632 31750 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "79be4e56d68949e7847e5b56fbf4d266"
format_stamp: "Formatted at 2026-08-11 00:56:08 on dist-test-slave-h3ft"
server_key: "e00f3bfb71cab238f00c3546db761cb0"
server_key_iv: "2b398acdeb04d59f7c81c4ac3aa1aced"
server_key_version: "encryptionkey@0"
I20260811 00:56:08.488520 31750 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.005s sys 0.000s
I20260811 00:56:08.489658 31776 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:56:08.489918 31750 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:56:08.490116 31750 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "79be4e56d68949e7847e5b56fbf4d266"
format_stamp: "Formatted at 2026-08-11 00:56:08 on dist-test-slave-h3ft"
server_key: "e00f3bfb71cab238f00c3546db761cb0"
server_key_iv: "2b398acdeb04d59f7c81c4ac3aa1aced"
server_key_version: "encryptionkey@0"
I20260811 00:56:08.490237 31750 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:56:08.494903 31750 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:56:08.495385 31750 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:56:08.495568 31750 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:56:08.501058 31750 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:40453
I20260811 00:56:08.501094 31856 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:40453 every 8 connection(s)
I20260811 00:56:08.501554 31750 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:56:08.502468 31857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:56:08.503630 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 31750
I20260811 00:56:08.503753 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 00:56:08.503983 15640 external_mini_cluster.cc:1428] Setting key ca2511d15be09812da261f6cf15c369a
I20260811 00:56:08.506844 31857 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79be4e56d68949e7847e5b56fbf4d266: Bootstrap starting.
I20260811 00:56:08.507583 31862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:08.504959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55170 (local address 127.15.70.62:40453)
0811 00:56:08.505204 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0811 00:56:08.505215 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 00:56:08.505246 (+ 31us) server_negotiation.cc:407] Connection header received
0811 00:56:08.505763 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:56:08.505771 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:56:08.505823 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:56:08.505968 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:56:08.506852 (+ 884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:56:08.506856 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:56:08.506856 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:56:08.506860 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:56:08.507001 (+ 141us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:56:08.507021 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:56:08.507155 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0811 00:56:08.507255 (+ 100us) server_negotiation.cc:299] Negotiation successful
0811 00:56:08.507336 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":111,"threads_started":1}
I20260811 00:56:08.507861 31857 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 79be4e56d68949e7847e5b56fbf4d266: Neither blocks nor log segments found. Creating new log.
I20260811 00:56:08.508242 31857 log.cc:824] T 00000000000000000000000000000000 P 79be4e56d68949e7847e5b56fbf4d266: Log is configured to *not* fsync() on all Append() calls
I20260811 00:56:08.509052 31857 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79be4e56d68949e7847e5b56fbf4d266: No bootstrap required, opened a new log
I20260811 00:56:08.510728 31857 raft_consensus.cc:348] T 00000000000000000000000000000000 P 79be4e56d68949e7847e5b56fbf4d266 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79be4e56d68949e7847e5b56fbf4d266" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 40453 } }
I20260811 00:56:08.510948 31857 raft_consensus.cc:374] T 00000000000000000000000000000000 P 79be4e56d68949e7847e5b56fbf4d266 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:56:08.511052 31857 raft_consensus.cc:729] T 00000000000000000000000000000000 P 79be4e56d68949e7847e5b56fbf4d266 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79be4e56d68949e7847e5b56fbf4d266, State: Initialized, Role: FOLLOWER
I20260811 00:56:08.511255 31857 consensus_queue.cc:260] T 00000000000000000000000000000000 P 79be4e56d68949e7847e5b56fbf4d266 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79be4e56d68949e7847e5b56fbf4d266" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 40453 } }
I20260811 00:56:08.511380 31857 raft_consensus.cc:388] T 00000000000000000000000000000000 P 79be4e56d68949e7847e5b56fbf4d266 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:56:08.511432 31857 raft_consensus.cc:482] T 00000000000000000000000000000000 P 79be4e56d68949e7847e5b56fbf4d266 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:56:08.511490 31857 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 79be4e56d68949e7847e5b56fbf4d266 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:56:08.512257 31857 raft_consensus.cc:504] T 00000000000000000000000000000000 P 79be4e56d68949e7847e5b56fbf4d266 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79be4e56d68949e7847e5b56fbf4d266" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 40453 } }
I20260811 00:56:08.512413 31857 leader_election.cc:302] T 00000000000000000000000000000000 P 79be4e56d68949e7847e5b56fbf4d266 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 79be4e56d68949e7847e5b56fbf4d266; no voters:
I20260811 00:56:08.512706 31857 leader_election.cc:288] T 00000000000000000000000000000000 P 79be4e56d68949e7847e5b56fbf4d266 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:56:08.513114 31857 sys_catalog.cc:564] T 00000000000000000000000000000000 P 79be4e56d68949e7847e5b56fbf4d266 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:56:08.513145 31866 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 79be4e56d68949e7847e5b56fbf4d266 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:56:08.513402 31866 raft_consensus.cc:686] T 00000000000000000000000000000000 P 79be4e56d68949e7847e5b56fbf4d266 [term 1 LEADER]: Becoming Leader. State: Replica: 79be4e56d68949e7847e5b56fbf4d266, State: Running, Role: LEADER
I20260811 00:56:08.513548 31866 consensus_queue.cc:237] T 00000000000000000000000000000000 P 79be4e56d68949e7847e5b56fbf4d266 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79be4e56d68949e7847e5b56fbf4d266" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 40453 } }
I20260811 00:56:08.514166 31868 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79be4e56d68949e7847e5b56fbf4d266 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 79be4e56d68949e7847e5b56fbf4d266. Latest consensus state: current_term: 1 leader_uuid: "79be4e56d68949e7847e5b56fbf4d266" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79be4e56d68949e7847e5b56fbf4d266" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 40453 } } }
I20260811 00:56:08.514285 31868 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79be4e56d68949e7847e5b56fbf4d266 [sys.catalog]: This master's current role is: LEADER
I20260811 00:56:08.514372 31867 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79be4e56d68949e7847e5b56fbf4d266 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "79be4e56d68949e7847e5b56fbf4d266" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79be4e56d68949e7847e5b56fbf4d266" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 40453 } } }
I20260811 00:56:08.514533 31867 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79be4e56d68949e7847e5b56fbf4d266 [sys.catalog]: This master's current role is: LEADER
I20260811 00:56:08.514711 31877 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:56:08.515421 31877 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:56:08.517560 31877 catalog_manager.cc:1347] Generated new cluster ID: 66609a87f5f54965be82e535f9d50fa3
I20260811 00:56:08.517638 31877 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:56:08.523258 31877 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:56:08.523520 31877 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:56:08.530227 31877 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 79be4e56d68949e7847e5b56fbf4d266: Generated new TSK 0
I20260811 00:56:08.530608 31877 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:56:08.536404 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.1:0
--local_ip_for_outbound_sockets=127.15.70.1
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:40453
--builtin_ntp_servers=127.15.70.20:39055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 00:56:08.645783 31893 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:56:08.646210 31893 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:56:08.646251 31893 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:56:08.648435 31893 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:56:08.648548 31893 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:56:08.648592 31893 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.1
I20260811 00:56:08.651291 31893 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:39055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:40453
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31893
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.1
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:56:08.651734 31893 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:56:08.652209 31893 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:56:08.659986 31901 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:56:08.659967 31900 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:56:08.660060 31907 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:56:08.660425 31893 server_base.cc:1034] running on GCE node
I20260811 00:56:08.660687 31893 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:56:08.661062 31893 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:56:08.662250 31893 hybrid_clock.cc:648] HybridClock initialized: now 1786409768662219 us; error 53 us; skew 500 ppm
I20260811 00:56:08.664315 31893 webserver.cc:460] Webserver started at http://127.15.70.1:40299/ using document root <none> and password file <none>
I20260811 00:56:08.664690 31893 fs_manager.cc:359] Metadata directory not provided
I20260811 00:56:08.664763 31893 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:56:08.664923 31893 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:56:08.666663 31893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/data/instance:
uuid: "7fc9cfbf850b4c33a53113198356f5e7"
format_stamp: "Formatted at 2026-08-11 00:56:08 on dist-test-slave-h3ft"
server_key: "bda1538f8ba99a78108c7053bb8ca4cd"
server_key_iv: "06b853e744a3fd158f715fc3795ced7b"
server_key_version: "encryptionkey@0"
I20260811 00:56:08.667246 31893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance:
uuid: "7fc9cfbf850b4c33a53113198356f5e7"
format_stamp: "Formatted at 2026-08-11 00:56:08 on dist-test-slave-h3ft"
server_key: "bda1538f8ba99a78108c7053bb8ca4cd"
server_key_iv: "06b853e744a3fd158f715fc3795ced7b"
server_key_version: "encryptionkey@0"
I20260811 00:56:08.669409 31893 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.001s
I20260811 00:56:08.670543 31917 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:56:08.670801 31893 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:56:08.670925 31893 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/wal
uuid: "7fc9cfbf850b4c33a53113198356f5e7"
format_stamp: "Formatted at 2026-08-11 00:56:08 on dist-test-slave-h3ft"
server_key: "bda1538f8ba99a78108c7053bb8ca4cd"
server_key_iv: "06b853e744a3fd158f715fc3795ced7b"
server_key_version: "encryptionkey@0"
I20260811 00:56:08.671128 31893 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:56:08.675421 31893 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:56:08.675766 31893 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:56:08.675925 31893 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:56:08.676187 31893 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:56:08.676574 31893 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:56:08.676632 31893 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:56:08.676679 31893 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:56:08.676710 31893 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:56:08.689090 31893 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.1:34173
I20260811 00:56:08.689172 32090 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.1:34173 every 8 connection(s)
I20260811 00:56:08.689697 31893 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
I20260811 00:56:08.694005 31862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:08.690842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:40917 (local address 127.15.70.62:40453)
0811 00:56:08.690920 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 00:56:08.690922 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:56:08.691436 (+ 514us) server_negotiation.cc:407] Connection header received
0811 00:56:08.691969 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:56:08.691971 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:56:08.691979 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:56:08.692045 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:56:08.693526 (+ 1481us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:56:08.693528 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:56:08.693528 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:56:08.693533 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:56:08.693552 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:56:08.693557 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:56:08.693617 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 00:56:08.693759 (+ 142us) server_negotiation.cc:299] Negotiation successful
0811 00:56:08.693778 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 00:56:08.694041 32095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:08.690831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:40453 (local address 127.15.70.1:40917)
0811 00:56:08.691175 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0811 00:56:08.691220 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 00:56:08.691809 (+ 589us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:56:08.692156 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:56:08.692160 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:56:08.692171 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:56:08.693341 (+ 1170us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:56:08.693341 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:56:08.693381 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:56:08.693421 (+ 40us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:56:08.693630 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:56:08.693635 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:56:08.693639 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:56:08.693713 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 00:56:08.693779 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":239,"threads_started":1}
I20260811 00:56:08.694777 32091 heartbeater.cc:347] Connected to a master server at 127.15.70.62:40453
I20260811 00:56:08.694914 32091 heartbeater.cc:464] Registering TS with master...
I20260811 00:56:08.695173 32091 heartbeater.cc:511] Master 127.15.70.62:40453 requested a full tablet report, sending...
I20260811 00:56:08.695262 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 31893
I20260811 00:56:08.695380 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance
I20260811 00:56:08.695647 15640 external_mini_cluster.cc:1428] Setting key 978b79a5a183b0523aa65a7991a68ee7
I20260811 00:56:08.695967 31804 ts_manager.cc:194] Registered new tserver with Master: 7fc9cfbf850b4c33a53113198356f5e7 (127.15.70.1:34173)
I20260811 00:56:08.696923 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.2:0
--local_ip_for_outbound_sockets=127.15.70.2
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:40453
--builtin_ntp_servers=127.15.70.20:39055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 00:56:08.808122 32096 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:56:08.808490 32096 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:56:08.808537 32096 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:56:08.810127 32096 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:56:08.810232 32096 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:56:08.810285 32096 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.2
I20260811 00:56:08.812148 32096 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:39055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:40453
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32096
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.2
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:56:08.812646 32096 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:56:08.813135 32096 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:56:08.819918 32108 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:56:08.819984 32096 server_base.cc:1034] running on GCE node
W20260811 00:56:08.820102 32113 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:56:08.819866 32104 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:56:08.820366 32096 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:56:08.820690 32096 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:56:08.821856 32096 hybrid_clock.cc:648] HybridClock initialized: now 1786409768821827 us; error 43 us; skew 500 ppm
I20260811 00:56:08.823619 32096 webserver.cc:460] Webserver started at http://127.15.70.2:46115/ using document root <none> and password file <none>
I20260811 00:56:08.823956 32096 fs_manager.cc:359] Metadata directory not provided
I20260811 00:56:08.824139 32096 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:56:08.824381 32096 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:56:08.825699 32096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/data/instance:
uuid: "13fb7f2690074216a3649230072a3b4b"
format_stamp: "Formatted at 2026-08-11 00:56:08 on dist-test-slave-h3ft"
server_key: "08cb3206880128994fedc10202761c85"
server_key_iv: "914b3a6573d1d627e60ec805dd9461dd"
server_key_version: "encryptionkey@0"
I20260811 00:56:08.826246 32096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance:
uuid: "13fb7f2690074216a3649230072a3b4b"
format_stamp: "Formatted at 2026-08-11 00:56:08 on dist-test-slave-h3ft"
server_key: "08cb3206880128994fedc10202761c85"
server_key_iv: "914b3a6573d1d627e60ec805dd9461dd"
server_key_version: "encryptionkey@0"
I20260811 00:56:08.828001 32096 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260811 00:56:08.828986 32123 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:56:08.829296 32096 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:56:08.829402 32096 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/wal
uuid: "13fb7f2690074216a3649230072a3b4b"
format_stamp: "Formatted at 2026-08-11 00:56:08 on dist-test-slave-h3ft"
server_key: "08cb3206880128994fedc10202761c85"
server_key_iv: "914b3a6573d1d627e60ec805dd9461dd"
server_key_version: "encryptionkey@0"
I20260811 00:56:08.829530 32096 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:56:08.833865 32096 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:56:08.834249 32096 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:56:08.834427 32096 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:56:08.834723 32096 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:56:08.835206 32096 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:56:08.835263 32096 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:56:08.835311 32096 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:56:08.835337 32096 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:56:08.843823 32096 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.2:37755
I20260811 00:56:08.844403 32096 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
I20260811 00:56:08.845500 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 32096
I20260811 00:56:08.845633 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance
I20260811 00:56:08.845858 15640 external_mini_cluster.cc:1428] Setting key 22e1182ca22b02b365c7eb28285c36af
I20260811 00:56:08.853935 32323 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.2:37755 every 8 connection(s)
I20260811 00:56:08.855567 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.3:0
--local_ip_for_outbound_sockets=127.15.70.3
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:40453
--builtin_ntp_servers=127.15.70.20:39055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260811 00:56:08.864435 31862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:08.860789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:35521 (local address 127.15.70.62:40453)
0811 00:56:08.860846 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 00:56:08.860849 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:56:08.860970 (+ 121us) server_negotiation.cc:407] Connection header received
0811 00:56:08.861847 (+ 877us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:56:08.861850 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:56:08.861860 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:56:08.861898 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:56:08.864034 (+ 2136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:56:08.864038 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:56:08.864038 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:56:08.864045 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:56:08.864069 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:56:08.864077 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:56:08.864115 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0811 00:56:08.864279 (+ 164us) server_negotiation.cc:299] Negotiation successful
0811 00:56:08.864303 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 00:56:08.865443 32334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:08.860414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:40453 (local address 127.15.70.2:35521)
0811 00:56:08.860753 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0811 00:56:08.860826 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0811 00:56:08.861685 (+ 859us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:56:08.862168 (+ 483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:56:08.862173 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:56:08.862186 (+ 13us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:56:08.863741 (+ 1555us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:56:08.863742 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:56:08.863808 (+ 66us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:56:08.863873 (+ 65us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:56:08.864166 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:56:08.864174 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:56:08.864180 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 00:56:08.864955 (+ 775us) client_negotiation.cc:240] Negotiation successful
0811 00:56:08.865081 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":146,"threads_started":1}
I20260811 00:56:08.866470 32324 heartbeater.cc:347] Connected to a master server at 127.15.70.62:40453
I20260811 00:56:08.866678 32324 heartbeater.cc:464] Registering TS with master...
I20260811 00:56:08.866937 32324 heartbeater.cc:511] Master 127.15.70.62:40453 requested a full tablet report, sending...
I20260811 00:56:08.867671 31802 ts_manager.cc:194] Registered new tserver with Master: 13fb7f2690074216a3649230072a3b4b (127.15.70.2:37755)
W20260811 00:56:08.990082 32328 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:56:08.990451 32328 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:56:08.990504 32328 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:56:08.992555 32328 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:56:08.992694 32328 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:56:08.992755 32328 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.3
I20260811 00:56:08.994843 32328 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:39055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:40453
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32328
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.3
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:56:08.995352 32328 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:56:08.995824 32328 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:56:09.003345 32346 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:56:09.003345 32342 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:56:09.003345 32340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:56:09.004208 32328 server_base.cc:1034] running on GCE node
I20260811 00:56:09.004556 32328 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:56:09.005146 32328 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:56:09.006364 32328 hybrid_clock.cc:648] HybridClock initialized: now 1786409769006345 us; error 48 us; skew 500 ppm
I20260811 00:56:09.008575 32328 webserver.cc:460] Webserver started at http://127.15.70.3:43467/ using document root <none> and password file <none>
I20260811 00:56:09.008929 32328 fs_manager.cc:359] Metadata directory not provided
I20260811 00:56:09.008992 32328 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:56:09.009224 32328 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:56:09.010848 32328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/data/instance:
uuid: "836e1703702a4c5f960c996cf4cfb9f4"
format_stamp: "Formatted at 2026-08-11 00:56:09 on dist-test-slave-h3ft"
server_key: "ffde7cc8046e70e432a5c8a751284050"
server_key_iv: "ef436c0b656e6656f51bdb40c845d8f1"
server_key_version: "encryptionkey@0"
I20260811 00:56:09.011466 32328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance:
uuid: "836e1703702a4c5f960c996cf4cfb9f4"
format_stamp: "Formatted at 2026-08-11 00:56:09 on dist-test-slave-h3ft"
server_key: "ffde7cc8046e70e432a5c8a751284050"
server_key_iv: "ef436c0b656e6656f51bdb40c845d8f1"
server_key_version: "encryptionkey@0"
I20260811 00:56:09.013447 32328 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 00:56:09.014884 32357 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:56:09.015214 32328 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:56:09.015363 32328 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/wal
uuid: "836e1703702a4c5f960c996cf4cfb9f4"
format_stamp: "Formatted at 2026-08-11 00:56:09 on dist-test-slave-h3ft"
server_key: "ffde7cc8046e70e432a5c8a751284050"
server_key_iv: "ef436c0b656e6656f51bdb40c845d8f1"
server_key_version: "encryptionkey@0"
I20260811 00:56:09.015486 32328 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:56:09.019860 32328 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:56:09.020275 32328 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:56:09.020475 32328 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:56:09.020771 32328 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:56:09.021222 32328 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:56:09.021286 32328 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:56:09.021335 32328 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:56:09.021364 32328 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:56:09.029452 32328 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.3:36095
I20260811 00:56:09.029498 32547 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.3:36095 every 8 connection(s)
I20260811 00:56:09.030138 32328 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
I20260811 00:56:09.030773 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 32328
I20260811 00:56:09.030900 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance
I20260811 00:56:09.031193 15640 external_mini_cluster.cc:1428] Setting key d5f456e22e445ace188fe28d7b026a7a
I20260811 00:56:09.034796 31862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:09.031313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:57667 (local address 127.15.70.62:40453)
0811 00:56:09.031396 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 00:56:09.031400 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:56:09.031813 (+ 413us) server_negotiation.cc:407] Connection header received
0811 00:56:09.032670 (+ 857us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:56:09.032672 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:56:09.032682 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:56:09.032753 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:56:09.034458 (+ 1705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:56:09.034460 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:56:09.034460 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:56:09.034466 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:56:09.034489 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:56:09.034494 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:56:09.034559 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 00:56:09.034686 (+ 127us) server_negotiation.cc:299] Negotiation successful
0811 00:56:09.034707 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 00:56:09.035006 32550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:09.031343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:40453 (local address 127.15.70.3:57667)
0811 00:56:09.031624 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0811 00:56:09.031681 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 00:56:09.032500 (+ 819us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:56:09.032927 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:56:09.032933 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:56:09.032946 (+ 13us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:56:09.034259 (+ 1313us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:56:09.034260 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:56:09.034299 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:56:09.034340 (+ 41us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:56:09.034571 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:56:09.034577 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:56:09.034582 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 00:56:09.034654 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 00:56:09.034725 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":119,"threads_started":1}
I20260811 00:56:09.035811 32548 heartbeater.cc:347] Connected to a master server at 127.15.70.62:40453
I20260811 00:56:09.035941 32548 heartbeater.cc:464] Registering TS with master...
I20260811 00:56:09.036170 32548 heartbeater.cc:511] Master 127.15.70.62:40453 requested a full tablet report, sending...
I20260811 00:56:09.036779 31802 ts_manager.cc:194] Registered new tserver with Master: 836e1703702a4c5f960c996cf4cfb9f4 (127.15.70.3:36095)
I20260811 00:56:09.044319 15640 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 00:56:09.047158 31862 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:56:09.046299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47256 (local address 127.15.70.62:40453)
0811 00:56:09.046379 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 00:56:09.046382 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:56:09.046552 (+ 170us) server_negotiation.cc:407] Connection header received
0811 00:56:09.046590 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:56:09.046591 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:56:09.046599 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:56:09.046651 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:56:09.046927 (+ 276us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47256: BlockingRecv error: recv got EOF from 127.0.0.1:47256 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 00:56:09.047210 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 31893
I20260811 00:56:09.072553 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 32096
I20260811 00:56:09.132864 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 32328
I20260811 00:56:09.151695 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 31750
2026-08-11T00:56:09Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (837 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:56:09 dist-test-slave-h3ft krb5kdc[32568](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:56:09 dist-test-slave-h3ft krb5kdc[32568](info): set up 2 sockets
Aug 11 00:56:09 dist-test-slave-h3ft krb5kdc[32568](info): commencing operation
krb5kdc: starting...
W20260811 00:56:10.527485 15640 mini_kdc.cc:121] Time spent starting KDC: real 1.345s user 0.000s sys 0.010s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Aug 11 00:56:10 dist-test-slave-h3ft krb5kdc[32568](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409770, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:56:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:56:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.70.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
I20260811 00:56:10.695765 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:35099
--webserver_interface=127.15.70.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:36141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:35099
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:56:10.800096 32591 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:56:10.800467 32591 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:56:10.800504 32591 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:56:10.802098 32591 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:56:10.802178 32591 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:56:10.802194 32591 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:56:10.802208 32591 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:56:10.802220 32591 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:56:10.804327 32591 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:36141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:35099
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:35099
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32591
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:56:10.804750 32591 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:56:10.805105 32591 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:56:10.811488 32602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:56:10.811508 32604 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:56:10.811514 32609 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:56:10.811787 32591 server_base.cc:1034] running on GCE node
I20260811 00:56:10.812201 32591 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:56:10.812613 32591 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:56:10.813796 32591 hybrid_clock.cc:648] HybridClock initialized: now 1786409770813765 us; error 57 us; skew 500 ppm
Aug 11 00:56:10 dist-test-slave-h3ft krb5kdc[32568](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409770, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:56:10.817238 32591 init.cc:377] Logged in from keytab as kudu/127.15.70.62@KRBTEST.COM (short username kudu)
I20260811 00:56:10.817945 32591 webserver.cc:460] Webserver started at http://127.15.70.62:42723/ using document root <none> and password file <none>
I20260811 00:56:10.818280 32591 fs_manager.cc:359] Metadata directory not provided
I20260811 00:56:10.818363 32591 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:56:10.818549 32591 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:56:10.820041 32591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "e2b7b591da3d448dacd2fd42c6d74e75"
format_stamp: "Formatted at 2026-08-11 00:56:10 on dist-test-slave-h3ft"
server_key: "77f2ae34685e9ea71eb00b2cf7778562"
server_key_iv: "cb9bfe23687d5272d88ab75277aace51"
server_key_version: "encryptionkey@0"
I20260811 00:56:10.820533 32591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "e2b7b591da3d448dacd2fd42c6d74e75"
format_stamp: "Formatted at 2026-08-11 00:56:10 on dist-test-slave-h3ft"
server_key: "77f2ae34685e9ea71eb00b2cf7778562"
server_key_iv: "cb9bfe23687d5272d88ab75277aace51"
server_key_version: "encryptionkey@0"
I20260811 00:56:10.822367 32591 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.002s
I20260811 00:56:10.823529 32619 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:56:10.823833 32591 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 00:56:10.823982 32591 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "e2b7b591da3d448dacd2fd42c6d74e75"
format_stamp: "Formatted at 2026-08-11 00:56:10 on dist-test-slave-h3ft"
server_key: "77f2ae34685e9ea71eb00b2cf7778562"
server_key_iv: "cb9bfe23687d5272d88ab75277aace51"
server_key_version: "encryptionkey@0"
I20260811 00:56:10.824091 32591 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:56:10.853303 32591 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:56:10.856462 32591 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:56:10.856689 32591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:56:10.862351 32591 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:35099
I20260811 00:56:10.862428 32703 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:35099 every 8 connection(s)
I20260811 00:56:10.862946 32591 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:56:10.864528 32706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:56:10.865109 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 32591
I20260811 00:56:10.865252 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 00:56:10.865486 15640 external_mini_cluster.cc:1428] Setting key 5dd8841e4274b48d349a2106dd5daf48
I20260811 00:56:10.869066 32706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2b7b591da3d448dacd2fd42c6d74e75: Bootstrap starting.
I20260811 00:56:10.869997 32706 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e2b7b591da3d448dacd2fd42c6d74e75: Neither blocks nor log segments found. Creating new log.
I20260811 00:56:10.870396 32706 log.cc:824] T 00000000000000000000000000000000 P e2b7b591da3d448dacd2fd42c6d74e75: Log is configured to *not* fsync() on all Append() calls
I20260811 00:56:10.871381 32706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2b7b591da3d448dacd2fd42c6d74e75: No bootstrap required, opened a new log
Aug 11 00:56:10 dist-test-slave-h3ft krb5kdc[32568](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409770, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:56:10.874671 32706 raft_consensus.cc:348] T 00000000000000000000000000000000 P e2b7b591da3d448dacd2fd42c6d74e75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2b7b591da3d448dacd2fd42c6d74e75" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 35099 } }
I20260811 00:56:10.874864 32706 raft_consensus.cc:374] T 00000000000000000000000000000000 P e2b7b591da3d448dacd2fd42c6d74e75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:56:10.874892 32706 raft_consensus.cc:729] T 00000000000000000000000000000000 P e2b7b591da3d448dacd2fd42c6d74e75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2b7b591da3d448dacd2fd42c6d74e75, State: Initialized, Role: FOLLOWER
I20260811 00:56:10.875110 32706 consensus_queue.cc:260] T 00000000000000000000000000000000 P e2b7b591da3d448dacd2fd42c6d74e75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2b7b591da3d448dacd2fd42c6d74e75" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 35099 } }
I20260811 00:56:10.875245 32706 raft_consensus.cc:388] T 00000000000000000000000000000000 P e2b7b591da3d448dacd2fd42c6d74e75 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:56:10.875303 32706 raft_consensus.cc:482] T 00000000000000000000000000000000 P e2b7b591da3d448dacd2fd42c6d74e75 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:56:10.875392 32706 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e2b7b591da3d448dacd2fd42c6d74e75 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:56:10.876216 32706 raft_consensus.cc:504] T 00000000000000000000000000000000 P e2b7b591da3d448dacd2fd42c6d74e75 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2b7b591da3d448dacd2fd42c6d74e75" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 35099 } }
I20260811 00:56:10.876367 32706 leader_election.cc:302] T 00000000000000000000000000000000 P e2b7b591da3d448dacd2fd42c6d74e75 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e2b7b591da3d448dacd2fd42c6d74e75; no voters:
I20260811 00:56:10.876683 32706 leader_election.cc:288] T 00000000000000000000000000000000 P e2b7b591da3d448dacd2fd42c6d74e75 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:56:10.876832 32715 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e2b7b591da3d448dacd2fd42c6d74e75 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:56:10.877158 32706 sys_catalog.cc:564] T 00000000000000000000000000000000 P e2b7b591da3d448dacd2fd42c6d74e75 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:56:10.877194 32715 raft_consensus.cc:686] T 00000000000000000000000000000000 P e2b7b591da3d448dacd2fd42c6d74e75 [term 1 LEADER]: Becoming Leader. State: Replica: e2b7b591da3d448dacd2fd42c6d74e75, State: Running, Role: LEADER
I20260811 00:56:10.877456 32715 consensus_queue.cc:237] T 00000000000000000000000000000000 P e2b7b591da3d448dacd2fd42c6d74e75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2b7b591da3d448dacd2fd42c6d74e75" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 35099 } }
I20260811 00:56:10.878201 32718 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2b7b591da3d448dacd2fd42c6d74e75 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e2b7b591da3d448dacd2fd42c6d74e75" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2b7b591da3d448dacd2fd42c6d74e75" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 35099 } } }
I20260811 00:56:10.878309 32718 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2b7b591da3d448dacd2fd42c6d74e75 [sys.catalog]: This master's current role is: LEADER
I20260811 00:56:10.878820 32722 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2b7b591da3d448dacd2fd42c6d74e75 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e2b7b591da3d448dacd2fd42c6d74e75. Latest consensus state: current_term: 1 leader_uuid: "e2b7b591da3d448dacd2fd42c6d74e75" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2b7b591da3d448dacd2fd42c6d74e75" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 35099 } } }
I20260811 00:56:10.878924 32722 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2b7b591da3d448dacd2fd42c6d74e75 [sys.catalog]: This master's current role is: LEADER
W20260811 00:56:10.879961 32739 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e2b7b591da3d448dacd2fd42c6d74e75: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 00:56:10.880070 32739 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 00:56:10.880162 32730 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:56:10.880410 32730 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:56:10.880491 32712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:10.866283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51572 (local address 127.15.70.62:35099)
0811 00:56:10.866538 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0811 00:56:10.866558 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 00:56:10.866600 (+ 42us) server_negotiation.cc:407] Connection header received
0811 00:56:10.867236 (+ 636us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:56:10.867246 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:56:10.867313 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:56:10.867477 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:56:10.868587 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:10.869913 (+ 1326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:10.871111 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:10.871640 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:10.871744 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:10.875146 (+ 3402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:56:10.875151 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:56:10.875151 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:56:10.875166 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:56:10.877822 (+ 2656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:56:10.878487 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:56:10.878492 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:56:10.878492 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:56:10.878648 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:56:10.878985 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:56:10.878986 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:56:10.878987 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:56:10.879478 (+ 491us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:56:10.879672 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0811 00:56:10.879866 (+ 194us) server_negotiation.cc:299] Negotiation successful
0811 00:56:10.880220 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":126,"threads_started":1}
I20260811 00:56:10.882503 32730 catalog_manager.cc:1347] Generated new cluster ID: a0f43265f2ad4c3face822587ee79c98
I20260811 00:56:10.882575 32730 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:56:10.902070 32730 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:56:10.903178 32730 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:56:10.910100 32730 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e2b7b591da3d448dacd2fd42c6d74e75: Generated new TSK 0
I20260811 00:56:10.910480 32730 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.70.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab.
Entry for principal kudu/127.15.70.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab.
I20260811 00:56:10.956496 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.1:0
--local_ip_for_outbound_sockets=127.15.70.1
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:35099
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:36141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:56:11.072299 32747 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:56:11.072705 32747 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:56:11.072759 32747 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:56:11.074400 32747 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:56:11.074508 32747 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:56:11.074568 32747 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.1
I20260811 00:56:11.076812 32747 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:36141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:35099
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32747
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.1
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:56:11.077226 32747 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:56:11.077571 32747 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:56:11.084884 32758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:56:11.084928 32757 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:56:11.084884 32760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:56:11.085790 32747 server_base.cc:1034] running on GCE node
I20260811 00:56:11.086103 32747 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:56:11.086440 32747 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:56:11.087668 32747 hybrid_clock.cc:648] HybridClock initialized: now 1786409771087632 us; error 46 us; skew 500 ppm
Aug 11 00:56:11 dist-test-slave-h3ft krb5kdc[32568](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409771, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:56:11.092042 32747 init.cc:377] Logged in from keytab as kudu/127.15.70.1@KRBTEST.COM (short username kudu)
I20260811 00:56:11.092881 32747 webserver.cc:460] Webserver started at http://127.15.70.1:42233/ using document root <none> and password file <none>
I20260811 00:56:11.093267 32747 fs_manager.cc:359] Metadata directory not provided
I20260811 00:56:11.093361 32747 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:56:11.093568 32747 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:56:11.095230 32747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/data/instance:
uuid: "d552888526064243999f6c9f1d20b5e9"
format_stamp: "Formatted at 2026-08-11 00:56:11 on dist-test-slave-h3ft"
server_key: "670ec1c04c0069f6b05e0e4684d45e8d"
server_key_iv: "58844803ec5d70ab24d966838f222a1d"
server_key_version: "encryptionkey@0"
I20260811 00:56:11.095813 32747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance:
uuid: "d552888526064243999f6c9f1d20b5e9"
format_stamp: "Formatted at 2026-08-11 00:56:11 on dist-test-slave-h3ft"
server_key: "670ec1c04c0069f6b05e0e4684d45e8d"
server_key_iv: "58844803ec5d70ab24d966838f222a1d"
server_key_version: "encryptionkey@0"
I20260811 00:56:11.097927 32747 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 00:56:11.099761 307 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:56:11.100411 32747 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 00:56:11.100595 32747 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/wal
uuid: "d552888526064243999f6c9f1d20b5e9"
format_stamp: "Formatted at 2026-08-11 00:56:11 on dist-test-slave-h3ft"
server_key: "670ec1c04c0069f6b05e0e4684d45e8d"
server_key_iv: "58844803ec5d70ab24d966838f222a1d"
server_key_version: "encryptionkey@0"
I20260811 00:56:11.100771 32747 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:56:11.115556 32747 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:56:11.124331 32747 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:56:11.124642 32747 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:56:11.125017 32747 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:56:11.125502 32747 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:56:11.125568 32747 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:56:11.125617 32747 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:56:11.125648 32747 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:56:11.134634 32747 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.1:41727
I20260811 00:56:11.134714 487 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.1:41727 every 8 connection(s)
I20260811 00:56:11.135267 32747 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
I20260811 00:56:11.136425 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 32747
I20260811 00:56:11.136571 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance
I20260811 00:56:11.136843 15640 external_mini_cluster.cc:1428] Setting key 4d24ebea662a43dc9a74246caefe74a7
Aug 11 00:56:11 dist-test-slave-h3ft krb5kdc[32568](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409771, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.70.2@KRBTEST.COM; defaulting to no policy
I20260811 00:56:11.149796 32712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:11.136466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:51389 (local address 127.15.70.62:35099)
0811 00:56:11.136572 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0811 00:56:11.136575 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:56:11.136862 (+ 287us) server_negotiation.cc:407] Connection header received
0811 00:56:11.137721 (+ 859us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:56:11.137722 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:56:11.137738 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:56:11.137794 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:56:11.139570 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:11.140285 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:11.141637 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:11.142017 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:11.142111 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:11.145305 (+ 3194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:56:11.145308 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:56:11.145309 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:56:11.145323 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:56:11.147591 (+ 2268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:56:11.148305 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:56:11.148307 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:56:11.148308 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:56:11.148387 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:56:11.148778 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:56:11.148780 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:56:11.148780 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:56:11.149004 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:56:11.149095 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 00:56:11.149507 (+ 412us) server_negotiation.cc:299] Negotiation successful
0811 00:56:11.149656 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 00:56:11.150171 493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:11.136428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35099 (local address 127.15.70.1:51389)
0811 00:56:11.136668 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0811 00:56:11.136727 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 00:56:11.137603 (+ 876us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:56:11.137882 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:56:11.137888 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:56:11.138974 (+ 1086us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:56:11.139396 (+ 422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:11.139405 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:11.140452 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:11.140455 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:11.141509 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:11.141512 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:11.142181 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:11.142182 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:11.142341 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:11.143249 (+ 908us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:56:11.143260 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:56:11.145150 (+ 1890us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:56:11.147743 (+ 2593us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:56:11.147759 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:56:11.147763 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:56:11.148195 (+ 432us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:56:11.148496 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:56:11.148504 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:56:11.148504 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:56:11.148686 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:56:11.149095 (+ 409us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:56:11.149104 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:56:11.149309 (+ 205us) client_negotiation.cc:769] Sending connection context
0811 00:56:11.149452 (+ 143us) client_negotiation.cc:240] Negotiation successful
0811 00:56:11.149739 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":142,"threads_started":1}
I20260811 00:56:11.151186 489 heartbeater.cc:347] Connected to a master server at 127.15.70.62:35099
I20260811 00:56:11.151361 489 heartbeater.cc:464] Registering TS with master...
I20260811 00:56:11.151654 489 heartbeater.cc:511] Master 127.15.70.62:35099 requested a full tablet report, sending...
I20260811 00:56:11.152664 32648 ts_manager.cc:194] Registered new tserver with Master: d552888526064243999f6c9f1d20b5e9 (127.15.70.1:41727)
I20260811 00:56:11.153497 32648 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.1@KRBTEST.COM'} at 127.15.70.1:51389
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab.
Entry for principal kudu/127.15.70.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab.
I20260811 00:56:11.179558 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.2:0
--local_ip_for_outbound_sockets=127.15.70.2
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:35099
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:36141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:56:11.296074 497 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:56:11.296447 497 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:56:11.296485 497 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:56:11.298535 497 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:56:11.298646 497 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:56:11.298693 497 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.2
I20260811 00:56:11.301110 497 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:36141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:35099
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.497
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.2
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:56:11.301561 497 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:56:11.301944 497 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:56:11.309283 505 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:56:11.309410 508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:56:11.309312 503 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:56:11.309873 497 server_base.cc:1034] running on GCE node
I20260811 00:56:11.310199 497 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:56:11.310570 497 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:56:11.311754 497 hybrid_clock.cc:648] HybridClock initialized: now 1786409771311734 us; error 42 us; skew 500 ppm
Aug 11 00:56:11 dist-test-slave-h3ft krb5kdc[32568](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409771, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:56:11.315611 497 init.cc:377] Logged in from keytab as kudu/127.15.70.2@KRBTEST.COM (short username kudu)
I20260811 00:56:11.316187 497 webserver.cc:460] Webserver started at http://127.15.70.2:36477/ using document root <none> and password file <none>
I20260811 00:56:11.316496 497 fs_manager.cc:359] Metadata directory not provided
I20260811 00:56:11.316558 497 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:56:11.316723 497 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:56:11.318110 497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/data/instance:
uuid: "da483da8c58e434393d274efb9d97e27"
format_stamp: "Formatted at 2026-08-11 00:56:11 on dist-test-slave-h3ft"
server_key: "2e8c7de94a86f48c2b1fe2c600421be9"
server_key_iv: "4361d859247bd88ab8d3b3a7b3bfb39f"
server_key_version: "encryptionkey@0"
I20260811 00:56:11.318583 497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance:
uuid: "da483da8c58e434393d274efb9d97e27"
format_stamp: "Formatted at 2026-08-11 00:56:11 on dist-test-slave-h3ft"
server_key: "2e8c7de94a86f48c2b1fe2c600421be9"
server_key_iv: "4361d859247bd88ab8d3b3a7b3bfb39f"
server_key_version: "encryptionkey@0"
I20260811 00:56:11.320690 497 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260811 00:56:11.321815 519 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:56:11.322213 497 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:56:11.322350 497 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/wal
uuid: "da483da8c58e434393d274efb9d97e27"
format_stamp: "Formatted at 2026-08-11 00:56:11 on dist-test-slave-h3ft"
server_key: "2e8c7de94a86f48c2b1fe2c600421be9"
server_key_iv: "4361d859247bd88ab8d3b3a7b3bfb39f"
server_key_version: "encryptionkey@0"
I20260811 00:56:11.322451 497 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:56:11.333209 497 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:56:11.336328 497 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:56:11.336534 497 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:56:11.336892 497 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:56:11.337306 497 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:56:11.337368 497 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:56:11.337409 497 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:56:11.337459 497 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:56:11.345047 497 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.2:38909
I20260811 00:56:11.345129 716 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.2:38909 every 8 connection(s)
I20260811 00:56:11.345582 497 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
I20260811 00:56:11.349545 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 497
I20260811 00:56:11.349700 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance
I20260811 00:56:11.349934 15640 external_mini_cluster.cc:1428] Setting key 04a657c360acdea60135c8ec2a6831c3
Aug 11 00:56:11 dist-test-slave-h3ft krb5kdc[32568](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409771, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:56:11.358672 32712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:11.346720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:36499 (local address 127.15.70.62:35099)
0811 00:56:11.346800 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 00:56:11.346803 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:56:11.347083 (+ 280us) server_negotiation.cc:407] Connection header received
0811 00:56:11.347740 (+ 657us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:56:11.347743 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:56:11.347757 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:56:11.347832 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:56:11.349022 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:11.349613 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:11.351006 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:11.351401 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:11.351501 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:11.354845 (+ 3344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:56:11.354847 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:56:11.354847 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:56:11.354857 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:56:11.356641 (+ 1784us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:56:11.357341 (+ 700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:56:11.357343 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:56:11.357343 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:56:11.357410 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:56:11.357773 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:56:11.357774 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:56:11.357775 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:56:11.357974 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:56:11.358054 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 00:56:11.358481 (+ 427us) server_negotiation.cc:299] Negotiation successful
0811 00:56:11.358578 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 00:56:11.359131 719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:11.346669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35099 (local address 127.15.70.2:36499)
0811 00:56:11.346858 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 00:56:11.346912 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 00:56:11.347622 (+ 710us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:56:11.347914 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:56:11.347918 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:56:11.348647 (+ 729us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:56:11.348904 (+ 257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:11.348910 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:11.349745 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:11.349746 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:11.350820 (+ 1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:11.350823 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:11.351525 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:11.351526 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:11.351660 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:11.352429 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:56:11.352439 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:56:11.354691 (+ 2252us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:56:11.356756 (+ 2065us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:56:11.356769 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:56:11.356773 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:56:11.357245 (+ 472us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:56:11.357490 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:56:11.357491 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:56:11.357491 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:56:11.357696 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:56:11.358061 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:56:11.358070 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:56:11.358311 (+ 241us) client_negotiation.cc:769] Sending connection context
0811 00:56:11.358459 (+ 148us) client_negotiation.cc:240] Negotiation successful
0811 00:56:11.358715 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":104,"threads_started":1}
I20260811 00:56:11.359891 717 heartbeater.cc:347] Connected to a master server at 127.15.70.62:35099
I20260811 00:56:11.360049 717 heartbeater.cc:464] Registering TS with master...
I20260811 00:56:11.360312 717 heartbeater.cc:511] Master 127.15.70.62:35099 requested a full tablet report, sending...
I20260811 00:56:11.360849 32648 ts_manager.cc:194] Registered new tserver with Master: da483da8c58e434393d274efb9d97e27 (127.15.70.2:38909)
I20260811 00:56:11.361315 32648 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.2@KRBTEST.COM'} at 127.15.70.2:36499
WARNING: no policy specified for kudu/127.15.70.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab.
Entry for principal kudu/127.15.70.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab.
I20260811 00:56:11.391207 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.3:0
--local_ip_for_outbound_sockets=127.15.70.3
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:35099
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:36141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:56:11.499083 731 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:56:11.499385 731 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:56:11.499426 731 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:56:11.500777 731 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:56:11.500830 731 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:56:11.500861 731 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.3
I20260811 00:56:11.502573 731 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:36141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:35099
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.731
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.3
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:56:11.502861 731 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:56:11.503155 731 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:56:11.509570 748 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:56:11.509577 744 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:56:11.509788 731 server_base.cc:1034] running on GCE node
W20260811 00:56:11.509572 742 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:56:11.510215 731 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:56:11.510543 731 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:56:11.511722 731 hybrid_clock.cc:648] HybridClock initialized: now 1786409771511686 us; error 49 us; skew 500 ppm
Aug 11 00:56:11 dist-test-slave-h3ft krb5kdc[32568](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409771, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:56:11.515367 731 init.cc:377] Logged in from keytab as kudu/127.15.70.3@KRBTEST.COM (short username kudu)
I20260811 00:56:11.515959 731 webserver.cc:460] Webserver started at http://127.15.70.3:37111/ using document root <none> and password file <none>
I20260811 00:56:11.516307 731 fs_manager.cc:359] Metadata directory not provided
I20260811 00:56:11.516366 731 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:56:11.516537 731 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:56:11.517915 731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/data/instance:
uuid: "7ef0b95389804cef9cc0c377816fc46a"
format_stamp: "Formatted at 2026-08-11 00:56:11 on dist-test-slave-h3ft"
server_key: "21d4070b943b726091fd7bb3d43d7fd3"
server_key_iv: "f6e6f73bd7620a8813c3e72aecba2dfc"
server_key_version: "encryptionkey@0"
I20260811 00:56:11.518362 731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance:
uuid: "7ef0b95389804cef9cc0c377816fc46a"
format_stamp: "Formatted at 2026-08-11 00:56:11 on dist-test-slave-h3ft"
server_key: "21d4070b943b726091fd7bb3d43d7fd3"
server_key_iv: "f6e6f73bd7620a8813c3e72aecba2dfc"
server_key_version: "encryptionkey@0"
I20260811 00:56:11.520376 731 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260811 00:56:11.521502 761 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:56:11.521783 731 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:56:11.521903 731 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/wal
uuid: "7ef0b95389804cef9cc0c377816fc46a"
format_stamp: "Formatted at 2026-08-11 00:56:11 on dist-test-slave-h3ft"
server_key: "21d4070b943b726091fd7bb3d43d7fd3"
server_key_iv: "f6e6f73bd7620a8813c3e72aecba2dfc"
server_key_version: "encryptionkey@0"
I20260811 00:56:11.521999 731 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:56:11.530578 731 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:56:11.533902 731 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:56:11.534170 731 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:56:11.534539 731 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:56:11.534978 731 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:56:11.535084 731 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:56:11.535137 731 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:56:11.535161 731 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:56:11.543118 731 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.3:33851
I20260811 00:56:11.543164 959 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.3:33851 every 8 connection(s)
I20260811 00:56:11.543634 731 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
I20260811 00:56:11.550508 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 731
I20260811 00:56:11.550683 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance
I20260811 00:56:11.550979 15640 external_mini_cluster.cc:1428] Setting key 0bfe2d21be11584abbd75199fe1755f9
Aug 11 00:56:11 dist-test-slave-h3ft krb5kdc[32568](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409771, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:56:11.556455 32712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:11.544767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:56679 (local address 127.15.70.62:35099)
0811 00:56:11.544927 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 00:56:11.544930 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:56:11.545122 (+ 192us) server_negotiation.cc:407] Connection header received
0811 00:56:11.545885 (+ 763us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:56:11.545887 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:56:11.545906 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:56:11.545997 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:56:11.547361 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:11.548043 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:11.549315 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:11.549555 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:11.549668 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:11.552804 (+ 3136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:56:11.552806 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:56:11.552807 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:56:11.552817 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:56:11.554642 (+ 1825us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:56:11.555300 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:56:11.555301 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:56:11.555302 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:56:11.555371 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:56:11.555696 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:56:11.555696 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:56:11.555697 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:56:11.555838 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:56:11.555894 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 00:56:11.556266 (+ 372us) server_negotiation.cc:299] Negotiation successful
0811 00:56:11.556363 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 00:56:11.556679 962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:11.544686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35099 (local address 127.15.70.3:56679)
0811 00:56:11.544928 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0811 00:56:11.544990 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 00:56:11.545719 (+ 729us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:56:11.546093 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:56:11.546099 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:56:11.546872 (+ 773us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:56:11.547227 (+ 355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:11.547235 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:11.548192 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:11.548194 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:11.549180 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:11.549183 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:11.549700 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:11.549701 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:11.549864 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:11.550619 (+ 755us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:56:11.550636 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:56:11.552688 (+ 2052us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:56:11.554753 (+ 2065us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:56:11.554761 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:56:11.554764 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:56:11.555217 (+ 453us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:56:11.555471 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:56:11.555472 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:56:11.555472 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:56:11.555619 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:56:11.555944 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:56:11.555950 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:56:11.556118 (+ 168us) client_negotiation.cc:769] Sending connection context
0811 00:56:11.556214 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 00:56:11.556387 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":84,"threads_started":1}
I20260811 00:56:11.557385 960 heartbeater.cc:347] Connected to a master server at 127.15.70.62:35099
I20260811 00:56:11.557516 960 heartbeater.cc:464] Registering TS with master...
I20260811 00:56:11.557722 960 heartbeater.cc:511] Master 127.15.70.62:35099 requested a full tablet report, sending...
I20260811 00:56:11.558295 32648 ts_manager.cc:194] Registered new tserver with Master: 7ef0b95389804cef9cc0c377816fc46a (127.15.70.3:33851)
I20260811 00:56:11.558749 32648 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.3@KRBTEST.COM'} at 127.15.70.3:56679
I20260811 00:56:11.563591 15640 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 00:56:11.574093 32712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:11.565612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51586 (local address 127.15.70.62:35099)
0811 00:56:11.565727 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0811 00:56:11.565730 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:56:11.565895 (+ 165us) server_negotiation.cc:407] Connection header received
0811 00:56:11.566031 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:56:11.566032 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:56:11.566054 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:56:11.566138 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:56:11.566934 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:11.567611 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:11.568502 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:11.568726 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:11.568832 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:11.570735 (+ 1903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:56:11.570737 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:56:11.570738 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:56:11.570748 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:56:11.572465 (+ 1717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:56:11.572956 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:56:11.572958 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:56:11.572958 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:56:11.573044 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:56:11.573274 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:56:11.573275 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:56:11.573276 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:56:11.573543 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:56:11.573662 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 00:56:11.573776 (+ 114us) server_negotiation.cc:299] Negotiation successful
0811 00:56:11.573880 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 00:56:11.576745 32648 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51586:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:56:11.580150 32648 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:56:11.589339 982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:11.584208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.2:38909 (local address 127.0.0.1:34642)
0811 00:56:11.584701 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0811 00:56:11.584714 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 00:56:11.584780 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:56:11.585167 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:56:11.585171 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:56:11.585174 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:56:11.585304 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:11.585307 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:11.586798 (+ 1491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:11.586799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:11.587887 (+ 1088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:11.587891 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:11.588889 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:11.588890 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:11.589025 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:11.589049 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 00:56:11.589129 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 00:56:11.589207 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":471,"mutex_wait_us":131,"thread_start_us":135,"threads_started":1}
I20260811 00:56:11.589653 980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:11.584503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:33851 (local address 127.0.0.1:52294)
0811 00:56:11.585278 (+ 775us) negotiation.cc:107] Waiting for socket to connect
0811 00:56:11.585288 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:56:11.585351 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:56:11.585549 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:56:11.585550 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:56:11.585553 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:56:11.585624 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:11.585626 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:11.586600 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:11.586601 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:11.588263 (+ 1662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:11.588267 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:11.589369 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:11.589370 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:11.589437 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:11.589442 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 00:56:11.589492 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 00:56:11.589556 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":722,"mutex_wait_us":128,"thread_start_us":102,"threads_started":1}
I20260811 00:56:11.589682 984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:11.584649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48794 (local address 127.15.70.1:41727)
0811 00:56:11.585036 (+ 387us) server_negotiation.cc:206] Beginning negotiation
0811 00:56:11.585041 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:56:11.585051 (+ 10us) server_negotiation.cc:407] Connection header received
0811 00:56:11.585098 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:56:11.585100 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:56:11.585118 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:56:11.585198 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:56:11.585408 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:11.586675 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:11.588399 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:11.589050 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:11.589389 (+ 339us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:11.589476 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 00:56:11.589510 (+ 34us) server_negotiation.cc:299] Negotiation successful
0811 00:56:11.589574 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":345,"thread_start_us":108,"threads_started":1}
I20260811 00:56:11.590076 987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:11.584656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52294 (local address 127.15.70.3:33851)
0811 00:56:11.584925 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0811 00:56:11.584931 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 00:56:11.585359 (+ 428us) server_negotiation.cc:407] Connection header received
0811 00:56:11.585424 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:56:11.585427 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:56:11.585452 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:56:11.585551 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:56:11.585688 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:11.586443 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:11.588375 (+ 1932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:11.589187 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:11.589261 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:11.589329 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 00:56:11.589867 (+ 538us) server_negotiation.cc:299] Negotiation successful
0811 00:56:11.589965 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":213,"thread_start_us":120,"threads_started":1}
I20260811 00:56:11.589993 978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:11.584203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:41727 (local address 127.0.0.1:48794)
0811 00:56:11.584449 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0811 00:56:11.584509 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 00:56:11.584599 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:56:11.585210 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:56:11.585211 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:56:11.585213 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:56:11.585304 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:11.585307 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:11.586913 (+ 1606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:11.586914 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:11.588263 (+ 1349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:11.588267 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:11.589162 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:11.589163 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:11.589230 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:11.589235 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 00:56:11.589267 (+ 32us) client_negotiation.cc:240] Negotiation successful
0811 00:56:11.589309 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":210,"mutex_wait_us":9,"thread_start_us":93,"threads_started":1}
I20260811 00:56:11.590265 981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:11.584347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34642 (local address 127.15.70.2:38909)
0811 00:56:11.584943 (+ 596us) server_negotiation.cc:206] Beginning negotiation
0811 00:56:11.584948 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:56:11.584963 (+ 15us) server_negotiation.cc:407] Connection header received
0811 00:56:11.585018 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:56:11.585020 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:56:11.585041 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:56:11.585138 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:56:11.585406 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:11.586673 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:11.588016 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:11.588773 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:11.588867 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:11.588944 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 00:56:11.590077 (+ 1133us) server_negotiation.cc:299] Negotiation successful
0811 00:56:11.590147 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":545,"thread_start_us":124,"threads_started":1}
I20260811 00:56:11.591156 386 tablet_service.cc:1467] Processing CreateTablet for tablet f6dd113f30054a9cb73cd06bfe3a58d4 (DEFAULT_TABLE table=test-table [id=67ba1382ae1e41d1bcb3def21e3946c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:56:11.591264 608 tablet_service.cc:1467] Processing CreateTablet for tablet f6dd113f30054a9cb73cd06bfe3a58d4 (DEFAULT_TABLE table=test-table [id=67ba1382ae1e41d1bcb3def21e3946c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:56:11.591871 386 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6dd113f30054a9cb73cd06bfe3a58d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:56:11.591938 608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6dd113f30054a9cb73cd06bfe3a58d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:56:11.596280 988 tablet_bootstrap.cc:492] T f6dd113f30054a9cb73cd06bfe3a58d4 P d552888526064243999f6c9f1d20b5e9: Bootstrap starting.
I20260811 00:56:11.597229 988 tablet_bootstrap.cc:654] T f6dd113f30054a9cb73cd06bfe3a58d4 P d552888526064243999f6c9f1d20b5e9: Neither blocks nor log segments found. Creating new log.
I20260811 00:56:11.597376 850 tablet_service.cc:1467] Processing CreateTablet for tablet f6dd113f30054a9cb73cd06bfe3a58d4 (DEFAULT_TABLE table=test-table [id=67ba1382ae1e41d1bcb3def21e3946c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:56:11.597839 850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6dd113f30054a9cb73cd06bfe3a58d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:56:11.597960 988 log.cc:824] T f6dd113f30054a9cb73cd06bfe3a58d4 P d552888526064243999f6c9f1d20b5e9: Log is configured to *not* fsync() on all Append() calls
I20260811 00:56:11.598399 992 tablet_bootstrap.cc:492] T f6dd113f30054a9cb73cd06bfe3a58d4 P da483da8c58e434393d274efb9d97e27: Bootstrap starting.
I20260811 00:56:11.599138 988 tablet_bootstrap.cc:492] T f6dd113f30054a9cb73cd06bfe3a58d4 P d552888526064243999f6c9f1d20b5e9: No bootstrap required, opened a new log
I20260811 00:56:11.599231 988 ts_tablet_manager.cc:1397] T f6dd113f30054a9cb73cd06bfe3a58d4 P d552888526064243999f6c9f1d20b5e9: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 00:56:11.599261 992 tablet_bootstrap.cc:654] T f6dd113f30054a9cb73cd06bfe3a58d4 P da483da8c58e434393d274efb9d97e27: Neither blocks nor log segments found. Creating new log.
I20260811 00:56:11.599908 992 log.cc:824] T f6dd113f30054a9cb73cd06bfe3a58d4 P da483da8c58e434393d274efb9d97e27: Log is configured to *not* fsync() on all Append() calls
I20260811 00:56:11.600878 992 tablet_bootstrap.cc:492] T f6dd113f30054a9cb73cd06bfe3a58d4 P da483da8c58e434393d274efb9d97e27: No bootstrap required, opened a new log
I20260811 00:56:11.600960 992 ts_tablet_manager.cc:1397] T f6dd113f30054a9cb73cd06bfe3a58d4 P da483da8c58e434393d274efb9d97e27: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 00:56:11.601842 997 tablet_bootstrap.cc:492] T f6dd113f30054a9cb73cd06bfe3a58d4 P 7ef0b95389804cef9cc0c377816fc46a: Bootstrap starting.
I20260811 00:56:11.601824 988 raft_consensus.cc:348] T f6dd113f30054a9cb73cd06bfe3a58d4 P d552888526064243999f6c9f1d20b5e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da483da8c58e434393d274efb9d97e27" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 38909 } } peers { permanent_uuid: "7ef0b95389804cef9cc0c377816fc46a" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 33851 } } peers { permanent_uuid: "d552888526064243999f6c9f1d20b5e9" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 41727 } }
I20260811 00:56:11.602057 988 raft_consensus.cc:374] T f6dd113f30054a9cb73cd06bfe3a58d4 P d552888526064243999f6c9f1d20b5e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:56:11.602108 988 raft_consensus.cc:729] T f6dd113f30054a9cb73cd06bfe3a58d4 P d552888526064243999f6c9f1d20b5e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d552888526064243999f6c9f1d20b5e9, State: Initialized, Role: FOLLOWER
I20260811 00:56:11.602295 988 consensus_queue.cc:260] T f6dd113f30054a9cb73cd06bfe3a58d4 P d552888526064243999f6c9f1d20b5e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da483da8c58e434393d274efb9d97e27" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 38909 } } peers { permanent_uuid: "7ef0b95389804cef9cc0c377816fc46a" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 33851 } } peers { permanent_uuid: "d552888526064243999f6c9f1d20b5e9" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 41727 } }
I20260811 00:56:11.602607 988 ts_tablet_manager.cc:1428] T f6dd113f30054a9cb73cd06bfe3a58d4 P d552888526064243999f6c9f1d20b5e9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 00:56:11.602762 489 heartbeater.cc:503] Master 127.15.70.62:35099 was elected leader, sending a full tablet report...
I20260811 00:56:11.603101 997 tablet_bootstrap.cc:654] T f6dd113f30054a9cb73cd06bfe3a58d4 P 7ef0b95389804cef9cc0c377816fc46a: Neither blocks nor log segments found. Creating new log.
I20260811 00:56:11.603744 997 log.cc:824] T f6dd113f30054a9cb73cd06bfe3a58d4 P 7ef0b95389804cef9cc0c377816fc46a: Log is configured to *not* fsync() on all Append() calls
I20260811 00:56:11.603790 992 raft_consensus.cc:348] T f6dd113f30054a9cb73cd06bfe3a58d4 P da483da8c58e434393d274efb9d97e27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da483da8c58e434393d274efb9d97e27" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 38909 } } peers { permanent_uuid: "7ef0b95389804cef9cc0c377816fc46a" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 33851 } } peers { permanent_uuid: "d552888526064243999f6c9f1d20b5e9" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 41727 } }
I20260811 00:56:11.604014 992 raft_consensus.cc:374] T f6dd113f30054a9cb73cd06bfe3a58d4 P da483da8c58e434393d274efb9d97e27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:56:11.604066 992 raft_consensus.cc:729] T f6dd113f30054a9cb73cd06bfe3a58d4 P da483da8c58e434393d274efb9d97e27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da483da8c58e434393d274efb9d97e27, State: Initialized, Role: FOLLOWER
I20260811 00:56:11.604202 992 consensus_queue.cc:260] T f6dd113f30054a9cb73cd06bfe3a58d4 P da483da8c58e434393d274efb9d97e27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da483da8c58e434393d274efb9d97e27" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 38909 } } peers { permanent_uuid: "7ef0b95389804cef9cc0c377816fc46a" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 33851 } } peers { permanent_uuid: "d552888526064243999f6c9f1d20b5e9" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 41727 } }
I20260811 00:56:11.604571 992 ts_tablet_manager.cc:1428] T f6dd113f30054a9cb73cd06bfe3a58d4 P da483da8c58e434393d274efb9d97e27: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260811 00:56:11.604671 717 heartbeater.cc:503] Master 127.15.70.62:35099 was elected leader, sending a full tablet report...
I20260811 00:56:11.605085 997 tablet_bootstrap.cc:492] T f6dd113f30054a9cb73cd06bfe3a58d4 P 7ef0b95389804cef9cc0c377816fc46a: No bootstrap required, opened a new log
I20260811 00:56:11.605187 997 ts_tablet_manager.cc:1397] T f6dd113f30054a9cb73cd06bfe3a58d4 P 7ef0b95389804cef9cc0c377816fc46a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 00:56:11.607445 997 raft_consensus.cc:348] T f6dd113f30054a9cb73cd06bfe3a58d4 P 7ef0b95389804cef9cc0c377816fc46a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da483da8c58e434393d274efb9d97e27" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 38909 } } peers { permanent_uuid: "7ef0b95389804cef9cc0c377816fc46a" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 33851 } } peers { permanent_uuid: "d552888526064243999f6c9f1d20b5e9" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 41727 } }
I20260811 00:56:11.607632 997 raft_consensus.cc:374] T f6dd113f30054a9cb73cd06bfe3a58d4 P 7ef0b95389804cef9cc0c377816fc46a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:56:11.607684 997 raft_consensus.cc:729] T f6dd113f30054a9cb73cd06bfe3a58d4 P 7ef0b95389804cef9cc0c377816fc46a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ef0b95389804cef9cc0c377816fc46a, State: Initialized, Role: FOLLOWER
I20260811 00:56:11.607820 997 consensus_queue.cc:260] T f6dd113f30054a9cb73cd06bfe3a58d4 P 7ef0b95389804cef9cc0c377816fc46a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da483da8c58e434393d274efb9d97e27" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 38909 } } peers { permanent_uuid: "7ef0b95389804cef9cc0c377816fc46a" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 33851 } } peers { permanent_uuid: "d552888526064243999f6c9f1d20b5e9" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 41727 } }
I20260811 00:56:11.608223 997 ts_tablet_manager.cc:1428] T f6dd113f30054a9cb73cd06bfe3a58d4 P 7ef0b95389804cef9cc0c377816fc46a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 00:56:11.608294 960 heartbeater.cc:503] Master 127.15.70.62:35099 was elected leader, sending a full tablet report...
W20260811 00:56:11.636417 492 tablet.cc:2369] T f6dd113f30054a9cb73cd06bfe3a58d4 P d552888526064243999f6c9f1d20b5e9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 00:56:11.638032 998 raft_consensus.cc:482] T f6dd113f30054a9cb73cd06bfe3a58d4 P d552888526064243999f6c9f1d20b5e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:56:11.638227 998 raft_consensus.cc:504] T f6dd113f30054a9cb73cd06bfe3a58d4 P d552888526064243999f6c9f1d20b5e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da483da8c58e434393d274efb9d97e27" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 38909 } } peers { permanent_uuid: "7ef0b95389804cef9cc0c377816fc46a" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 33851 } } peers { permanent_uuid: "d552888526064243999f6c9f1d20b5e9" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 41727 } }
I20260811 00:56:11.638753 998 leader_election.cc:288] T f6dd113f30054a9cb73cd06bfe3a58d4 P d552888526064243999f6c9f1d20b5e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da483da8c58e434393d274efb9d97e27 (127.15.70.2:38909), 7ef0b95389804cef9cc0c377816fc46a (127.15.70.3:33851)
I20260811 00:56:11.642285 493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:11.639096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.2:38909 (local address 127.15.70.1:49113)
0811 00:56:11.639186 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0811 00:56:11.639204 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 00:56:11.639267 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:56:11.639554 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:56:11.639556 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:56:11.639558 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:56:11.639664 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:11.639667 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:11.640421 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:11.640422 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:11.641266 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:11.641269 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:11.641930 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:11.641931 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:11.642030 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:11.642033 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:56:11.642123 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 00:56:11.642181 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
I20260811 00:56:11.642287 981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:11.639232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:49113 (local address 127.15.70.2:38909)
0811 00:56:11.639308 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 00:56:11.639311 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:56:11.639362 (+ 51us) server_negotiation.cc:407] Connection header received
0811 00:56:11.639409 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:56:11.639410 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:56:11.639424 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:56:11.639505 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:56:11.639767 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:11.640320 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:11.641387 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:11.641835 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:11.641933 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:11.641950 (+ 17us) server_negotiation.cc:1035] Waiting for connection context
0811 00:56:11.642141 (+ 191us) server_negotiation.cc:299] Negotiation successful
0811 00:56:11.642196 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 00:56:11.642684 987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:11.639415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:57565 (local address 127.15.70.3:33851)
0811 00:56:11.639497 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 00:56:11.639499 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:56:11.639671 (+ 172us) server_negotiation.cc:407] Connection header received
0811 00:56:11.639752 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:56:11.639753 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:56:11.639777 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:56:11.639851 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:56:11.640063 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:11.640642 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:11.641706 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:11.642215 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:11.642315 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:11.642329 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0811 00:56:11.642534 (+ 205us) server_negotiation.cc:299] Negotiation successful
0811 00:56:11.642601 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 00:56:11.642822 647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6dd113f30054a9cb73cd06bfe3a58d4" candidate_uuid: "d552888526064243999f6c9f1d20b5e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da483da8c58e434393d274efb9d97e27" is_pre_election: true
I20260811 00:56:11.643108 1002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:11.639300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:33851 (local address 127.15.70.1:57565)
0811 00:56:11.639571 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0811 00:56:11.639581 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:56:11.639673 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:56:11.639858 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:56:11.639859 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:56:11.639861 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:56:11.639958 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:11.639960 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:11.640749 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:11.640750 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:11.641591 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:56:11.641593 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:56:11.642319 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:56:11.642320 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:56:11.642415 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:11.642421 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 00:56:11.642852 (+ 431us) client_negotiation.cc:240] Negotiation successful
0811 00:56:11.642920 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":175,"threads_started":1}
I20260811 00:56:11.643131 647 raft_consensus.cc:2454] T f6dd113f30054a9cb73cd06bfe3a58d4 P da483da8c58e434393d274efb9d97e27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d552888526064243999f6c9f1d20b5e9 in term 0.
I20260811 00:56:11.643465 309 leader_election.cc:302] T f6dd113f30054a9cb73cd06bfe3a58d4 P d552888526064243999f6c9f1d20b5e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d552888526064243999f6c9f1d20b5e9, da483da8c58e434393d274efb9d97e27; no voters:
I20260811 00:56:11.643564 878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6dd113f30054a9cb73cd06bfe3a58d4" candidate_uuid: "d552888526064243999f6c9f1d20b5e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ef0b95389804cef9cc0c377816fc46a" is_pre_election: true
I20260811 00:56:11.643689 998 raft_consensus.cc:2781] T f6dd113f30054a9cb73cd06bfe3a58d4 P d552888526064243999f6c9f1d20b5e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:56:11.643759 878 raft_consensus.cc:2454] T f6dd113f30054a9cb73cd06bfe3a58d4 P 7ef0b95389804cef9cc0c377816fc46a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d552888526064243999f6c9f1d20b5e9 in term 0.
I20260811 00:56:11.643782 998 raft_consensus.cc:482] T f6dd113f30054a9cb73cd06bfe3a58d4 P d552888526064243999f6c9f1d20b5e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:56:11.643812 998 raft_consensus.cc:3037] T f6dd113f30054a9cb73cd06bfe3a58d4 P d552888526064243999f6c9f1d20b5e9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:56:11.644964 998 raft_consensus.cc:504] T f6dd113f30054a9cb73cd06bfe3a58d4 P d552888526064243999f6c9f1d20b5e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da483da8c58e434393d274efb9d97e27" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 38909 } } peers { permanent_uuid: "7ef0b95389804cef9cc0c377816fc46a" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 33851 } } peers { permanent_uuid: "d552888526064243999f6c9f1d20b5e9" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 41727 } }
I20260811 00:56:11.645164 998 leader_election.cc:288] T f6dd113f30054a9cb73cd06bfe3a58d4 P d552888526064243999f6c9f1d20b5e9 [CANDIDATE]: Term 1 election: Requested vote from peers da483da8c58e434393d274efb9d97e27 (127.15.70.2:38909), 7ef0b95389804cef9cc0c377816fc46a (127.15.70.3:33851)
I20260811 00:56:11.645491 878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6dd113f30054a9cb73cd06bfe3a58d4" candidate_uuid: "d552888526064243999f6c9f1d20b5e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ef0b95389804cef9cc0c377816fc46a"
I20260811 00:56:11.645488 647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6dd113f30054a9cb73cd06bfe3a58d4" candidate_uuid: "d552888526064243999f6c9f1d20b5e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da483da8c58e434393d274efb9d97e27"
I20260811 00:56:11.645615 878 raft_consensus.cc:3037] T f6dd113f30054a9cb73cd06bfe3a58d4 P 7ef0b95389804cef9cc0c377816fc46a [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:56:11.645615 647 raft_consensus.cc:3037] T f6dd113f30054a9cb73cd06bfe3a58d4 P da483da8c58e434393d274efb9d97e27 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:56:11.647044 647 raft_consensus.cc:2454] T f6dd113f30054a9cb73cd06bfe3a58d4 P da483da8c58e434393d274efb9d97e27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d552888526064243999f6c9f1d20b5e9 in term 1.
I20260811 00:56:11.647042 878 raft_consensus.cc:2454] T f6dd113f30054a9cb73cd06bfe3a58d4 P 7ef0b95389804cef9cc0c377816fc46a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d552888526064243999f6c9f1d20b5e9 in term 1.
I20260811 00:56:11.647321 309 leader_election.cc:302] T f6dd113f30054a9cb73cd06bfe3a58d4 P d552888526064243999f6c9f1d20b5e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d552888526064243999f6c9f1d20b5e9, da483da8c58e434393d274efb9d97e27; no voters:
I20260811 00:56:11.647505 998 raft_consensus.cc:2781] T f6dd113f30054a9cb73cd06bfe3a58d4 P d552888526064243999f6c9f1d20b5e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:56:11.647815 998 raft_consensus.cc:686] T f6dd113f30054a9cb73cd06bfe3a58d4 P d552888526064243999f6c9f1d20b5e9 [term 1 LEADER]: Becoming Leader. State: Replica: d552888526064243999f6c9f1d20b5e9, State: Running, Role: LEADER
I20260811 00:56:11.647979 998 consensus_queue.cc:237] T f6dd113f30054a9cb73cd06bfe3a58d4 P d552888526064243999f6c9f1d20b5e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da483da8c58e434393d274efb9d97e27" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 38909 } } peers { permanent_uuid: "7ef0b95389804cef9cc0c377816fc46a" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 33851 } } peers { permanent_uuid: "d552888526064243999f6c9f1d20b5e9" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 41727 } }
I20260811 00:56:11.649237 32648 catalog_manager.cc:5495] T f6dd113f30054a9cb73cd06bfe3a58d4 P d552888526064243999f6c9f1d20b5e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to d552888526064243999f6c9f1d20b5e9 (127.15.70.1). New cstate: current_term: 1 leader_uuid: "d552888526064243999f6c9f1d20b5e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da483da8c58e434393d274efb9d97e27" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ef0b95389804cef9cc0c377816fc46a" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 33851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d552888526064243999f6c9f1d20b5e9" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 41727 } health_report { overall_health: HEALTHY } } }
I20260811 00:56:11.665761 984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:11.662751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48810 (local address 127.15.70.1:41727)
0811 00:56:11.662833 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 00:56:11.662836 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:56:11.662844 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:56:11.662900 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:56:11.662901 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:56:11.662929 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:56:11.663098 (+ 169us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:56:11.663293 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:11.663834 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:11.664759 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:56:11.664990 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:56:11.665054 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:56:11.665267 (+ 213us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:56:11.665432 (+ 165us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:56:11.665505 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 00:56:11.665616 (+ 111us) server_negotiation.cc:299] Negotiation successful
0811 00:56:11.665646 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 00:56:11.668541 647 raft_consensus.cc:1261] T f6dd113f30054a9cb73cd06bfe3a58d4 P da483da8c58e434393d274efb9d97e27 [term 1 FOLLOWER]: Refusing update from remote peer d552888526064243999f6c9f1d20b5e9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:56:11.668520 878 raft_consensus.cc:1261] T f6dd113f30054a9cb73cd06bfe3a58d4 P 7ef0b95389804cef9cc0c377816fc46a [term 1 FOLLOWER]: Refusing update from remote peer d552888526064243999f6c9f1d20b5e9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:56:11.669077 998 consensus_queue.cc:1035] T f6dd113f30054a9cb73cd06bfe3a58d4 P d552888526064243999f6c9f1d20b5e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da483da8c58e434393d274efb9d97e27" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:56:11.669416 1003 consensus_queue.cc:1035] T f6dd113f30054a9cb73cd06bfe3a58d4 P d552888526064243999f6c9f1d20b5e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ef0b95389804cef9cc0c377816fc46a" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 33851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:56:11.673720 1017 mvcc.cc:205] Tried to move back new op lower bound from 7317134424749969408 to 7317134424671195136. Current Snapshot: MvccSnapshot[applied={T|T < 7317134424749969408}]
I20260811 00:56:11.673897 1014 mvcc.cc:205] Tried to move back new op lower bound from 7317134424749969408 to 7317134424671195136. Current Snapshot: MvccSnapshot[applied={T|T < 7317134424749969408}]
I20260811 00:56:11.676101 32647 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51586:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:56:11.676244 32647 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51586:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:56:11.677346 32647 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e2b7b591da3d448dacd2fd42c6d74e75: Sending DeleteTablet for 3 replicas of tablet f6dd113f30054a9cb73cd06bfe3a58d4
I20260811 00:56:11.677851 850 tablet_service.cc:1514] Processing DeleteTablet for tablet f6dd113f30054a9cb73cd06bfe3a58d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:56:11 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:52294
I20260811 00:56:11.677896 608 tablet_service.cc:1514] Processing DeleteTablet for tablet f6dd113f30054a9cb73cd06bfe3a58d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:56:11 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:34642
I20260811 00:56:11.678161 1030 tablet_replica.cc:330] T f6dd113f30054a9cb73cd06bfe3a58d4 P 7ef0b95389804cef9cc0c377816fc46a: stopping tablet replica
I20260811 00:56:11.678246 386 tablet_service.cc:1514] Processing DeleteTablet for tablet f6dd113f30054a9cb73cd06bfe3a58d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:56:11 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:48794
I20260811 00:56:11.678304 1030 raft_consensus.cc:2229] T f6dd113f30054a9cb73cd06bfe3a58d4 P 7ef0b95389804cef9cc0c377816fc46a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:56:11.678468 1030 raft_consensus.cc:2258] T f6dd113f30054a9cb73cd06bfe3a58d4 P 7ef0b95389804cef9cc0c377816fc46a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:56:11.679068 1030 ts_tablet_manager.cc:1905] T f6dd113f30054a9cb73cd06bfe3a58d4 P 7ef0b95389804cef9cc0c377816fc46a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:56:11.679122 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 32747
I20260811 00:56:11.681195 1030 ts_tablet_manager.cc:1918] T f6dd113f30054a9cb73cd06bfe3a58d4 P 7ef0b95389804cef9cc0c377816fc46a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:56:11.681286 1030 log.cc:1196] T f6dd113f30054a9cb73cd06bfe3a58d4 P 7ef0b95389804cef9cc0c377816fc46a: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-2/wal/wals/f6dd113f30054a9cb73cd06bfe3a58d4
I20260811 00:56:11.681576 1030 ts_tablet_manager.cc:1939] T f6dd113f30054a9cb73cd06bfe3a58d4 P 7ef0b95389804cef9cc0c377816fc46a: Deleting consensus metadata
I20260811 00:56:11.701359 32621 catalog_manager.cc:4841] TS 7ef0b95389804cef9cc0c377816fc46a (127.15.70.3:33851): tablet f6dd113f30054a9cb73cd06bfe3a58d4 (table test-table [id=67ba1382ae1e41d1bcb3def21e3946c2]) successfully deleted
I20260811 00:56:11.706046 1032 tablet_replica.cc:330] T f6dd113f30054a9cb73cd06bfe3a58d4 P da483da8c58e434393d274efb9d97e27: stopping tablet replica
I20260811 00:56:11.706306 1032 raft_consensus.cc:2229] T f6dd113f30054a9cb73cd06bfe3a58d4 P da483da8c58e434393d274efb9d97e27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:56:11.706501 1032 raft_consensus.cc:2258] T f6dd113f30054a9cb73cd06bfe3a58d4 P da483da8c58e434393d274efb9d97e27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:56:11.707317 1032 ts_tablet_manager.cc:1905] T f6dd113f30054a9cb73cd06bfe3a58d4 P da483da8c58e434393d274efb9d97e27: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:56:11.709801 1032 ts_tablet_manager.cc:1918] T f6dd113f30054a9cb73cd06bfe3a58d4 P da483da8c58e434393d274efb9d97e27: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:56:11.709924 1032 log.cc:1196] T f6dd113f30054a9cb73cd06bfe3a58d4 P da483da8c58e434393d274efb9d97e27: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409704606556-15640-0/minicluster-data/ts-1/wal/wals/f6dd113f30054a9cb73cd06bfe3a58d4
I20260811 00:56:11.710278 1032 ts_tablet_manager.cc:1939] T f6dd113f30054a9cb73cd06bfe3a58d4 P da483da8c58e434393d274efb9d97e27: Deleting consensus metadata
I20260811 00:56:11.711089 32621 catalog_manager.cc:4841] TS da483da8c58e434393d274efb9d97e27 (127.15.70.2:38909): tablet f6dd113f30054a9cb73cd06bfe3a58d4 (table test-table [id=67ba1382ae1e41d1bcb3def21e3946c2]) successfully deleted
W20260811 00:56:11.713599 32620 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.70.1:41727 (error 108)
I20260811 00:56:11.713856 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 497
I20260811 00:56:11.718531 980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:56:11.718273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:41727 (local address 127.0.0.1:48824)
0811 00:56:11.718353 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0811 00:56:11.718444 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.1:41727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260811 00:56:11.718823 32620 catalog_manager.cc:4584] TS d552888526064243999f6c9f1d20b5e9 (127.15.70.1:41727): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f6dd113f30054a9cb73cd06bfe3a58d4: Network error: Client connection negotiation failed: client connection to 127.15.70.1:41727: connect: Connection refused (error 111)
I20260811 00:56:11.746762 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 731
I20260811 00:56:11.769613 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 32591
2026-08-11T00:56:11Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2622 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:56:11 dist-test-slave-h3ft krb5kdc[1039](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:56:11 dist-test-slave-h3ft krb5kdc[1039](info): set up 2 sockets
Aug 11 00:56:11 dist-test-slave-h3ft krb5kdc[1039](info): commencing operation
krb5kdc: starting...
W20260811 00:56:13.144990 15640 mini_kdc.cc:121] Time spent starting KDC: real 1.340s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Aug 11 00:56:13 dist-test-slave-h3ft krb5kdc[1039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409773, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:56:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:56:13Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.15.70.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.15.70.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.15.70.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/krb5kdc/rangeradmin_127.15.70.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.15.70.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/krb5kdc/rangeradmin_127.15.70.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.15.70.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.15.70.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.15.70.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/krb5kdc/rangerlookup_127.15.70.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.15.70.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/krb5kdc/rangerlookup_127.15.70.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.15.70.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.15.70.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.15.70.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/krb5kdc/HTTP_127.15.70.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.15.70.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/krb5kdc/HTTP_127.15.70.20@KRBTEST.COM.keytab.
I20260811 00:56:13.374840 15640 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskN44M8g/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/postgres -l logfile start
2026-08-11 00:56:16.516 UTC [1093] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 00:56:16.516 UTC [1093] LOG: listening on IPv4 address "127.15.70.20", port 57021
2026-08-11 00:56:16.521 UTC [1093] LOG: listening on Unix socket "/tmp/.s.PGSQL.57021"
2026-08-11 00:56:16.548 UTC [1102] LOG: database system was shut down at 2026-08-11 00:56:14 UTC
2026-08-11 00:56:16.553 UTC [1093] LOG: database system is ready to accept connections
I20260811 00:56:17.768260 15640 mini_postgres.cc:96] Postgres bound to 57021
2026-08-11 00:56:17.780 UTC [1121] FATAL: database "slave" does not exist
127.15.70.20:57021 - accepting connections
I20260811 00:56:17.781049 15640 mini_ranger.cc:161] Starting Ranger...
I20260811 00:56:17.803166 15640 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 00:56:18.400858 15640 mini_ranger.cc:87] Created ranger Postgres database
I20260811 00:56:18.400947 15640 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ranger-admin
2026-08-11 00:56:18,764 [I] DB FLAVOR :POSTGRES
2026-08-11 00:56:18,765 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 00:56:18,765 [I] Checking connection..
2026-08-11 00:56:18,765 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:57021/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 00:56:19,069 [I] Checking connection passed.
2026-08-11 00:56:19,070 [I] --------- Verifying version history table ---------
2026-08-11 00:56:19,070 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:57021/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 00:56:19,382 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 00:56:19,383 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:57021/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 00:56:19,677 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 00:56:19,677 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 00:56:19,677 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:57021/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 00:56:19.944 UTC [1230] WARNING: there is no transaction in progress
2026-08-11 00:56:19,956 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 00:56:19,956 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:57021/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 00:56:20,253 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 00:56:20,253 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 00:56:20,254 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:57021/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 00:56:20,551 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:57021/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 00:56:20,858 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:57021/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-h3ft.c.gcp-upstream.internal','N') ;"
2026-08-11 00:56:21,168 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:57021/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 00:56:21,475 [I] Table x_portal_user does not exist in database ranger
2026-08-11 00:56:21,475 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:57021/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 00:56:21,780 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 00:56:21,780 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:57021/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 00:56:22,069 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:57021/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 00:56:22,366 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 00:56:22,366 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:57021/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 00:56:23.531 UTC [1425] WARNING: there is no transaction in progress
2026-08-11 00:56:23.550 UTC [1425] WARNING: there is no transaction in progress
2026-08-11 00:56:23.570 UTC [1425] WARNING: there is no transaction in progress
2026-08-11 00:56:23.590 UTC [1425] WARNING: there is no transaction in progress
2026-08-11 00:56:23.611 UTC [1425] WARNING: there is no transaction in progress
2026-08-11 00:56:23.632 UTC [1425] WARNING: there is no transaction in progress
2026-08-11 00:56:23.698 UTC [1425] WARNING: there is no transaction in progress
2026-08-11 00:56:23.708 UTC [1425] WARNING: there is no transaction in progress
2026-08-11 00:56:23.727 UTC [1425] WARNING: there is no transaction in progress
2026-08-11 00:56:23.739 UTC [1425] WARNING: there is no transaction in progress
2026-08-11 00:56:23.752 UTC [1425] WARNING: there is no transaction in progress
2026-08-11 00:56:23.768 UTC [1425] WARNING: there is no transaction in progress
2026-08-11 00:56:23.780 UTC [1425] WARNING: there is no transaction in progress
2026-08-11 00:56:23.787 UTC [1425] WARNING: there is no transaction in progress
2026-08-11 00:56:23.796 UTC [1425] WARNING: there is no transaction in progress
2026-08-11 00:56:23.804 UTC [1425] WARNING: there is no transaction in progress
2026-08-11 00:56:24,585 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 00:56:24,586 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:57021/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 00:56:24,875 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 00:56:24,875 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:57021/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 00:56:25,167 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 00:56:25,167 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:57021/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 00:56:25,460 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 00:56:25,460 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:57021/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 00:56:25,751 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:57021/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 00:56:26,041 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:57021/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-h3ft.c.gcp-upstream.internal';"
2026-08-11 00:56:26,338 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 00:56:26,339 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:57021/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 00:56:26,641 [I] DB_PATCHES have already been applied
I20260811 00:56:26.648730 15640 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ranger-admin:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskN44M8g/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 00:56:26.648869 15640 mini_ranger.cc:193] Using host: 127.15.70.20
I20260811 00:56:26.654338 15640 mini_ranger.cc:227] Ranger admin URL: http://127.15.70.20:49639
Aug 11, 2026 12:56:27 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 12:56:27 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 12:56:27 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 12:56:27 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 12:56:27 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 12:56:27 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 12:56:27 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 00:56:29.713470 15640 mini_ranger.cc:160] Time spent starting Ranger: real 11.932s user 0.000s sys 0.019s
Aug 11, 2026 12:56:52 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 12:56:52 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 11, 2026 12:56:52 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 12:56:52 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 12:56:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 12:56:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 12:56:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 12:56:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 12:56:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 12:56:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 12:56:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 12:56:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 12:56:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 12:56:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 12:56:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 12:56:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 12:56:52 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 12:56:53 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 00:56:54.277199 15640 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.15.70.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.15.70.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.15.70.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/krb5kdc/rangerkms_127.15.70.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.15.70.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/krb5kdc/rangerkms_127.15.70.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.15.70.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.15.70.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.15.70.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/krb5kdc/HTTP_127.15.70.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.15.70.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/krb5kdc/HTTP_127.15.70.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 00:56:54 dist-test-slave-h3ft krb5kdc[1039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409814, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 00:56:54.401284 15640 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 00:56:54.417212 15640 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 00:56:55.524276 15640 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 00:56:55.524397 15640 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ranger-kms
I20260811 00:56:55.524418 15640 mini_ranger_kms.cc:227] Using postgres at 127.15.70.20:57021
2026-08-11 00:56:55,841 [I] DB FLAVOR :POSTGRES
2026-08-11 00:56:55,842 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 00:56:55,842 [I] Checking connection
2026-08-11 00:56:55,843 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:57021/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 00:56:56,184 [I] connection success
2026-08-11 00:56:56,184 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 00:56:56,184 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 00:56:56,184 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:57021/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 00:56:56,511 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 00:56:56,511 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 00:56:56,511 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 00:56:56,512 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:57021/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 00:56:56,857 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 00:56:57.506470 15640 mini_ranger_kms.cc:310] Created kms service
I20260811 00:56:57.762756 15640 mini_ranger_kms.cc:326] Created kudu user
I20260811 00:56:57.825939 15640 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 00:56:57 dist-test-slave-h3ft krb5kdc[1039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409814, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.15.70.20@KRBTEST.COM
I20260811 00:56:58.365729 15640 mini_ranger_kms.cc:384] Added ranger policy
I20260811 00:56:58.365914 15640 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ranger-kms:/tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 00:56:58.365950 15640 mini_ranger_kms.cc:240] Using host: 127.15.70.20
I20260811 00:56:58.371569 15640 mini_ranger_kms.cc:276] Ranger KMS PID: 1718
I20260811 00:56:58.371742 15640 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.15.70.20:58421
Aug 11, 2026 12:56:59 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 12:56:59 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 12:56:59 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 12:56:59 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 12:57:00 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 12:57:00 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 00:57:01 dist-test-slave-h3ft krb5kdc[1039](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786409821, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.15.70.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:57:01.398952 15640 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.998s user 0.002s sys 0.295s
I20260811 00:57:01.399125 15640 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 00:57:01.399241 15640 mini_ranger_kms.cc:401] 127.15.70.20:58421/kms/v1/keys
Aug 11 00:57:01 dist-test-slave-h3ft krb5kdc[1039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409821, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.15.70.20@KRBTEST.COM for HTTP/127.15.70.20@KRBTEST.COM
Aug 11 00:57:02 dist-test-slave-h3ft krb5kdc[1039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409821, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.15.70.20@KRBTEST.COM for HTTP/127.15.70.20@KRBTEST.COM
Aug 11 00:57:05 dist-test-slave-h3ft krb5kdc[1039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409825, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.15.70.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
I20260811 00:57:05.431921 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:38671
--webserver_interface=127.15.70.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:42847
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:38671
--ranger_config_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.70.20:58421/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:57:05.565279 1799 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:57:05.565639 1799 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:57:05.565687 1799 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:57:05.567193 1799 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:57:05.567283 1799 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:57:05.567305 1799 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:57:05.567327 1799 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:57:05.567356 1799 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:57:05.569419 1799 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:42847
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/master-0/wal
--ranger_kms_url=127.15.70.20:58421/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:38671
--ranger_config_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:38671
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1799
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:57:05.569813 1799 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:57:05.570122 1799 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:57:05.577471 1807 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:57:05.577739 1809 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:57:05.577525 1805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:57:05.577862 1799 server_base.cc:1034] running on GCE node
I20260811 00:57:05.578291 1799 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:57:05.578791 1799 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:57:05.580077 1799 hybrid_clock.cc:648] HybridClock initialized: now 1786409825580032 us; error 58 us; skew 500 ppm
Aug 11 00:57:05 dist-test-slave-h3ft krb5kdc[1039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409825, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:57:05.583843 1799 init.cc:377] Logged in from keytab as kudu/127.15.70.62@KRBTEST.COM (short username kudu)
I20260811 00:57:05.584532 1799 webserver.cc:460] Webserver started at http://127.15.70.62:33053/ using document root <none> and password file <none>
I20260811 00:57:05.584870 1799 fs_manager.cc:359] Metadata directory not provided
I20260811 00:57:05.585011 1799 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:57:05.585209 1799 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 00:57:05 dist-test-slave-h3ft krb5kdc[1039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409825, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for HTTP/127.15.70.20@KRBTEST.COM
I20260811 00:57:05.661397 1799 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "c6dc72924c7f40249733cf9801ecce3c"
format_stamp: "Formatted at 2026-08-11 00:57:05 on dist-test-slave-h3ft"
server_key: "fa9b08a8d1d8e9dc9118cb0e05adee37"
server_key_iv: "caccbeccd275a4a848d5b408273768bf"
server_key_version: "kuduclusterkey@0"
I20260811 00:57:05.662012 1799 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "c6dc72924c7f40249733cf9801ecce3c"
format_stamp: "Formatted at 2026-08-11 00:57:05 on dist-test-slave-h3ft"
server_key: "fa9b08a8d1d8e9dc9118cb0e05adee37"
server_key_iv: "caccbeccd275a4a848d5b408273768bf"
server_key_version: "kuduclusterkey@0"
I20260811 00:57:05.664317 1799 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.005s sys 0.000s
I20260811 00:57:05.686405 1821 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:57:05.686884 1799 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:57:05.687103 1799 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "c6dc72924c7f40249733cf9801ecce3c"
format_stamp: "Formatted at 2026-08-11 00:57:05 on dist-test-slave-h3ft"
server_key: "fa9b08a8d1d8e9dc9118cb0e05adee37"
server_key_iv: "caccbeccd275a4a848d5b408273768bf"
server_key_version: "kuduclusterkey@0"
I20260811 00:57:05.687263 1799 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:57:05.716033 1799 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:57:05.719398 1799 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:57:05.719718 1799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:57:05.727612 1799 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:38671
I20260811 00:57:05.727720 1909 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:38671 every 8 connection(s)
I20260811 00:57:05.728317 1799 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:57:05.729418 1910 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:57:05.733402 1910 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6dc72924c7f40249733cf9801ecce3c: Bootstrap starting.
I20260811 00:57:05.734522 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 1799
I20260811 00:57:05.734678 1910 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c6dc72924c7f40249733cf9801ecce3c: Neither blocks nor log segments found. Creating new log.
I20260811 00:57:05.734712 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 00:57:05.735109 15640 external_mini_cluster.cc:1428] Setting key d0b12282fbf2c3f6bb32e1242f87c41d
I20260811 00:57:05.735373 1910 log.cc:824] T 00000000000000000000000000000000 P c6dc72924c7f40249733cf9801ecce3c: Log is configured to *not* fsync() on all Append() calls
I20260811 00:57:05.736590 1910 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6dc72924c7f40249733cf9801ecce3c: No bootstrap required, opened a new log
I20260811 00:57:05.740005 1910 raft_consensus.cc:348] T 00000000000000000000000000000000 P c6dc72924c7f40249733cf9801ecce3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6dc72924c7f40249733cf9801ecce3c" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 38671 } }
I20260811 00:57:05.740384 1910 raft_consensus.cc:374] T 00000000000000000000000000000000 P c6dc72924c7f40249733cf9801ecce3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:57:05.740438 1910 raft_consensus.cc:729] T 00000000000000000000000000000000 P c6dc72924c7f40249733cf9801ecce3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6dc72924c7f40249733cf9801ecce3c, State: Initialized, Role: FOLLOWER
I20260811 00:57:05.740653 1910 consensus_queue.cc:260] T 00000000000000000000000000000000 P c6dc72924c7f40249733cf9801ecce3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6dc72924c7f40249733cf9801ecce3c" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 38671 } }
I20260811 00:57:05.740767 1910 raft_consensus.cc:388] T 00000000000000000000000000000000 P c6dc72924c7f40249733cf9801ecce3c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:57:05.740830 1910 raft_consensus.cc:482] T 00000000000000000000000000000000 P c6dc72924c7f40249733cf9801ecce3c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:57:05.740898 1910 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c6dc72924c7f40249733cf9801ecce3c [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:57:05.742084 1910 raft_consensus.cc:504] T 00000000000000000000000000000000 P c6dc72924c7f40249733cf9801ecce3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6dc72924c7f40249733cf9801ecce3c" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 38671 } }
I20260811 00:57:05.742254 1910 leader_election.cc:302] T 00000000000000000000000000000000 P c6dc72924c7f40249733cf9801ecce3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c6dc72924c7f40249733cf9801ecce3c; no voters:
I20260811 00:57:05.742594 1910 leader_election.cc:288] T 00000000000000000000000000000000 P c6dc72924c7f40249733cf9801ecce3c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:57:05.742636 1918 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c6dc72924c7f40249733cf9801ecce3c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:57:05.742954 1918 raft_consensus.cc:686] T 00000000000000000000000000000000 P c6dc72924c7f40249733cf9801ecce3c [term 1 LEADER]: Becoming Leader. State: Replica: c6dc72924c7f40249733cf9801ecce3c, State: Running, Role: LEADER
I20260811 00:57:05.743148 1910 sys_catalog.cc:564] T 00000000000000000000000000000000 P c6dc72924c7f40249733cf9801ecce3c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:57:05.743178 1918 consensus_queue.cc:237] T 00000000000000000000000000000000 P c6dc72924c7f40249733cf9801ecce3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6dc72924c7f40249733cf9801ecce3c" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 38671 } }
I20260811 00:57:05.743690 1918 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6dc72924c7f40249733cf9801ecce3c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c6dc72924c7f40249733cf9801ecce3c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6dc72924c7f40249733cf9801ecce3c" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 38671 } } }
I20260811 00:57:05.743815 1918 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6dc72924c7f40249733cf9801ecce3c [sys.catalog]: This master's current role is: LEADER
I20260811 00:57:05.744144 1922 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6dc72924c7f40249733cf9801ecce3c [sys.catalog]: SysCatalogTable state changed. Reason: New leader c6dc72924c7f40249733cf9801ecce3c. Latest consensus state: current_term: 1 leader_uuid: "c6dc72924c7f40249733cf9801ecce3c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6dc72924c7f40249733cf9801ecce3c" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 38671 } } }
I20260811 00:57:05.744262 1922 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6dc72924c7f40249733cf9801ecce3c [sys.catalog]: This master's current role is: LEADER
I20260811 00:57:05.745878 1910 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 00:57:05.746970 1927 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:57:05.747799 1927 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 00:57:05 dist-test-slave-h3ft krb5kdc[1039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409825, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:57:05.756804 1927 catalog_manager.cc:1347] Generated new cluster ID: da5bbdc7888348efb6ad4d1c43131efe
I20260811 00:57:05.757134 1927 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:57:05.763243 1916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:57:05.736327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49068 (local address 127.15.70.62:38671)
0811 00:57:05.736567 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0811 00:57:05.736581 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 00:57:05.736888 (+ 307us) server_negotiation.cc:407] Connection header received
0811 00:57:05.740005 (+ 3117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:57:05.740029 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:57:05.740161 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:57:05.740454 (+ 293us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:57:05.741825 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:57:05.744470 (+ 2645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:57:05.745787 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:57:05.746641 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:57:05.746804 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:57:05.751907 (+ 5103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:57:05.751989 (+ 82us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:57:05.751989 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:57:05.752166 (+ 177us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:57:05.756847 (+ 4681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:57:05.757553 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:57:05.757557 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:57:05.757558 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:57:05.757737 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:57:05.758126 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:57:05.758127 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:57:05.758127 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:57:05.758677 (+ 550us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:57:05.759490 (+ 813us) server_negotiation.cc:1035] Waiting for connection context
0811 00:57:05.759582 (+ 92us) server_negotiation.cc:299] Negotiation successful
0811 00:57:05.760035 (+ 453us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":94,"threads_started":1}
I20260811 00:57:05.788800 1927 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:57:05.790279 1927 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:57:05.794510 1927 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c6dc72924c7f40249733cf9801ecce3c: Generated new TSK 0
I20260811 00:57:05.795085 1927 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.70.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab.
Entry for principal kudu/127.15.70.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab.
I20260811 00:57:06.752260 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.70.20:58421/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.1:0
--local_ip_for_outbound_sockets=127.15.70.1
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:38671
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:42847
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:57:06.910805 1991 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:57:06.911257 1991 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:57:06.911307 1991 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:57:06.913580 1991 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:57:06.913672 1991 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:57:06.913723 1991 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.1
I20260811 00:57:06.916602 1991 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:42847
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.15.70.20:58421/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:38671
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1991
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.1
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:57:06.917006 1991 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:57:06.917430 1991 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:57:06.926819 2003 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:57:06.927258 1991 server_base.cc:1034] running on GCE node
W20260811 00:57:06.926793 2001 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:57:06.927521 2000 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:57:06.927865 1991 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:57:06.928258 1991 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:57:06.929384 1991 hybrid_clock.cc:648] HybridClock initialized: now 1786409826929359 us; error 47 us; skew 500 ppm
Aug 11 00:57:06 dist-test-slave-h3ft krb5kdc[1039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409826, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:57:06.934484 1991 init.cc:377] Logged in from keytab as kudu/127.15.70.1@KRBTEST.COM (short username kudu)
I20260811 00:57:06.935402 1991 webserver.cc:460] Webserver started at http://127.15.70.1:33739/ using document root <none> and password file <none>
I20260811 00:57:06.935820 1991 fs_manager.cc:359] Metadata directory not provided
I20260811 00:57:06.935952 1991 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:57:06.936165 1991 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 00:57:06 dist-test-slave-h3ft krb5kdc[1039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409826, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for HTTP/127.15.70.20@KRBTEST.COM
I20260811 00:57:06.960110 1991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-0/data/instance:
uuid: "8a4357aeee23446b83c72f644bfc0900"
format_stamp: "Formatted at 2026-08-11 00:57:06 on dist-test-slave-h3ft"
server_key: "9023f77669417d37f0d98117b52cd0b0"
server_key_iv: "51f0281d2dfe1522279f022beec0017e"
server_key_version: "kuduclusterkey@0"
I20260811 00:57:06.960777 1991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance:
uuid: "8a4357aeee23446b83c72f644bfc0900"
format_stamp: "Formatted at 2026-08-11 00:57:06 on dist-test-slave-h3ft"
server_key: "9023f77669417d37f0d98117b52cd0b0"
server_key_iv: "51f0281d2dfe1522279f022beec0017e"
server_key_version: "kuduclusterkey@0"
I20260811 00:57:06.967231 1991 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.000s
I20260811 00:57:06.994741 2018 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:57:06.995151 1991 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260811 00:57:06.995322 1991 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-0/wal
uuid: "8a4357aeee23446b83c72f644bfc0900"
format_stamp: "Formatted at 2026-08-11 00:57:06 on dist-test-slave-h3ft"
server_key: "9023f77669417d37f0d98117b52cd0b0"
server_key_iv: "51f0281d2dfe1522279f022beec0017e"
server_key_version: "kuduclusterkey@0"
I20260811 00:57:06.995486 1991 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:57:07.017795 1991 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:57:07.021003 1991 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:57:07.021274 1991 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:57:07.021667 1991 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:57:07.022218 1991 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:57:07.022320 1991 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:57:07.022449 1991 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:57:07.022543 1991 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:57:07.034039 1991 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.1:46201
I20260811 00:57:07.034687 1991 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
I20260811 00:57:07.035804 2232 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.1:46201 every 8 connection(s)
I20260811 00:57:07.039965 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 1991
I20260811 00:57:07.040118 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance
I20260811 00:57:07.040369 15640 external_mini_cluster.cc:1428] Setting key ba09dd5c436b571ddaf3ab3d9f06fa9a
Aug 11 00:57:07 dist-test-slave-h3ft krb5kdc[1039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409826, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:57:07.051097 2236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:57:07.036750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:38671 (local address 127.15.70.1:44567)
0811 00:57:07.037022 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0811 00:57:07.037089 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0811 00:57:07.037941 (+ 852us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:57:07.038506 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:57:07.038513 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:57:07.038835 (+ 322us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:57:07.039304 (+ 469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:57:07.039313 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:57:07.040426 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:57:07.040428 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:57:07.041904 (+ 1476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:57:07.041909 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:57:07.042736 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:57:07.042737 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:57:07.042926 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:57:07.043805 (+ 879us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:57:07.043820 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:57:07.046181 (+ 2361us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:57:07.048981 (+ 2800us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:57:07.048992 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:57:07.048996 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:57:07.049365 (+ 369us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:57:07.049639 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:57:07.049640 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:57:07.049641 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:57:07.049807 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:57:07.050147 (+ 340us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:57:07.050154 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:57:07.050384 (+ 230us) client_negotiation.cc:769] Sending connection context
0811 00:57:07.050512 (+ 128us) client_negotiation.cc:240] Negotiation successful
0811 00:57:07.050725 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":120,"threads_started":1}
I20260811 00:57:07.051776 2242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:57:07.037164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:44567 (local address 127.15.70.62:38671)
0811 00:57:07.038207 (+ 1043us) server_negotiation.cc:206] Beginning negotiation
0811 00:57:07.038210 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:57:07.038224 (+ 14us) server_negotiation.cc:407] Connection header received
0811 00:57:07.038260 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:57:07.038261 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:57:07.038279 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:57:07.038357 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:57:07.039453 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:57:07.040292 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:57:07.042330 (+ 2038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:57:07.042634 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:57:07.042703 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:57:07.046550 (+ 3847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:57:07.046553 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:57:07.046553 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:57:07.046566 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:57:07.048853 (+ 2287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:57:07.049480 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:57:07.049481 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:57:07.049482 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:57:07.049561 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:57:07.049889 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:57:07.049889 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:57:07.049890 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:57:07.050066 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:57:07.051481 (+ 1415us) server_negotiation.cc:1035] Waiting for connection context
0811 00:57:07.051532 (+ 51us) server_negotiation.cc:299] Negotiation successful
0811 00:57:07.051656 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1009,"thread_start_us":74,"threads_started":1}
I20260811 00:57:07.052331 2234 heartbeater.cc:347] Connected to a master server at 127.15.70.62:38671
I20260811 00:57:07.052491 2234 heartbeater.cc:464] Registering TS with master...
I20260811 00:57:07.052826 2234 heartbeater.cc:511] Master 127.15.70.62:38671 requested a full tablet report, sending...
I20260811 00:57:07.053670 1848 ts_manager.cc:194] Registered new tserver with Master: 8a4357aeee23446b83c72f644bfc0900 (127.15.70.1:46201)
I20260811 00:57:07.054752 1848 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.1@KRBTEST.COM'} at 127.15.70.1:44567
WARNING: no policy specified for kudu/127.15.70.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab.
Entry for principal kudu/127.15.70.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab.
I20260811 00:57:07.090343 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.70.20:58421/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.2:0
--local_ip_for_outbound_sockets=127.15.70.2
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:38671
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:42847
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 00:57:07 dist-test-slave-h3ft krb5kdc[1039](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786409827, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 00:57:07.239784 2246 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:57:07.240173 2246 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:57:07.240224 2246 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:57:07.241832 2246 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:57:07.241923 2246 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:57:07.241976 2246 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.2
I20260811 00:57:07.244618 2246 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:42847
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.15.70.20:58421/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:38671
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2246
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.2
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:57:07.244992 2246 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:57:07.245404 2246 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:57:07.255630 2257 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:57:07.255818 2259 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:57:07.256073 2261 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:57:07.256981 2246 server_base.cc:1034] running on GCE node
I20260811 00:57:07.257292 2246 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:57:07.257654 2246 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:57:07.258836 2246 hybrid_clock.cc:648] HybridClock initialized: now 1786409827258805 us; error 51 us; skew 500 ppm
Aug 11 00:57:07 dist-test-slave-h3ft krb5kdc[1039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409827, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:57:07.262748 2246 init.cc:377] Logged in from keytab as kudu/127.15.70.2@KRBTEST.COM (short username kudu)
I20260811 00:57:07.263484 2246 webserver.cc:460] Webserver started at http://127.15.70.2:42483/ using document root <none> and password file <none>
I20260811 00:57:07.263837 2246 fs_manager.cc:359] Metadata directory not provided
I20260811 00:57:07.263896 2246 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:57:07.264104 2246 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 00:57:07 dist-test-slave-h3ft krb5kdc[1039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409827, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for HTTP/127.15.70.20@KRBTEST.COM
I20260811 00:57:07.281715 2246 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-1/data/instance:
uuid: "9376ce98198a4e16a28f6f3ffecdf207"
format_stamp: "Formatted at 2026-08-11 00:57:07 on dist-test-slave-h3ft"
server_key: "7577e1037398d4226cc716e80b5a5ca5"
server_key_iv: "e950d39d28976ad6250f2ad6a5f52da2"
server_key_version: "kuduclusterkey@0"
I20260811 00:57:07.282559 2246 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance:
uuid: "9376ce98198a4e16a28f6f3ffecdf207"
format_stamp: "Formatted at 2026-08-11 00:57:07 on dist-test-slave-h3ft"
server_key: "7577e1037398d4226cc716e80b5a5ca5"
server_key_iv: "e950d39d28976ad6250f2ad6a5f52da2"
server_key_version: "kuduclusterkey@0"
I20260811 00:57:07.285729 2246 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260811 00:57:07.306505 2274 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:57:07.306864 2246 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:57:07.307096 2246 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-1/wal
uuid: "9376ce98198a4e16a28f6f3ffecdf207"
format_stamp: "Formatted at 2026-08-11 00:57:07 on dist-test-slave-h3ft"
server_key: "7577e1037398d4226cc716e80b5a5ca5"
server_key_iv: "e950d39d28976ad6250f2ad6a5f52da2"
server_key_version: "kuduclusterkey@0"
I20260811 00:57:07.307255 2246 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:57:07.343490 2246 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:57:07.346467 2246 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:57:07.346670 2246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:57:07.347064 2246 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:57:07.347584 2246 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:57:07.347628 2246 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:57:07.347654 2246 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:57:07.347672 2246 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:57:07.357829 2246 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.2:44647
I20260811 00:57:07.358487 2246 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
I20260811 00:57:07.359874 2463 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.2:44647 every 8 connection(s)
I20260811 00:57:07.366425 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 2246
I20260811 00:57:07.366590 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance
I20260811 00:57:07.366825 15640 external_mini_cluster.cc:1428] Setting key 5f5dcb2959b2fe0846ed3cc22170768f
Aug 11 00:57:07 dist-test-slave-h3ft krb5kdc[1039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409827, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:57:07.380512 2242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:57:07.361250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:44279 (local address 127.15.70.62:38671)
0811 00:57:07.361388 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0811 00:57:07.361391 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:57:07.362004 (+ 613us) server_negotiation.cc:407] Connection header received
0811 00:57:07.362821 (+ 817us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:57:07.362823 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:57:07.362840 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:57:07.362930 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:57:07.368742 (+ 5812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:57:07.369607 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:57:07.371474 (+ 1867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:57:07.371852 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:57:07.371914 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:57:07.376212 (+ 4298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:57:07.376215 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:57:07.376215 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:57:07.376227 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:57:07.378229 (+ 2002us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:57:07.378961 (+ 732us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:57:07.378963 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:57:07.378964 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:57:07.379100 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:57:07.379464 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:57:07.379466 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:57:07.379466 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:57:07.379661 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:57:07.379718 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 00:57:07.380206 (+ 488us) server_negotiation.cc:299] Negotiation successful
0811 00:57:07.380343 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 00:57:07.381721 2477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:57:07.360753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:38671 (local address 127.15.70.2:44279)
0811 00:57:07.361763 (+ 1010us) negotiation.cc:107] Waiting for socket to connect
0811 00:57:07.361828 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0811 00:57:07.362689 (+ 861us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:57:07.367662 (+ 4973us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:57:07.367671 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:57:07.368157 (+ 486us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:57:07.368565 (+ 408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:57:07.368592 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:57:07.369783 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:57:07.369784 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:57:07.371333 (+ 1549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:57:07.371339 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:57:07.372054 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:57:07.372055 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:57:07.372252 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:57:07.373124 (+ 872us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:57:07.373140 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:57:07.376000 (+ 2860us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:57:07.378374 (+ 2374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:57:07.378390 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:57:07.378394 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:57:07.378843 (+ 449us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:57:07.379183 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:57:07.379184 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:57:07.379184 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:57:07.379387 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:57:07.379756 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:57:07.379764 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:57:07.380030 (+ 266us) client_negotiation.cc:769] Sending connection context
0811 00:57:07.381077 (+ 1047us) client_negotiation.cc:240] Negotiation successful
0811 00:57:07.381334 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":954,"thread_start_us":205,"threads_started":1}
I20260811 00:57:07.382607 2468 heartbeater.cc:347] Connected to a master server at 127.15.70.62:38671
I20260811 00:57:07.382735 2468 heartbeater.cc:464] Registering TS with master...
I20260811 00:57:07.382983 2468 heartbeater.cc:511] Master 127.15.70.62:38671 requested a full tablet report, sending...
I20260811 00:57:07.383598 1848 ts_manager.cc:194] Registered new tserver with Master: 9376ce98198a4e16a28f6f3ffecdf207 (127.15.70.2:44647)
I20260811 00:57:07.384173 1848 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.2@KRBTEST.COM'} at 127.15.70.2:44279
WARNING: no policy specified for kudu/127.15.70.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab.
Entry for principal kudu/127.15.70.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab.
I20260811 00:57:07.440034 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.70.20:58421/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.3:0
--local_ip_for_outbound_sockets=127.15.70.3
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:38671
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:42847
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:57:07.611712 2481 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:57:07.612109 2481 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:57:07.612162 2481 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:57:07.614035 2481 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:57:07.614146 2481 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:57:07.614203 2481 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.3
I20260811 00:57:07.616824 2481 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:42847
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.15.70.20:58421/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:38671
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2481
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.3
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:57:07.617268 2481 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:57:07.617666 2481 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:57:07.624245 2489 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:57:07.624326 2498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:57:07.624250 2493 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:57:07.633322 2481 server_base.cc:1034] running on GCE node
I20260811 00:57:07.634021 2481 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:57:07.634541 2481 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:57:07.635736 2481 hybrid_clock.cc:648] HybridClock initialized: now 1786409827635704 us; error 62 us; skew 500 ppm
Aug 11 00:57:07 dist-test-slave-h3ft krb5kdc[1039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409827, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:57:07.640538 2481 init.cc:377] Logged in from keytab as kudu/127.15.70.3@KRBTEST.COM (short username kudu)
I20260811 00:57:07.641438 2481 webserver.cc:460] Webserver started at http://127.15.70.3:33179/ using document root <none> and password file <none>
I20260811 00:57:07.641920 2481 fs_manager.cc:359] Metadata directory not provided
I20260811 00:57:07.642074 2481 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:57:07.642282 2481 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 00:57:07 dist-test-slave-h3ft krb5kdc[1039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409827, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for HTTP/127.15.70.20@KRBTEST.COM
I20260811 00:57:07.672876 2481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-2/data/instance:
uuid: "4b726586877f4a079035eba0aad9f58f"
format_stamp: "Formatted at 2026-08-11 00:57:07 on dist-test-slave-h3ft"
server_key: "0080f46c13b7c9e61e9d0473db8ee00c"
server_key_iv: "3c284fa9b5d91dbfc10eab9be534df06"
server_key_version: "kuduclusterkey@0"
I20260811 00:57:07.673579 2481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance:
uuid: "4b726586877f4a079035eba0aad9f58f"
format_stamp: "Formatted at 2026-08-11 00:57:07 on dist-test-slave-h3ft"
server_key: "0080f46c13b7c9e61e9d0473db8ee00c"
server_key_iv: "3c284fa9b5d91dbfc10eab9be534df06"
server_key_version: "kuduclusterkey@0"
I20260811 00:57:07.684302 2481 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.000s sys 0.003s
I20260811 00:57:07.716277 2509 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:57:07.716652 2481 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.000s
I20260811 00:57:07.716801 2481 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-2/wal
uuid: "4b726586877f4a079035eba0aad9f58f"
format_stamp: "Formatted at 2026-08-11 00:57:07 on dist-test-slave-h3ft"
server_key: "0080f46c13b7c9e61e9d0473db8ee00c"
server_key_iv: "3c284fa9b5d91dbfc10eab9be534df06"
server_key_version: "kuduclusterkey@0"
I20260811 00:57:07.716939 2481 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:57:07.750736 2481 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:57:07.754384 2481 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:57:07.754719 2481 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:57:07.755209 2481 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:57:07.755828 2481 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:57:07.755959 2481 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:57:07.756058 2481 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:57:07.756135 2481 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:57:07.768756 2481 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.3:36289
I20260811 00:57:07.769578 2481 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
I20260811 00:57:07.771504 2712 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.3:36289 every 8 connection(s)
I20260811 00:57:07.780169 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 2481
I20260811 00:57:07.780390 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance
I20260811 00:57:07.780658 15640 external_mini_cluster.cc:1428] Setting key 2aaade46399de3cc34b72e59f1a4ca26
Aug 11 00:57:07 dist-test-slave-h3ft krb5kdc[1039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409827, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:57:07.789974 2242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:57:07.772649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:46007 (local address 127.15.70.62:38671)
0811 00:57:07.772724 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 00:57:07.772727 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:57:07.773106 (+ 379us) server_negotiation.cc:407] Connection header received
0811 00:57:07.774180 (+ 1074us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:57:07.774183 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:57:07.774202 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:57:07.774243 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:57:07.776099 (+ 1856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:57:07.777031 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:57:07.779341 (+ 2310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:57:07.779729 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:57:07.779790 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:57:07.784781 (+ 4991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:57:07.784784 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:57:07.784785 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:57:07.784798 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:57:07.787105 (+ 2307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:57:07.788091 (+ 986us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:57:07.788094 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:57:07.788094 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:57:07.788185 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:57:07.788573 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:57:07.788574 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:57:07.788574 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:57:07.788913 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:57:07.789013 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 00:57:07.789698 (+ 685us) server_negotiation.cc:299] Negotiation successful
0811 00:57:07.789838 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 00:57:07.791302 2716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:57:07.772634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:38671 (local address 127.15.70.3:46007)
0811 00:57:07.772883 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0811 00:57:07.772961 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0811 00:57:07.773991 (+ 1030us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:57:07.774524 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:57:07.774531 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:57:07.775497 (+ 966us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:57:07.775946 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:57:07.775957 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:57:07.777212 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:57:07.777213 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:57:07.779179 (+ 1966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:57:07.779185 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:57:07.779954 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:57:07.779955 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:57:07.780169 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:57:07.782250 (+ 2081us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:57:07.782266 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:57:07.784602 (+ 2336us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:57:07.787387 (+ 2785us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:57:07.787405 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:57:07.787410 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:57:07.787975 (+ 565us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:57:07.788264 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:57:07.788264 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:57:07.788265 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:57:07.788485 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:57:07.789167 (+ 682us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:57:07.789179 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:57:07.789476 (+ 297us) client_negotiation.cc:769] Sending connection context
0811 00:57:07.790568 (+ 1092us) client_negotiation.cc:240] Negotiation successful
0811 00:57:07.790871 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":128,"threads_started":1}
I20260811 00:57:07.793541 2713 heartbeater.cc:347] Connected to a master server at 127.15.70.62:38671
I20260811 00:57:07.793712 2713 heartbeater.cc:464] Registering TS with master...
I20260811 00:57:07.794014 2713 heartbeater.cc:511] Master 127.15.70.62:38671 requested a full tablet report, sending...
I20260811 00:57:07.794811 1848 ts_manager.cc:194] Registered new tserver with Master: 4b726586877f4a079035eba0aad9f58f (127.15.70.3:36289)
I20260811 00:57:07.795466 1848 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.3@KRBTEST.COM'} at 127.15.70.3:46007
I20260811 00:57:07.804108 15640 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 00:57:07.823263 2242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:57:07.807552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49074 (local address 127.15.70.62:38671)
0811 00:57:07.807625 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 00:57:07.807628 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:57:07.812922 (+ 5294us) server_negotiation.cc:407] Connection header received
0811 00:57:07.813112 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:57:07.813114 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:57:07.813162 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:57:07.813213 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:57:07.814411 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:57:07.815350 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:57:07.816534 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:57:07.816830 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:57:07.816879 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:57:07.819362 (+ 2483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:57:07.819363 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:57:07.819364 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:57:07.819375 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:57:07.821624 (+ 2249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:57:07.822176 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:57:07.822178 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:57:07.822179 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:57:07.822253 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:57:07.822459 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:57:07.822460 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:57:07.822461 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:57:07.822645 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:57:07.822734 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 00:57:07.822981 (+ 247us) server_negotiation.cc:299] Negotiation successful
0811 00:57:07.823125 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 00:57:07.827067 1848 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49074:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:57:07.830853 1848 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:57:07.853413 2741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:57:07.837153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:46201 (local address 127.0.0.1:53422)
0811 00:57:07.838896 (+ 1743us) negotiation.cc:107] Waiting for socket to connect
0811 00:57:07.838905 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:57:07.838946 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:57:07.845206 (+ 6260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:57:07.845208 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:57:07.845212 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:57:07.845300 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:57:07.845303 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:57:07.846931 (+ 1628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:57:07.846933 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:57:07.848304 (+ 1371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:57:07.848309 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:57:07.852876 (+ 4567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:57:07.852878 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:57:07.853044 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:57:07.853064 (+ 20us) client_negotiation.cc:769] Sending connection context
0811 00:57:07.853167 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 00:57:07.853256 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1724,"mutex_wait_us":39,"thread_start_us":89,"threads_started":1}
I20260811 00:57:07.854739 2739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:57:07.836763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.2:44647 (local address 127.0.0.1:35780)
0811 00:57:07.838606 (+ 1843us) negotiation.cc:107] Waiting for socket to connect
0811 00:57:07.838679 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0811 00:57:07.838761 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:57:07.840011 (+ 1250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:57:07.840015 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:57:07.840018 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:57:07.840526 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:57:07.840530 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:57:07.843570 (+ 3040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:57:07.843572 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:57:07.847239 (+ 3667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:57:07.847244 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:57:07.853316 (+ 6072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:57:07.853317 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:57:07.853384 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:57:07.853388 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:57:07.853439 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 00:57:07.853492 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1770,"thread_start_us":109,"threads_started":1}
I20260811 00:57:07.855691 2743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:57:07.837524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35780 (local address 127.15.70.2:44647)
0811 00:57:07.839110 (+ 1586us) server_negotiation.cc:206] Beginning negotiation
0811 00:57:07.839120 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 00:57:07.839135 (+ 15us) server_negotiation.cc:407] Connection header received
0811 00:57:07.839197 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:57:07.839200 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:57:07.839220 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:57:07.839304 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:57:07.840635 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:57:07.841879 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:57:07.847461 (+ 5582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:57:07.848553 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:57:07.848658 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:57:07.848794 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 00:57:07.855443 (+ 6649us) server_negotiation.cc:299] Negotiation successful
0811 00:57:07.855541 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1529,"thread_start_us":99,"threads_started":1}
I20260811 00:57:07.856640 2744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:57:07.837944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55626 (local address 127.15.70.3:36289)
0811 00:57:07.839539 (+ 1595us) server_negotiation.cc:206] Beginning negotiation
0811 00:57:07.839544 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:57:07.839735 (+ 191us) server_negotiation.cc:407] Connection header received
0811 00:57:07.839783 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:57:07.839786 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:57:07.839802 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:57:07.839871 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:57:07.842340 (+ 2469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:57:07.845419 (+ 3079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:57:07.851305 (+ 5886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:57:07.852553 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:57:07.852697 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:57:07.852827 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 00:57:07.856429 (+ 3602us) server_negotiation.cc:299] Negotiation successful
0811 00:57:07.856519 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1542,"thread_start_us":97,"threads_started":1}
I20260811 00:57:07.857158 2734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:57:07.837363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:36289 (local address 127.0.0.1:55626)
0811 00:57:07.839618 (+ 2255us) negotiation.cc:107] Waiting for socket to connect
0811 00:57:07.839628 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:57:07.839683 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:57:07.842003 (+ 2320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:57:07.842005 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:57:07.842010 (+ 5us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:57:07.842170 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:57:07.842177 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:57:07.848972 (+ 6795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:57:07.848973 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:57:07.850977 (+ 2004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:57:07.850983 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:57:07.852879 (+ 1896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:57:07.852881 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:57:07.853117 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:57:07.853124 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 00:57:07.853192 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 00:57:07.853256 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2233,"thread_start_us":68,"threads_started":1}
I20260811 00:57:07.857033 2330 tablet_service.cc:1467] Processing CreateTablet for tablet a10eaf445e794338874ef46451e9431f (DEFAULT_TABLE table=test-table [id=944208dd95a040ca87a12474cf1a03a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:57:07.857614 2330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a10eaf445e794338874ef46451e9431f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:57:07.857673 2740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:57:07.837306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53422 (local address 127.15.70.1:46201)
0811 00:57:07.844766 (+ 7460us) server_negotiation.cc:206] Beginning negotiation
0811 00:57:07.844774 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 00:57:07.844795 (+ 21us) server_negotiation.cc:407] Connection header received
0811 00:57:07.844865 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:57:07.844868 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:57:07.844896 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:57:07.845057 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:57:07.845432 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:57:07.846750 (+ 1318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:57:07.851123 (+ 4373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:57:07.852601 (+ 1478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:57:07.852715 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:57:07.852804 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 00:57:07.857472 (+ 4668us) server_negotiation.cc:299] Negotiation successful
0811 00:57:07.857574 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7385,"thread_start_us":111,"threads_started":1}
I20260811 00:57:07.858670 2115 tablet_service.cc:1467] Processing CreateTablet for tablet a10eaf445e794338874ef46451e9431f (DEFAULT_TABLE table=test-table [id=944208dd95a040ca87a12474cf1a03a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:57:07.859334 2115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a10eaf445e794338874ef46451e9431f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:57:07.866925 2593 tablet_service.cc:1467] Processing CreateTablet for tablet a10eaf445e794338874ef46451e9431f (DEFAULT_TABLE table=test-table [id=944208dd95a040ca87a12474cf1a03a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:57:07.867558 2593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a10eaf445e794338874ef46451e9431f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:57:07.872417 2745 tablet_bootstrap.cc:492] T a10eaf445e794338874ef46451e9431f P 9376ce98198a4e16a28f6f3ffecdf207: Bootstrap starting.
I20260811 00:57:07.874526 2745 tablet_bootstrap.cc:654] T a10eaf445e794338874ef46451e9431f P 9376ce98198a4e16a28f6f3ffecdf207: Neither blocks nor log segments found. Creating new log.
I20260811 00:57:07.874650 2747 tablet_bootstrap.cc:492] T a10eaf445e794338874ef46451e9431f P 4b726586877f4a079035eba0aad9f58f: Bootstrap starting.
I20260811 00:57:07.875252 2745 log.cc:824] T a10eaf445e794338874ef46451e9431f P 9376ce98198a4e16a28f6f3ffecdf207: Log is configured to *not* fsync() on all Append() calls
I20260811 00:57:07.876361 2747 tablet_bootstrap.cc:654] T a10eaf445e794338874ef46451e9431f P 4b726586877f4a079035eba0aad9f58f: Neither blocks nor log segments found. Creating new log.
I20260811 00:57:07.876708 2746 tablet_bootstrap.cc:492] T a10eaf445e794338874ef46451e9431f P 8a4357aeee23446b83c72f644bfc0900: Bootstrap starting.
I20260811 00:57:07.877899 2746 tablet_bootstrap.cc:654] T a10eaf445e794338874ef46451e9431f P 8a4357aeee23446b83c72f644bfc0900: Neither blocks nor log segments found. Creating new log.
I20260811 00:57:07.878466 2747 log.cc:824] T a10eaf445e794338874ef46451e9431f P 4b726586877f4a079035eba0aad9f58f: Log is configured to *not* fsync() on all Append() calls
I20260811 00:57:07.880499 2745 tablet_bootstrap.cc:492] T a10eaf445e794338874ef46451e9431f P 9376ce98198a4e16a28f6f3ffecdf207: No bootstrap required, opened a new log
I20260811 00:57:07.880672 2745 ts_tablet_manager.cc:1397] T a10eaf445e794338874ef46451e9431f P 9376ce98198a4e16a28f6f3ffecdf207: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.003s
I20260811 00:57:07.883662 2745 raft_consensus.cc:348] T a10eaf445e794338874ef46451e9431f P 9376ce98198a4e16a28f6f3ffecdf207 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9376ce98198a4e16a28f6f3ffecdf207" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 44647 } } peers { permanent_uuid: "8a4357aeee23446b83c72f644bfc0900" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 46201 } } peers { permanent_uuid: "4b726586877f4a079035eba0aad9f58f" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36289 } }
I20260811 00:57:07.887099 2745 raft_consensus.cc:374] T a10eaf445e794338874ef46451e9431f P 9376ce98198a4e16a28f6f3ffecdf207 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:57:07.887398 2745 raft_consensus.cc:729] T a10eaf445e794338874ef46451e9431f P 9376ce98198a4e16a28f6f3ffecdf207 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9376ce98198a4e16a28f6f3ffecdf207, State: Initialized, Role: FOLLOWER
I20260811 00:57:07.887823 2745 consensus_queue.cc:260] T a10eaf445e794338874ef46451e9431f P 9376ce98198a4e16a28f6f3ffecdf207 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9376ce98198a4e16a28f6f3ffecdf207" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 44647 } } peers { permanent_uuid: "8a4357aeee23446b83c72f644bfc0900" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 46201 } } peers { permanent_uuid: "4b726586877f4a079035eba0aad9f58f" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36289 } }
I20260811 00:57:07.890236 2745 ts_tablet_manager.cc:1428] T a10eaf445e794338874ef46451e9431f P 9376ce98198a4e16a28f6f3ffecdf207: Time spent starting tablet: real 0.009s user 0.003s sys 0.001s
I20260811 00:57:07.890522 2468 heartbeater.cc:503] Master 127.15.70.62:38671 was elected leader, sending a full tablet report...
I20260811 00:57:07.901513 2746 log.cc:824] T a10eaf445e794338874ef46451e9431f P 8a4357aeee23446b83c72f644bfc0900: Log is configured to *not* fsync() on all Append() calls
I20260811 00:57:07.905753 2747 tablet_bootstrap.cc:492] T a10eaf445e794338874ef46451e9431f P 4b726586877f4a079035eba0aad9f58f: No bootstrap required, opened a new log
I20260811 00:57:07.906112 2747 ts_tablet_manager.cc:1397] T a10eaf445e794338874ef46451e9431f P 4b726586877f4a079035eba0aad9f58f: Time spent bootstrapping tablet: real 0.032s user 0.004s sys 0.000s
I20260811 00:57:07.909271 2747 raft_consensus.cc:348] T a10eaf445e794338874ef46451e9431f P 4b726586877f4a079035eba0aad9f58f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9376ce98198a4e16a28f6f3ffecdf207" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 44647 } } peers { permanent_uuid: "8a4357aeee23446b83c72f644bfc0900" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 46201 } } peers { permanent_uuid: "4b726586877f4a079035eba0aad9f58f" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36289 } }
I20260811 00:57:07.909687 2747 raft_consensus.cc:374] T a10eaf445e794338874ef46451e9431f P 4b726586877f4a079035eba0aad9f58f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:57:07.909790 2747 raft_consensus.cc:729] T a10eaf445e794338874ef46451e9431f P 4b726586877f4a079035eba0aad9f58f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b726586877f4a079035eba0aad9f58f, State: Initialized, Role: FOLLOWER
I20260811 00:57:07.910069 2747 consensus_queue.cc:260] T a10eaf445e794338874ef46451e9431f P 4b726586877f4a079035eba0aad9f58f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9376ce98198a4e16a28f6f3ffecdf207" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 44647 } } peers { permanent_uuid: "8a4357aeee23446b83c72f644bfc0900" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 46201 } } peers { permanent_uuid: "4b726586877f4a079035eba0aad9f58f" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36289 } }
I20260811 00:57:07.910567 2747 ts_tablet_manager.cc:1428] T a10eaf445e794338874ef46451e9431f P 4b726586877f4a079035eba0aad9f58f: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260811 00:57:07.910780 2713 heartbeater.cc:503] Master 127.15.70.62:38671 was elected leader, sending a full tablet report...
I20260811 00:57:07.914530 2746 tablet_bootstrap.cc:492] T a10eaf445e794338874ef46451e9431f P 8a4357aeee23446b83c72f644bfc0900: No bootstrap required, opened a new log
I20260811 00:57:07.914700 2746 ts_tablet_manager.cc:1397] T a10eaf445e794338874ef46451e9431f P 8a4357aeee23446b83c72f644bfc0900: Time spent bootstrapping tablet: real 0.038s user 0.003s sys 0.000s
I20260811 00:57:07.919191 2746 raft_consensus.cc:348] T a10eaf445e794338874ef46451e9431f P 8a4357aeee23446b83c72f644bfc0900 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9376ce98198a4e16a28f6f3ffecdf207" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 44647 } } peers { permanent_uuid: "8a4357aeee23446b83c72f644bfc0900" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 46201 } } peers { permanent_uuid: "4b726586877f4a079035eba0aad9f58f" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36289 } }
I20260811 00:57:07.919675 2746 raft_consensus.cc:374] T a10eaf445e794338874ef46451e9431f P 8a4357aeee23446b83c72f644bfc0900 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:57:07.919809 2746 raft_consensus.cc:729] T a10eaf445e794338874ef46451e9431f P 8a4357aeee23446b83c72f644bfc0900 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a4357aeee23446b83c72f644bfc0900, State: Initialized, Role: FOLLOWER
I20260811 00:57:07.920099 2746 consensus_queue.cc:260] T a10eaf445e794338874ef46451e9431f P 8a4357aeee23446b83c72f644bfc0900 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9376ce98198a4e16a28f6f3ffecdf207" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 44647 } } peers { permanent_uuid: "8a4357aeee23446b83c72f644bfc0900" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 46201 } } peers { permanent_uuid: "4b726586877f4a079035eba0aad9f58f" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36289 } }
I20260811 00:57:07.920674 2746 ts_tablet_manager.cc:1428] T a10eaf445e794338874ef46451e9431f P 8a4357aeee23446b83c72f644bfc0900: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260811 00:57:07.920940 2234 heartbeater.cc:503] Master 127.15.70.62:38671 was elected leader, sending a full tablet report...
Aug 11 00:57:07 dist-test-slave-h3ft krb5kdc[1039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409827, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for HTTP/127.15.70.20@KRBTEST.COM
W20260811 00:57:08.022598 2714 tablet.cc:2369] T a10eaf445e794338874ef46451e9431f P 4b726586877f4a079035eba0aad9f58f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 00:57:08.037552 2235 tablet.cc:2369] T a10eaf445e794338874ef46451e9431f P 8a4357aeee23446b83c72f644bfc0900: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 00:57:08.112532 2471 tablet.cc:2369] T a10eaf445e794338874ef46451e9431f P 9376ce98198a4e16a28f6f3ffecdf207: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 00:57:08.147949 2750 raft_consensus.cc:482] T a10eaf445e794338874ef46451e9431f P 9376ce98198a4e16a28f6f3ffecdf207 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:57:08.148209 2750 raft_consensus.cc:504] T a10eaf445e794338874ef46451e9431f P 9376ce98198a4e16a28f6f3ffecdf207 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9376ce98198a4e16a28f6f3ffecdf207" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 44647 } } peers { permanent_uuid: "8a4357aeee23446b83c72f644bfc0900" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 46201 } } peers { permanent_uuid: "4b726586877f4a079035eba0aad9f58f" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36289 } }
I20260811 00:57:08.148794 2750 leader_election.cc:288] T a10eaf445e794338874ef46451e9431f P 9376ce98198a4e16a28f6f3ffecdf207 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a4357aeee23446b83c72f644bfc0900 (127.15.70.1:46201), 4b726586877f4a079035eba0aad9f58f (127.15.70.3:36289)
I20260811 00:57:08.153273 2753 raft_consensus.cc:482] T a10eaf445e794338874ef46451e9431f P 4b726586877f4a079035eba0aad9f58f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:57:08.153487 2753 raft_consensus.cc:504] T a10eaf445e794338874ef46451e9431f P 4b726586877f4a079035eba0aad9f58f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9376ce98198a4e16a28f6f3ffecdf207" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 44647 } } peers { permanent_uuid: "8a4357aeee23446b83c72f644bfc0900" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 46201 } } peers { permanent_uuid: "4b726586877f4a079035eba0aad9f58f" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36289 } }
I20260811 00:57:08.154081 2753 leader_election.cc:288] T a10eaf445e794338874ef46451e9431f P 4b726586877f4a079035eba0aad9f58f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9376ce98198a4e16a28f6f3ffecdf207 (127.15.70.2:44647), 8a4357aeee23446b83c72f644bfc0900 (127.15.70.1:46201)
I20260811 00:57:08.154973 2740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:57:08.149912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:40313 (local address 127.15.70.1:46201)
0811 00:57:08.149988 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 00:57:08.149992 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:57:08.150713 (+ 721us) server_negotiation.cc:407] Connection header received
0811 00:57:08.150846 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:57:08.150848 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:57:08.150866 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:57:08.150900 (+ 34us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:57:08.151236 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:57:08.152055 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:57:08.153681 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:57:08.154265 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:57:08.154318 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:57:08.154335 (+ 17us) server_negotiation.cc:1035] Waiting for connection context
0811 00:57:08.154788 (+ 453us) server_negotiation.cc:299] Negotiation successful
0811 00:57:08.154864 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 00:57:08.155344 2758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:57:08.149266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:46201 (local address 127.15.70.2:40313)
0811 00:57:08.150604 (+ 1338us) negotiation.cc:107] Waiting for socket to connect
0811 00:57:08.150619 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 00:57:08.150756 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:57:08.150988 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:57:08.150990 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:57:08.150992 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:57:08.151145 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:57:08.151149 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:57:08.152196 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:57:08.152197 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:57:08.153521 (+ 1324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:57:08.153526 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:57:08.154573 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:57:08.154574 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:57:08.154687 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:57:08.154694 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 00:57:08.155161 (+ 467us) client_negotiation.cc:240] Negotiation successful
0811 00:57:08.155227 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1306,"thread_start_us":176,"threads_started":1}
I20260811 00:57:08.156052 2154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a10eaf445e794338874ef46451e9431f" candidate_uuid: "9376ce98198a4e16a28f6f3ffecdf207" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a4357aeee23446b83c72f644bfc0900" is_pre_election: true
I20260811 00:57:08.156328 2154 raft_consensus.cc:2454] T a10eaf445e794338874ef46451e9431f P 8a4357aeee23446b83c72f644bfc0900 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9376ce98198a4e16a28f6f3ffecdf207 in term 0.
I20260811 00:57:08.157400 2276 leader_election.cc:302] T a10eaf445e794338874ef46451e9431f P 9376ce98198a4e16a28f6f3ffecdf207 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a4357aeee23446b83c72f644bfc0900, 9376ce98198a4e16a28f6f3ffecdf207; no voters:
I20260811 00:57:08.157608 2750 raft_consensus.cc:2781] T a10eaf445e794338874ef46451e9431f P 9376ce98198a4e16a28f6f3ffecdf207 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:57:08.157665 2750 raft_consensus.cc:482] T a10eaf445e794338874ef46451e9431f P 9376ce98198a4e16a28f6f3ffecdf207 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:57:08.157689 2750 raft_consensus.cc:3037] T a10eaf445e794338874ef46451e9431f P 9376ce98198a4e16a28f6f3ffecdf207 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:57:08.159360 2716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:57:08.154330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.2:44647 (local address 127.15.70.3:56955)
0811 00:57:08.154381 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 00:57:08.154399 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 00:57:08.154447 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:57:08.155424 (+ 977us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:57:08.155426 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:57:08.155429 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:57:08.155533 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:57:08.155536 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:57:08.156614 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:57:08.156616 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:57:08.158083 (+ 1467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:57:08.158090 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:57:08.158959 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:57:08.158960 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:57:08.159107 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:57:08.159113 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 00:57:08.159173 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 00:57:08.159252 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260811 00:57:08.159570 2750 raft_consensus.cc:504] T a10eaf445e794338874ef46451e9431f P 9376ce98198a4e16a28f6f3ffecdf207 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9376ce98198a4e16a28f6f3ffecdf207" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 44647 } } peers { permanent_uuid: "8a4357aeee23446b83c72f644bfc0900" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 46201 } } peers { permanent_uuid: "4b726586877f4a079035eba0aad9f58f" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36289 } }
I20260811 00:57:08.159776 2750 leader_election.cc:288] T a10eaf445e794338874ef46451e9431f P 9376ce98198a4e16a28f6f3ffecdf207 [CANDIDATE]: Term 1 election: Requested vote from peers 8a4357aeee23446b83c72f644bfc0900 (127.15.70.1:46201), 4b726586877f4a079035eba0aad9f58f (127.15.70.3:36289)
I20260811 00:57:08.160179 2743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:57:08.155146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:56955 (local address 127.15.70.2:44647)
0811 00:57:08.155216 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 00:57:08.155218 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:57:08.155229 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:57:08.155258 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:57:08.155259 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:57:08.155270 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:57:08.155355 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:57:08.155653 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:57:08.156469 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:57:08.158209 (+ 1740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:57:08.158792 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:57:08.158874 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:57:08.158910 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0811 00:57:08.160057 (+ 1147us) server_negotiation.cc:299] Negotiation successful
0811 00:57:08.160109 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 00:57:08.160482 2390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a10eaf445e794338874ef46451e9431f" candidate_uuid: "4b726586877f4a079035eba0aad9f58f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9376ce98198a4e16a28f6f3ffecdf207" is_pre_election: true
I20260811 00:57:08.160627 2390 raft_consensus.cc:2379] T a10eaf445e794338874ef46451e9431f P 9376ce98198a4e16a28f6f3ffecdf207 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b726586877f4a079035eba0aad9f58f in current term 1: Already voted for candidate 9376ce98198a4e16a28f6f3ffecdf207 in this term.
I20260811 00:57:08.161280 2154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a10eaf445e794338874ef46451e9431f" candidate_uuid: "9376ce98198a4e16a28f6f3ffecdf207" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a4357aeee23446b83c72f644bfc0900"
I20260811 00:57:08.161398 2154 raft_consensus.cc:3037] T a10eaf445e794338874ef46451e9431f P 8a4357aeee23446b83c72f644bfc0900 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:57:08.162663 2154 raft_consensus.cc:2454] T a10eaf445e794338874ef46451e9431f P 8a4357aeee23446b83c72f644bfc0900 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9376ce98198a4e16a28f6f3ffecdf207 in term 1.
I20260811 00:57:08.162971 2276 leader_election.cc:302] T a10eaf445e794338874ef46451e9431f P 9376ce98198a4e16a28f6f3ffecdf207 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a4357aeee23446b83c72f644bfc0900, 9376ce98198a4e16a28f6f3ffecdf207; no voters:
I20260811 00:57:08.163219 2750 raft_consensus.cc:2781] T a10eaf445e794338874ef46451e9431f P 9376ce98198a4e16a28f6f3ffecdf207 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:57:08.163444 2750 raft_consensus.cc:686] T a10eaf445e794338874ef46451e9431f P 9376ce98198a4e16a28f6f3ffecdf207 [term 1 LEADER]: Becoming Leader. State: Replica: 9376ce98198a4e16a28f6f3ffecdf207, State: Running, Role: LEADER
I20260811 00:57:08.163749 2750 consensus_queue.cc:237] T a10eaf445e794338874ef46451e9431f P 9376ce98198a4e16a28f6f3ffecdf207 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9376ce98198a4e16a28f6f3ffecdf207" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 44647 } } peers { permanent_uuid: "8a4357aeee23446b83c72f644bfc0900" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 46201 } } peers { permanent_uuid: "4b726586877f4a079035eba0aad9f58f" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36289 } }
I20260811 00:57:08.163913 2716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:57:08.154330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:46201 (local address 127.15.70.3:43977)
0811 00:57:08.159594 (+ 5264us) negotiation.cc:107] Waiting for socket to connect
0811 00:57:08.159611 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 00:57:08.159675 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:57:08.160288 (+ 613us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:57:08.160290 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:57:08.160292 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:57:08.160342 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:57:08.160344 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:57:08.161341 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:57:08.161343 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:57:08.162401 (+ 1058us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:57:08.162405 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:57:08.163491 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:57:08.163493 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:57:08.163562 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:57:08.163565 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:57:08.163615 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 00:57:08.163667 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5242,"thread_start_us":195,"threads_started":1}
I20260811 00:57:08.164024 2744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:57:08.150185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:54639 (local address 127.15.70.3:36289)
0811 00:57:08.150270 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0811 00:57:08.150272 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:57:08.154533 (+ 4261us) server_negotiation.cc:407] Connection header received
0811 00:57:08.154640 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:57:08.154641 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:57:08.154653 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:57:08.154686 (+ 33us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:57:08.154949 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:57:08.155695 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:57:08.162801 (+ 7106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:57:08.163421 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:57:08.163469 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:57:08.163480 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 00:57:08.163891 (+ 411us) server_negotiation.cc:299] Negotiation successful
0811 00:57:08.163960 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 00:57:08.164218 2740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:57:08.154875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:43977 (local address 127.15.70.1:46201)
0811 00:57:08.155101 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0811 00:57:08.155102 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:57:08.159893 (+ 4791us) server_negotiation.cc:407] Connection header received
0811 00:57:08.159931 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:57:08.159933 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:57:08.159947 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:57:08.159996 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:57:08.160430 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:57:08.161213 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:57:08.162534 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:57:08.163352 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:57:08.163430 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:57:08.163447 (+ 17us) server_negotiation.cc:1035] Waiting for connection context
0811 00:57:08.164038 (+ 591us) server_negotiation.cc:299] Negotiation successful
0811 00:57:08.164125 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":206,"thread_start_us":169,"threads_started":1}
I20260811 00:57:08.164304 2757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:57:08.150251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:36289 (local address 127.15.70.2:54639)
0811 00:57:08.154458 (+ 4207us) negotiation.cc:107] Waiting for socket to connect
0811 00:57:08.154470 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 00:57:08.154565 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:57:08.154762 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:57:08.154764 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:57:08.154766 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:57:08.154860 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:57:08.154862 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:57:08.155832 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:57:08.155834 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:57:08.157414 (+ 1580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:57:08.157418 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:57:08.163566 (+ 6148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:57:08.163568 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:57:08.163667 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:57:08.163673 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 00:57:08.164106 (+ 433us) client_negotiation.cc:240] Negotiation successful
0811 00:57:08.164183 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4181,"thread_start_us":228,"threads_started":1}
I20260811 00:57:08.164744 2600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a10eaf445e794338874ef46451e9431f" candidate_uuid: "9376ce98198a4e16a28f6f3ffecdf207" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b726586877f4a079035eba0aad9f58f" is_pre_election: true
I20260811 00:57:08.164932 2600 raft_consensus.cc:2454] T a10eaf445e794338874ef46451e9431f P 4b726586877f4a079035eba0aad9f58f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9376ce98198a4e16a28f6f3ffecdf207 in term 0.
I20260811 00:57:08.165045 2627 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a10eaf445e794338874ef46451e9431f" candidate_uuid: "9376ce98198a4e16a28f6f3ffecdf207" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b726586877f4a079035eba0aad9f58f"
I20260811 00:57:08.165102 2627 raft_consensus.cc:3037] T a10eaf445e794338874ef46451e9431f P 4b726586877f4a079035eba0aad9f58f [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:57:08.166200 2627 raft_consensus.cc:2454] T a10eaf445e794338874ef46451e9431f P 4b726586877f4a079035eba0aad9f58f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9376ce98198a4e16a28f6f3ffecdf207 in term 1.
I20260811 00:57:08.167155 2154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a10eaf445e794338874ef46451e9431f" candidate_uuid: "4b726586877f4a079035eba0aad9f58f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a4357aeee23446b83c72f644bfc0900" is_pre_election: true
I20260811 00:57:08.167323 2154 raft_consensus.cc:2379] T a10eaf445e794338874ef46451e9431f P 8a4357aeee23446b83c72f644bfc0900 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b726586877f4a079035eba0aad9f58f in current term 1: Already voted for candidate 9376ce98198a4e16a28f6f3ffecdf207 in this term.
I20260811 00:57:08.167702 2512 leader_election.cc:302] T a10eaf445e794338874ef46451e9431f P 4b726586877f4a079035eba0aad9f58f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b726586877f4a079035eba0aad9f58f; no voters: 8a4357aeee23446b83c72f644bfc0900, 9376ce98198a4e16a28f6f3ffecdf207
I20260811 00:57:08.167929 2753 raft_consensus.cc:2726] T a10eaf445e794338874ef46451e9431f P 4b726586877f4a079035eba0aad9f58f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 00:57:08.168483 1848 catalog_manager.cc:5495] T a10eaf445e794338874ef46451e9431f P 9376ce98198a4e16a28f6f3ffecdf207 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9376ce98198a4e16a28f6f3ffecdf207 (127.15.70.2). New cstate: current_term: 1 leader_uuid: "9376ce98198a4e16a28f6f3ffecdf207" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9376ce98198a4e16a28f6f3ffecdf207" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 44647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a4357aeee23446b83c72f644bfc0900" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 46201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b726586877f4a079035eba0aad9f58f" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36289 } health_report { overall_health: UNKNOWN } } }
I20260811 00:57:08.220072 2743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:57:08.216030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35788 (local address 127.15.70.2:44647)
0811 00:57:08.216099 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 00:57:08.216102 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:57:08.216114 (+ 12us) server_negotiation.cc:407] Connection header received
0811 00:57:08.216188 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:57:08.216189 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:57:08.216220 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:57:08.216339 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:57:08.216560 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:57:08.217345 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:57:08.218635 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:57:08.218948 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:57:08.219233 (+ 285us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:57:08.219305 (+ 72us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:57:08.219497 (+ 192us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:57:08.219580 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 00:57:08.219904 (+ 324us) server_negotiation.cc:299] Negotiation successful
0811 00:57:08.219933 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 00:57:08.223614 2627 raft_consensus.cc:1261] T a10eaf445e794338874ef46451e9431f P 4b726586877f4a079035eba0aad9f58f [term 1 FOLLOWER]: Refusing update from remote peer 9376ce98198a4e16a28f6f3ffecdf207: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:57:08.223590 2154 raft_consensus.cc:1261] T a10eaf445e794338874ef46451e9431f P 8a4357aeee23446b83c72f644bfc0900 [term 1 FOLLOWER]: Refusing update from remote peer 9376ce98198a4e16a28f6f3ffecdf207: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:57:08.224116 2750 consensus_queue.cc:1035] T a10eaf445e794338874ef46451e9431f P 9376ce98198a4e16a28f6f3ffecdf207 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b726586877f4a079035eba0aad9f58f" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:57:08.224766 2765 consensus_queue.cc:1035] T a10eaf445e794338874ef46451e9431f P 9376ce98198a4e16a28f6f3ffecdf207 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a4357aeee23446b83c72f644bfc0900" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 46201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:57:08.235672 2770 mvcc.cc:205] Tried to move back new op lower bound from 7317134656398577664 to 7317134656159866880. Current Snapshot: MvccSnapshot[applied={T|T < 7317134656398577664}]
I20260811 00:57:08.236193 2771 mvcc.cc:205] Tried to move back new op lower bound from 7317134656398577664 to 7317134656159866880. Current Snapshot: MvccSnapshot[applied={T|T < 7317134656398577664}]
I20260811 00:57:08.239073 2776 mvcc.cc:205] Tried to move back new op lower bound from 7317134656398577664 to 7317134656159866880. Current Snapshot: MvccSnapshot[applied={T|T < 7317134656398577664}]
I20260811 00:57:08.245272 1848 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49074:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:57:08.245479 1848 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49074:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:57:08.247036 1848 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c6dc72924c7f40249733cf9801ecce3c: Sending DeleteTablet for 3 replicas of tablet a10eaf445e794338874ef46451e9431f
I20260811 00:57:08.247912 2115 tablet_service.cc:1514] Processing DeleteTablet for tablet a10eaf445e794338874ef46451e9431f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:57:08 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:53422
I20260811 00:57:08.248277 2593 tablet_service.cc:1514] Processing DeleteTablet for tablet a10eaf445e794338874ef46451e9431f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:57:08 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:55626
I20260811 00:57:08.249140 2330 tablet_service.cc:1514] Processing DeleteTablet for tablet a10eaf445e794338874ef46451e9431f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:57:08 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:35780
I20260811 00:57:08.249706 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 1991
I20260811 00:57:08.261132 2795 tablet_replica.cc:330] T a10eaf445e794338874ef46451e9431f P 9376ce98198a4e16a28f6f3ffecdf207: stopping tablet replica
I20260811 00:57:08.261359 2795 raft_consensus.cc:2229] T a10eaf445e794338874ef46451e9431f P 9376ce98198a4e16a28f6f3ffecdf207 [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:57:08.261528 2795 raft_consensus.cc:2258] T a10eaf445e794338874ef46451e9431f P 9376ce98198a4e16a28f6f3ffecdf207 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:57:08.261912 2794 tablet_replica.cc:330] T a10eaf445e794338874ef46451e9431f P 4b726586877f4a079035eba0aad9f58f: stopping tablet replica
I20260811 00:57:08.262102 2794 raft_consensus.cc:2229] T a10eaf445e794338874ef46451e9431f P 4b726586877f4a079035eba0aad9f58f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:57:08.262284 2794 raft_consensus.cc:2258] T a10eaf445e794338874ef46451e9431f P 4b726586877f4a079035eba0aad9f58f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:57:08.273999 2795 ts_tablet_manager.cc:1905] T a10eaf445e794338874ef46451e9431f P 9376ce98198a4e16a28f6f3ffecdf207: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:57:08.274026 2794 ts_tablet_manager.cc:1905] T a10eaf445e794338874ef46451e9431f P 4b726586877f4a079035eba0aad9f58f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:57:08.276750 2795 ts_tablet_manager.cc:1918] T a10eaf445e794338874ef46451e9431f P 9376ce98198a4e16a28f6f3ffecdf207: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:57:08.276762 2794 ts_tablet_manager.cc:1918] T a10eaf445e794338874ef46451e9431f P 4b726586877f4a079035eba0aad9f58f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:57:08.276875 2795 log.cc:1196] T a10eaf445e794338874ef46451e9431f P 9376ce98198a4e16a28f6f3ffecdf207: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-1/wal/wals/a10eaf445e794338874ef46451e9431f
I20260811 00:57:08.276880 2794 log.cc:1196] T a10eaf445e794338874ef46451e9431f P 4b726586877f4a079035eba0aad9f58f: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409704606556-15640-0/minicluster-data/ts-2/wal/wals/a10eaf445e794338874ef46451e9431f
I20260811 00:57:08.277171 2795 ts_tablet_manager.cc:1939] T a10eaf445e794338874ef46451e9431f P 9376ce98198a4e16a28f6f3ffecdf207: Deleting consensus metadata
I20260811 00:57:08.277740 2794 ts_tablet_manager.cc:1939] T a10eaf445e794338874ef46451e9431f P 4b726586877f4a079035eba0aad9f58f: Deleting consensus metadata
I20260811 00:57:08.278232 1826 catalog_manager.cc:4841] TS 9376ce98198a4e16a28f6f3ffecdf207 (127.15.70.2:44647): tablet a10eaf445e794338874ef46451e9431f (table test-table [id=944208dd95a040ca87a12474cf1a03a1]) successfully deleted
I20260811 00:57:08.278316 1827 catalog_manager.cc:4841] TS 4b726586877f4a079035eba0aad9f58f (127.15.70.3:36289): tablet a10eaf445e794338874ef46451e9431f (table test-table [id=944208dd95a040ca87a12474cf1a03a1]) successfully deleted
W20260811 00:57:08.278733 1825 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.70.1:46201 (error 108)
I20260811 00:57:08.279758 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 2246
I20260811 00:57:08.304791 2734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:57:08.304524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:46201 (local address 127.0.0.1:53424)
0811 00:57:08.304613 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0811 00:57:08.304711 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.1:46201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260811 00:57:08.305069 1825 catalog_manager.cc:4584] TS 8a4357aeee23446b83c72f644bfc0900 (127.15.70.1:46201): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a10eaf445e794338874ef46451e9431f: Network error: Client connection negotiation failed: client connection to 127.15.70.1:46201: connect: Connection refused (error 111)
I20260811 00:57:08.312829 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 2481
I20260811 00:57:08.325644 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 1799
I20260811 00:57:08.355270 15640 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 00:57:08.721735 15640 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 00:57:08.721966 15640 mini_ranger.cc:66] Stopping Ranger...
I20260811 00:57:09.089533 15640 mini_ranger.cc:68] Stopped Ranger
2026-08-11 00:57:09.089 UTC [1093] LOG: received smart shutdown request
2026-08-11 00:57:09.097 UTC [1093] LOG: background worker "logical replication launcher" (PID 1116) exited with exit code 1
2026-08-11 00:57:09.097 UTC [1103] LOG: shutting down
2026-08-11 00:57:09.397 UTC [1093] LOG: database system is shut down
2026-08-11T00:57:09Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (57764 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:57:09 dist-test-slave-h3ft krb5kdc[2811](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:57:09 dist-test-slave-h3ft krb5kdc[2811](info): set up 2 sockets
Aug 11 00:57:09 dist-test-slave-h3ft krb5kdc[2811](info): commencing operation
krb5kdc: starting...
W20260811 00:57:10.950848 15640 mini_kdc.cc:121] Time spent starting KDC: real 1.381s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Aug 11 00:57:11 dist-test-slave-h3ft krb5kdc[2811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409831, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:57:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:57:11Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.15.70.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.15.70.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.15.70.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/rangeradmin_127.15.70.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.15.70.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/rangeradmin_127.15.70.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.15.70.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.15.70.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.15.70.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/rangerlookup_127.15.70.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.15.70.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/rangerlookup_127.15.70.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.15.70.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.15.70.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.15.70.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/HTTP_127.15.70.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.15.70.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/HTTP_127.15.70.20@KRBTEST.COM.keytab.
I20260811 00:57:11.196379 15640 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskN44M8g/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/postgres -l logfile start
2026-08-11 00:57:14.338 UTC [2858] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 00:57:14.338 UTC [2858] LOG: listening on IPv4 address "127.15.70.20", port 45081
2026-08-11 00:57:14.342 UTC [2858] LOG: listening on Unix socket "/tmp/.s.PGSQL.45081"
2026-08-11 00:57:14.367 UTC [2862] LOG: database system was shut down at 2026-08-11 00:57:12 UTC
2026-08-11 00:57:14.373 UTC [2858] LOG: database system is ready to accept connections
I20260811 00:57:15.601590 15640 mini_postgres.cc:96] Postgres bound to 45081
2026-08-11 00:57:15.610 UTC [2876] FATAL: database "slave" does not exist
127.15.70.20:45081 - accepting connections
I20260811 00:57:15.611691 15640 mini_ranger.cc:161] Starting Ranger...
I20260811 00:57:15.631137 15640 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 00:57:16.268204 15640 mini_ranger.cc:87] Created ranger Postgres database
I20260811 00:57:16.268294 15640 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ranger-admin
2026-08-11 00:57:16,575 [I] DB FLAVOR :POSTGRES
2026-08-11 00:57:16,576 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 00:57:16,576 [I] Checking connection..
2026-08-11 00:57:16,576 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:45081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 00:57:16,872 [I] Checking connection passed.
2026-08-11 00:57:16,873 [I] --------- Verifying version history table ---------
2026-08-11 00:57:16,873 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:45081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 00:57:17,161 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 00:57:17,162 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:45081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 00:57:17,448 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 00:57:17,448 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 00:57:17,448 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:45081/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 00:57:17.761 UTC [2971] WARNING: there is no transaction in progress
2026-08-11 00:57:17,773 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 00:57:17,774 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:45081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 00:57:18,078 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 00:57:18,078 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 00:57:18,079 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:45081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 00:57:18,394 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:45081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 00:57:18,670 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:45081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-h3ft.c.gcp-upstream.internal','N') ;"
2026-08-11 00:57:18,968 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:45081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 00:57:19,302 [I] Table x_portal_user does not exist in database ranger
2026-08-11 00:57:19,303 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:45081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 00:57:19,614 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 00:57:19,614 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:45081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 00:57:19,907 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:45081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 00:57:20,225 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 00:57:20,225 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:45081/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 00:57:21.510 UTC [3162] WARNING: there is no transaction in progress
2026-08-11 00:57:21.533 UTC [3162] WARNING: there is no transaction in progress
2026-08-11 00:57:21.555 UTC [3162] WARNING: there is no transaction in progress
2026-08-11 00:57:21.575 UTC [3162] WARNING: there is no transaction in progress
2026-08-11 00:57:21.596 UTC [3162] WARNING: there is no transaction in progress
2026-08-11 00:57:21.619 UTC [3162] WARNING: there is no transaction in progress
2026-08-11 00:57:21.700 UTC [3162] WARNING: there is no transaction in progress
2026-08-11 00:57:21.710 UTC [3162] WARNING: there is no transaction in progress
2026-08-11 00:57:21.730 UTC [3162] WARNING: there is no transaction in progress
2026-08-11 00:57:21.745 UTC [3162] WARNING: there is no transaction in progress
2026-08-11 00:57:21.757 UTC [3162] WARNING: there is no transaction in progress
2026-08-11 00:57:21.776 UTC [3162] WARNING: there is no transaction in progress
2026-08-11 00:57:21.790 UTC [3162] WARNING: there is no transaction in progress
2026-08-11 00:57:21.799 UTC [3162] WARNING: there is no transaction in progress
2026-08-11 00:57:21.808 UTC [3162] WARNING: there is no transaction in progress
2026-08-11 00:57:21.817 UTC [3162] WARNING: there is no transaction in progress
2026-08-11 00:57:22,666 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 00:57:22,666 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:45081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 00:57:22,956 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 00:57:22,956 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:45081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 00:57:23,260 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 00:57:23,260 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:45081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 00:57:23,592 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 00:57:23,592 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:45081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 00:57:23,885 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:45081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 00:57:24,194 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:45081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-h3ft.c.gcp-upstream.internal';"
2026-08-11 00:57:24,498 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 00:57:24,499 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:45081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 00:57:24,806 [I] DB_PATCHES have already been applied
I20260811 00:57:24.813364 15640 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ranger-admin:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskN44M8g/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 00:57:24.813467 15640 mini_ranger.cc:193] Using host: 127.15.70.20
I20260811 00:57:24.818893 15640 mini_ranger.cc:227] Ranger admin URL: http://127.15.70.20:38593
Aug 11, 2026 12:57:25 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 12:57:25 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 12:57:25 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 12:57:25 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 12:57:25 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 12:57:25 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 12:57:25 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 00:57:26.323372 15640 mini_ranger.cc:160] Time spent starting Ranger: real 10.712s user 0.007s sys 0.009s
Aug 11, 2026 12:57:50 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 12:57:50 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.XKeyREST
Aug 11, 2026 12:57:50 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 12:57:50 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 12:57:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 12:57:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 12:57:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 12:57:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 12:57:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 12:57:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 12:57:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 12:57:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 12:57:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 12:57:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 12:57:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 12:57:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 12:57:50 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 12:57:51 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 00:57:52.343921 15640 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.15.70.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.15.70.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.15.70.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/rangerkms_127.15.70.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.15.70.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/rangerkms_127.15.70.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.15.70.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.15.70.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.15.70.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/HTTP_127.15.70.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.15.70.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/HTTP_127.15.70.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 00:57:52 dist-test-slave-h3ft krb5kdc[2811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409872, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 00:57:52.464304 15640 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 00:57:52.484629 15640 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 00:57:53.357788 15640 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 00:57:53.357918 15640 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ranger-kms
I20260811 00:57:53.357946 15640 mini_ranger_kms.cc:227] Using postgres at 127.15.70.20:45081
2026-08-11 00:57:53,585 [I] DB FLAVOR :POSTGRES
2026-08-11 00:57:53,585 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 00:57:53,585 [I] Checking connection
2026-08-11 00:57:53,586 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:45081/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 00:57:53,885 [I] connection success
2026-08-11 00:57:53,886 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 00:57:53,886 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 00:57:53,886 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:45081/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 00:57:54,187 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 00:57:54,188 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 00:57:54,188 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 00:57:54,188 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.70.20:45081/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 00:57:54,510 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 00:57:55.111896 15640 mini_ranger_kms.cc:310] Created kms service
I20260811 00:57:55.322382 15640 mini_ranger_kms.cc:326] Created kudu user
I20260811 00:57:55.378293 15640 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 00:57:55 dist-test-slave-h3ft krb5kdc[2811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409872, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.15.70.20@KRBTEST.COM
I20260811 00:57:55.921762 15640 mini_ranger_kms.cc:384] Added ranger policy
I20260811 00:57:55.922060 15640 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ranger-kms:/tmp/dist-test-taskN44M8g/build/release/bin/postgresql.jar:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskN44M8g/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 00:57:55.922084 15640 mini_ranger_kms.cc:240] Using host: 127.15.70.20
I20260811 00:57:55.928540 15640 mini_ranger_kms.cc:276] Ranger KMS PID: 3481
I20260811 00:57:55.928663 15640 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.15.70.20:56721
Aug 11, 2026 12:57:56 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 12:57:56 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 12:57:57 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 12:57:57 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 12:57:57 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 12:57:57 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 00:57:58 dist-test-slave-h3ft krb5kdc[2811](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786409878, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.15.70.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:57:59.002238 15640 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.538s user 0.010s sys 0.203s
I20260811 00:57:59.002379 15640 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 00:57:59.002439 15640 mini_ranger_kms.cc:401] 127.15.70.20:56721/kms/v1/keys
Aug 11 00:57:59 dist-test-slave-h3ft krb5kdc[2811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409878, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.15.70.20@KRBTEST.COM for HTTP/127.15.70.20@KRBTEST.COM
Aug 11 00:57:59 dist-test-slave-h3ft krb5kdc[2811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409878, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.15.70.20@KRBTEST.COM for HTTP/127.15.70.20@KRBTEST.COM
Aug 11 00:58:02 dist-test-slave-h3ft krb5kdc[2811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409882, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.15.70.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
I20260811 00:58:02.351403 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:40183
--webserver_interface=127.15.70.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:34477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:40183
--ranger_config_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.70.20:56721/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:58:02.464687 3566 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:58:02.464985 3566 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:58:02.465011 3566 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:58:02.466352 3566 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:58:02.466403 3566 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:58:02.466416 3566 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:58:02.466429 3566 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:58:02.466442 3566 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:58:02.468324 3566 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:34477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/master-0/wal
--ranger_kms_url=127.15.70.20:56721/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:40183
--ranger_config_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:40183
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3566
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:58:02.468603 3566 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:58:02.468842 3566 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:58:02.474892 3572 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:02.474908 3577 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:02.474941 3574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:58:02.475364 3566 server_base.cc:1034] running on GCE node
I20260811 00:58:02.475760 3566 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:58:02.476183 3566 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:58:02.477386 3566 hybrid_clock.cc:648] HybridClock initialized: now 1786409882477384 us; error 70 us; skew 500 ppm
Aug 11 00:58:02 dist-test-slave-h3ft krb5kdc[2811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409882, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:58:02.481132 3566 init.cc:377] Logged in from keytab as kudu/127.15.70.62@KRBTEST.COM (short username kudu)
I20260811 00:58:02.481727 3566 webserver.cc:460] Webserver started at http://127.15.70.62:37259/ using document root <none> and password file <none>
I20260811 00:58:02.481988 3566 fs_manager.cc:359] Metadata directory not provided
I20260811 00:58:02.482033 3566 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:58:02.482156 3566 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 00:58:02 dist-test-slave-h3ft krb5kdc[2811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409882, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for HTTP/127.15.70.20@KRBTEST.COM
I20260811 00:58:02.540244 3566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "c844716782a14625a7b4c8bd637b67a7"
format_stamp: "Formatted at 2026-08-11 00:58:02 on dist-test-slave-h3ft"
server_key: "e886d9e0615bbcb1c77edb64a5e8f1b4"
server_key_iv: "73217dcc2ba6626163e8fbfcb32b525a"
server_key_version: "kuduclusterkey@0"
I20260811 00:58:02.540876 3566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "c844716782a14625a7b4c8bd637b67a7"
format_stamp: "Formatted at 2026-08-11 00:58:02 on dist-test-slave-h3ft"
server_key: "e886d9e0615bbcb1c77edb64a5e8f1b4"
server_key_iv: "73217dcc2ba6626163e8fbfcb32b525a"
server_key_version: "kuduclusterkey@0"
I20260811 00:58:02.543207 3566 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.001s
I20260811 00:58:02.562000 3588 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:02.562330 3566 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 00:58:02.562458 3566 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "c844716782a14625a7b4c8bd637b67a7"
format_stamp: "Formatted at 2026-08-11 00:58:02 on dist-test-slave-h3ft"
server_key: "e886d9e0615bbcb1c77edb64a5e8f1b4"
server_key_iv: "73217dcc2ba6626163e8fbfcb32b525a"
server_key_version: "kuduclusterkey@0"
I20260811 00:58:02.562610 3566 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:58:02.585085 3566 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:58:02.587997 3566 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:58:02.588241 3566 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:58:02.594141 3566 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:40183
I20260811 00:58:02.594178 3678 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:40183 every 8 connection(s)
I20260811 00:58:02.594652 3566 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:58:02.595579 3679 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:58:02.598520 3679 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7: Bootstrap starting.
I20260811 00:58:02.599408 3679 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7: Neither blocks nor log segments found. Creating new log.
I20260811 00:58:02.599715 3679 log.cc:824] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7: Log is configured to *not* fsync() on all Append() calls
I20260811 00:58:02.600687 3679 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7: No bootstrap required, opened a new log
I20260811 00:58:02.601855 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 3566
I20260811 00:58:02.601994 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 00:58:02.602214 15640 external_mini_cluster.cc:1428] Setting key c2acf3ca4b71969bed54f14e8fc2db9e
I20260811 00:58:02.603724 3679 raft_consensus.cc:348] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c844716782a14625a7b4c8bd637b67a7" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 40183 } }
I20260811 00:58:02.604055 3679 raft_consensus.cc:374] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:58:02.604146 3679 raft_consensus.cc:729] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c844716782a14625a7b4c8bd637b67a7, State: Initialized, Role: FOLLOWER
I20260811 00:58:02.604331 3679 consensus_queue.cc:260] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c844716782a14625a7b4c8bd637b67a7" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 40183 } }
I20260811 00:58:02.604421 3679 raft_consensus.cc:388] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:58:02.604447 3679 raft_consensus.cc:482] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:58:02.604521 3679 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:58:02.605276 3679 raft_consensus.cc:504] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c844716782a14625a7b4c8bd637b67a7" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 40183 } }
I20260811 00:58:02.605417 3679 leader_election.cc:302] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c844716782a14625a7b4c8bd637b67a7; no voters:
I20260811 00:58:02.605652 3679 leader_election.cc:288] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:58:02.605690 3688 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:58:02.605849 3688 raft_consensus.cc:686] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7 [term 1 LEADER]: Becoming Leader. State: Replica: c844716782a14625a7b4c8bd637b67a7, State: Running, Role: LEADER
I20260811 00:58:02.605954 3688 consensus_queue.cc:237] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c844716782a14625a7b4c8bd637b67a7" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 40183 } }
I20260811 00:58:02.606068 3679 sys_catalog.cc:564] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:58:02.606356 3688 sys_catalog.cc:455] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c844716782a14625a7b4c8bd637b67a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c844716782a14625a7b4c8bd637b67a7" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 40183 } } }
I20260811 00:58:02.606550 3688 sys_catalog.cc:458] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7 [sys.catalog]: This master's current role is: LEADER
I20260811 00:58:02.606793 3688 sys_catalog.cc:455] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c844716782a14625a7b4c8bd637b67a7. Latest consensus state: current_term: 1 leader_uuid: "c844716782a14625a7b4c8bd637b67a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c844716782a14625a7b4c8bd637b67a7" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 40183 } } }
I20260811 00:58:02.606876 3688 sys_catalog.cc:458] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7 [sys.catalog]: This master's current role is: LEADER
I20260811 00:58:02.607366 3698 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:58:02.608048 3698 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:58:02.608490 3679 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
Aug 11 00:58:02 dist-test-slave-h3ft krb5kdc[2811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409882, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:58:02.617722 3683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:02.603050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60838 (local address 127.15.70.62:40183)
0811 00:58:02.603354 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:02.603384 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:02.603810 (+ 426us) server_negotiation.cc:407] Connection header received
0811 00:58:02.604088 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:02.604098 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:02.604176 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:02.604363 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:02.605306 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:02.606933 (+ 1627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:02.608221 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:02.608959 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:02.609085 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:02.612787 (+ 3702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:02.612834 (+ 47us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:02.612834 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:02.612964 (+ 130us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:02.615711 (+ 2747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:02.616172 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:02.616176 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:02.616177 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:02.616306 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:02.616553 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:02.616554 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:02.616555 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:02.616895 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:02.617075 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:02.617204 (+ 129us) server_negotiation.cc:299] Negotiation successful
0811 00:58:02.617404 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":212,"thread_start_us":109,"threads_started":1}
I20260811 00:58:02.619819 3698 catalog_manager.cc:1347] Generated new cluster ID: 05270c688dbf432aa0c79caba266e51b
I20260811 00:58:02.619901 3698 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:58:02.631757 3698 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:58:02.632647 3698 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:58:02.640446 3698 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7: Generated new TSK 0
I20260811 00:58:02.640682 3698 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.70.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab.
Entry for principal kudu/127.15.70.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab.
I20260811 00:58:03.535946 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.70.20:56721/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.1:0
--local_ip_for_outbound_sockets=127.15.70.1
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:40183
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:34477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:58:03.669468 3756 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:58:03.669764 3756 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:58:03.669806 3756 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:58:03.671195 3756 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:58:03.671271 3756 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:58:03.671319 3756 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.1
I20260811 00:58:03.673121 3756 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:34477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.15.70.20:56721/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:40183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3756
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.1
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:58:03.673460 3756 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:58:03.673812 3756 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:58:03.680166 3766 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:03.680155 3772 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:03.680616 3769 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:58:03.681241 3756 server_base.cc:1034] running on GCE node
I20260811 00:58:03.681541 3756 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:58:03.681876 3756 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:58:03.685192 3756 hybrid_clock.cc:648] HybridClock initialized: now 1786409883685169 us; error 34 us; skew 500 ppm
Aug 11 00:58:03 dist-test-slave-h3ft krb5kdc[2811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409883, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:58:03.689213 3756 init.cc:377] Logged in from keytab as kudu/127.15.70.1@KRBTEST.COM (short username kudu)
I20260811 00:58:03.689970 3756 webserver.cc:460] Webserver started at http://127.15.70.1:44275/ using document root <none> and password file <none>
I20260811 00:58:03.690284 3756 fs_manager.cc:359] Metadata directory not provided
I20260811 00:58:03.690364 3756 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:58:03.690572 3756 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 00:58:03 dist-test-slave-h3ft krb5kdc[2811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409883, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for HTTP/127.15.70.20@KRBTEST.COM
I20260811 00:58:03.707711 3756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-0/data/instance:
uuid: "e47c73044b1743b3bc6942808fb63e67"
format_stamp: "Formatted at 2026-08-11 00:58:03 on dist-test-slave-h3ft"
server_key: "5f21e013e389c550329fcb1ac98fa173"
server_key_iv: "22674de039b0976c12aa2daf6f6a3ff0"
server_key_version: "kuduclusterkey@0"
I20260811 00:58:03.708339 3756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance:
uuid: "e47c73044b1743b3bc6942808fb63e67"
format_stamp: "Formatted at 2026-08-11 00:58:03 on dist-test-slave-h3ft"
server_key: "5f21e013e389c550329fcb1ac98fa173"
server_key_iv: "22674de039b0976c12aa2daf6f6a3ff0"
server_key_version: "kuduclusterkey@0"
I20260811 00:58:03.710384 3756 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 00:58:03.731321 3785 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:03.731727 3756 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260811 00:58:03.731863 3756 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-0/wal
uuid: "e47c73044b1743b3bc6942808fb63e67"
format_stamp: "Formatted at 2026-08-11 00:58:03 on dist-test-slave-h3ft"
server_key: "5f21e013e389c550329fcb1ac98fa173"
server_key_iv: "22674de039b0976c12aa2daf6f6a3ff0"
server_key_version: "kuduclusterkey@0"
I20260811 00:58:03.732002 3756 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:58:03.749336 3756 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:58:03.752475 3756 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:58:03.752738 3756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:58:03.753123 3756 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:58:03.753677 3756 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:58:03.753737 3756 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:03.753839 3756 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:58:03.753893 3756 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:03.763397 3756 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.1:37331
I20260811 00:58:03.763523 3978 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.1:37331 every 8 connection(s)
I20260811 00:58:03.763958 3756 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
I20260811 00:58:03.768069 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 3756
I20260811 00:58:03.768216 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance
I20260811 00:58:03.768481 15640 external_mini_cluster.cc:1428] Setting key 750bca39c9a3ef7a18b5e130e3a58b59
Aug 11 00:58:03 dist-test-slave-h3ft krb5kdc[2811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409883, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:58:03.779138 3982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:03.765107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:40183 (local address 127.15.70.1:37817)
0811 00:58:03.765359 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:03.765422 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:03.766186 (+ 764us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:03.766614 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:03.766620 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:03.766948 (+ 328us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:58:03.767341 (+ 393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:03.767349 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:03.768402 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:03.768404 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:03.769757 (+ 1353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:03.769762 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:03.770331 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:03.770333 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:03.770506 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:03.772178 (+ 1672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:58:03.772194 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:58:03.774368 (+ 2174us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:58:03.776960 (+ 2592us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:03.776969 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:03.776972 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:03.777351 (+ 379us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:03.777617 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:03.777618 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:03.777618 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:03.777788 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:03.778164 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:58:03.778171 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:58:03.778409 (+ 238us) client_negotiation.cc:769] Sending connection context
0811 00:58:03.778544 (+ 135us) client_negotiation.cc:240] Negotiation successful
0811 00:58:03.778770 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":113,"threads_started":1}
I20260811 00:58:03.779407 3983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:03.765477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:37817 (local address 127.15.70.62:40183)
0811 00:58:03.765648 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:03.765651 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:03.765666 (+ 15us) server_negotiation.cc:407] Connection header received
0811 00:58:03.766347 (+ 681us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:03.766349 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:03.766369 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:03.766478 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:03.767476 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:03.768277 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:03.769867 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:03.770122 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:03.770217 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:03.774512 (+ 4295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:03.774514 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:03.774515 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:03.774525 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:03.776822 (+ 2297us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:03.777454 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:03.777457 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:03.777457 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:03.777540 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:03.777864 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:03.777865 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:03.777866 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:03.778057 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:03.778132 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:03.779153 (+ 1021us) server_negotiation.cc:299] Negotiation successful
0811 00:58:03.779282 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":94,"threads_started":1}
I20260811 00:58:03.780746 3979 heartbeater.cc:347] Connected to a master server at 127.15.70.62:40183
I20260811 00:58:03.780887 3979 heartbeater.cc:464] Registering TS with master...
I20260811 00:58:03.781163 3979 heartbeater.cc:511] Master 127.15.70.62:40183 requested a full tablet report, sending...
I20260811 00:58:03.781978 3620 ts_manager.cc:194] Registered new tserver with Master: e47c73044b1743b3bc6942808fb63e67 (127.15.70.1:37331)
I20260811 00:58:03.783126 3620 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.1@KRBTEST.COM'} at 127.15.70.1:37817
WARNING: no policy specified for kudu/127.15.70.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab.
Entry for principal kudu/127.15.70.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab.
I20260811 00:58:03.823158 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.70.20:56721/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.2:0
--local_ip_for_outbound_sockets=127.15.70.2
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:40183
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:34477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 00:58:03 dist-test-slave-h3ft krb5kdc[2811](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786409883, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 00:58:03.979194 3988 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:58:03.979693 3988 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:58:03.979792 3988 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:58:03.981926 3988 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:58:03.982084 3988 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:58:03.982182 3988 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.2
I20260811 00:58:03.984920 3988 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:34477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.15.70.20:56721/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:40183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3988
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.2
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:58:03.985255 3988 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:58:03.985646 3988 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:58:03.993464 4001 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:03.993975 4007 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:03.994221 3999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:58:03.994835 3988 server_base.cc:1034] running on GCE node
I20260811 00:58:03.995138 3988 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:58:03.995488 3988 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:58:03.996686 3988 hybrid_clock.cc:648] HybridClock initialized: now 1786409883996650 us; error 47 us; skew 500 ppm
Aug 11 00:58:03 dist-test-slave-h3ft krb5kdc[2811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409883, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:58:04.000602 3988 init.cc:377] Logged in from keytab as kudu/127.15.70.2@KRBTEST.COM (short username kudu)
I20260811 00:58:04.001266 3988 webserver.cc:460] Webserver started at http://127.15.70.2:45857/ using document root <none> and password file <none>
I20260811 00:58:04.001574 3988 fs_manager.cc:359] Metadata directory not provided
I20260811 00:58:04.001636 3988 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:58:04.001838 3988 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 00:58:04 dist-test-slave-h3ft krb5kdc[2811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409883, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for HTTP/127.15.70.20@KRBTEST.COM
I20260811 00:58:04.020087 3988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-1/data/instance:
uuid: "6e13f85e85c04d4cb2c73124744006df"
format_stamp: "Formatted at 2026-08-11 00:58:04 on dist-test-slave-h3ft"
server_key: "938292e21b42bbbd592a7a14dc3b4b00"
server_key_iv: "761e818587f9f263856ebe2096bb52c0"
server_key_version: "kuduclusterkey@0"
I20260811 00:58:04.020965 3988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance:
uuid: "6e13f85e85c04d4cb2c73124744006df"
format_stamp: "Formatted at 2026-08-11 00:58:04 on dist-test-slave-h3ft"
server_key: "938292e21b42bbbd592a7a14dc3b4b00"
server_key_iv: "761e818587f9f263856ebe2096bb52c0"
server_key_version: "kuduclusterkey@0"
I20260811 00:58:04.027989 3988 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.002s
I20260811 00:58:04.050472 4020 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:04.050721 3988 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 00:58:04.050834 3988 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-1/wal
uuid: "6e13f85e85c04d4cb2c73124744006df"
format_stamp: "Formatted at 2026-08-11 00:58:04 on dist-test-slave-h3ft"
server_key: "938292e21b42bbbd592a7a14dc3b4b00"
server_key_iv: "761e818587f9f263856ebe2096bb52c0"
server_key_version: "kuduclusterkey@0"
I20260811 00:58:04.050976 3988 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:58:04.061688 3988 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:58:04.065361 3988 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:58:04.065662 3988 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:58:04.066020 3988 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:58:04.066668 3988 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:58:04.066771 3988 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:04.066854 3988 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:58:04.066923 3988 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:04.074903 3988 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.2:35717
I20260811 00:58:04.075626 3988 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
I20260811 00:58:04.076390 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 3988
I20260811 00:58:04.076536 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance
I20260811 00:58:04.076777 15640 external_mini_cluster.cc:1428] Setting key b9a8b8c8316891977300503ef611612a
I20260811 00:58:04.083271 4205 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.2:35717 every 8 connection(s)
WARNING: no policy specified for kudu/127.15.70.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.3@KRBTEST.COM" created.
Aug 11 00:58:04 dist-test-slave-h3ft krb5kdc[2811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409883, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:58:04.104210 3983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:04.084793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:49859 (local address 127.15.70.62:40183)
0811 00:58:04.084900 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:04.084904 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:04.087464 (+ 2560us) server_negotiation.cc:407] Connection header received
0811 00:58:04.088565 (+ 1101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:04.088568 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:04.088588 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:04.088629 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:04.089827 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:04.090711 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:04.092744 (+ 2033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:04.093111 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:04.093167 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:04.099691 (+ 6524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:04.099695 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:04.099695 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:04.099709 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:04.101914 (+ 2205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:04.102639 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:04.102640 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:04.102641 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:04.102713 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:04.103100 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:04.103102 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:04.103102 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:04.103299 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:04.103357 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:04.103852 (+ 495us) server_negotiation.cc:299] Negotiation successful
0811 00:58:04.104005 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 00:58:04.105396 4211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:04.084435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:40183 (local address 127.15.70.2:49859)
0811 00:58:04.087206 (+ 2771us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:04.087301 (+ 95us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:04.088377 (+ 1076us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:04.088905 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:04.088912 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:04.089287 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:58:04.089682 (+ 395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:04.089690 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:04.091100 (+ 1410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:04.091101 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:04.092619 (+ 1518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:04.092623 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:04.093312 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:04.093313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:04.093483 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:04.094216 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:58:04.094230 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:58:04.099484 (+ 5254us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:58:04.102082 (+ 2598us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:04.102100 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:04.102104 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:04.102534 (+ 430us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:04.102786 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:04.102787 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:04.102788 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:04.102961 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:04.103396 (+ 435us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:58:04.103404 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:58:04.103659 (+ 255us) client_negotiation.cc:769] Sending connection context
0811 00:58:04.104757 (+ 1098us) client_negotiation.cc:240] Negotiation successful
0811 00:58:04.105035 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2689,"thread_start_us":135,"threads_started":1}
I20260811 00:58:04.106488 4206 heartbeater.cc:347] Connected to a master server at 127.15.70.62:40183
I20260811 00:58:04.106635 4206 heartbeater.cc:464] Registering TS with master...
I20260811 00:58:04.106978 4206 heartbeater.cc:511] Master 127.15.70.62:40183 requested a full tablet report, sending...
I20260811 00:58:04.107566 3620 ts_manager.cc:194] Registered new tserver with Master: 6e13f85e85c04d4cb2c73124744006df (127.15.70.2:35717)
I20260811 00:58:04.108157 3620 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.2@KRBTEST.COM'} at 127.15.70.2:49859
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab.
Entry for principal kudu/127.15.70.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab.
I20260811 00:58:04.122835 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.70.20:56721/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.3:0
--local_ip_for_outbound_sockets=127.15.70.3
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:40183
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:34477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:58:04.259769 4215 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:58:04.260239 4215 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:58:04.260352 4215 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:58:04.262552 4215 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:58:04.262727 4215 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:58:04.262827 4215 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.3
I20260811 00:58:04.265837 4215 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:34477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.15.70.20:56721/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:40183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4215
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.3
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:58:04.266412 4215 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:58:04.266886 4215 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:58:04.274785 4222 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:04.275208 4227 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:04.275624 4221 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:58:04.277128 4215 server_base.cc:1034] running on GCE node
I20260811 00:58:04.277432 4215 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:58:04.277767 4215 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:58:04.279969 4215 hybrid_clock.cc:648] HybridClock initialized: now 1786409884279937 us; error 43 us; skew 500 ppm
Aug 11 00:58:04 dist-test-slave-h3ft krb5kdc[2811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409884, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:58:04.284081 4215 init.cc:377] Logged in from keytab as kudu/127.15.70.3@KRBTEST.COM (short username kudu)
I20260811 00:58:04.284711 4215 webserver.cc:460] Webserver started at http://127.15.70.3:43395/ using document root <none> and password file <none>
I20260811 00:58:04.285073 4215 fs_manager.cc:359] Metadata directory not provided
I20260811 00:58:04.285136 4215 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:58:04.285287 4215 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 00:58:04 dist-test-slave-h3ft krb5kdc[2811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409884, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for HTTP/127.15.70.20@KRBTEST.COM
I20260811 00:58:04.310669 4215 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-2/data/instance:
uuid: "8fd2b655dea141a097d7ac9cff3e9c6a"
format_stamp: "Formatted at 2026-08-11 00:58:04 on dist-test-slave-h3ft"
server_key: "f29aa66f321cd76ebf37bb7c090c674e"
server_key_iv: "34dcd7dcdc9f132bcb9732621d16badb"
server_key_version: "kuduclusterkey@0"
I20260811 00:58:04.311342 4215 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance:
uuid: "8fd2b655dea141a097d7ac9cff3e9c6a"
format_stamp: "Formatted at 2026-08-11 00:58:04 on dist-test-slave-h3ft"
server_key: "f29aa66f321cd76ebf37bb7c090c674e"
server_key_iv: "34dcd7dcdc9f132bcb9732621d16badb"
server_key_version: "kuduclusterkey@0"
I20260811 00:58:04.313745 4215 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.001s
I20260811 00:58:04.329777 4239 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:04.330125 4215 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:58:04.330277 4215 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-2/wal
uuid: "8fd2b655dea141a097d7ac9cff3e9c6a"
format_stamp: "Formatted at 2026-08-11 00:58:04 on dist-test-slave-h3ft"
server_key: "f29aa66f321cd76ebf37bb7c090c674e"
server_key_iv: "34dcd7dcdc9f132bcb9732621d16badb"
server_key_version: "kuduclusterkey@0"
I20260811 00:58:04.330436 4215 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:58:04.347046 4215 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:58:04.351401 4215 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:58:04.351679 4215 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:58:04.352083 4215 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:58:04.352626 4215 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:58:04.352731 4215 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:04.352811 4215 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:58:04.352880 4215 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:04.360893 4215 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.3:38599
I20260811 00:58:04.361545 4215 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
I20260811 00:58:04.366849 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 4215
I20260811 00:58:04.366987 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance
I20260811 00:58:04.367262 15640 external_mini_cluster.cc:1428] Setting key d8b08c451836fd44951d915623264d64
Aug 11 00:58:04 dist-test-slave-h3ft krb5kdc[2811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409884, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:58:04.365497 4445 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.3:38599 every 8 connection(s)
I20260811 00:58:04.380072 3983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:04.367886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:36499 (local address 127.15.70.62:40183)
0811 00:58:04.367952 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:04.367955 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:04.368233 (+ 278us) server_negotiation.cc:407] Connection header received
0811 00:58:04.369221 (+ 988us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:04.369222 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:04.369237 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:04.369271 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:04.370253 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:04.371083 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:04.372621 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:04.372912 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:04.372957 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:04.376109 (+ 3152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:04.376111 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:04.376112 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:04.376122 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:04.378082 (+ 1960us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:04.378651 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:04.378653 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:04.378654 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:04.378762 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:04.379160 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:04.379161 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:04.379161 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:04.379340 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:04.379392 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:04.379831 (+ 439us) server_negotiation.cc:299] Negotiation successful
0811 00:58:04.379956 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 00:58:04.381006 4448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:04.366326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:40183 (local address 127.15.70.3:36499)
0811 00:58:04.368076 (+ 1750us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:04.368144 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:04.369083 (+ 939us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:04.369496 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:04.369501 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:04.369794 (+ 293us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:58:04.370142 (+ 348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:04.370148 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:04.371206 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:04.371207 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:04.372492 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:04.372497 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:04.373082 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:04.373083 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:04.373235 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:04.373996 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:58:04.374009 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:58:04.375954 (+ 1945us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:58:04.378193 (+ 2239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:04.378201 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:04.378204 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:04.378539 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:04.378850 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:04.378851 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:04.378851 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:04.379076 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:04.379443 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:58:04.379451 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:58:04.379671 (+ 220us) client_negotiation.cc:769] Sending connection context
0811 00:58:04.380502 (+ 831us) client_negotiation.cc:240] Negotiation successful
0811 00:58:04.380714 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1690,"thread_start_us":133,"threads_started":1}
I20260811 00:58:04.381783 4446 heartbeater.cc:347] Connected to a master server at 127.15.70.62:40183
I20260811 00:58:04.381910 4446 heartbeater.cc:464] Registering TS with master...
I20260811 00:58:04.382149 4446 heartbeater.cc:511] Master 127.15.70.62:40183 requested a full tablet report, sending...
I20260811 00:58:04.382654 3620 ts_manager.cc:194] Registered new tserver with Master: 8fd2b655dea141a097d7ac9cff3e9c6a (127.15.70.3:38599)
I20260811 00:58:04.383253 3620 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.3@KRBTEST.COM'} at 127.15.70.3:36499
I20260811 00:58:04.390374 15640 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 00:58:04.391433 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 3756
I20260811 00:58:04.418480 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 3988
I20260811 00:58:04.432953 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 4215
I20260811 00:58:04.468892 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 3566
I20260811 00:58:04.490269 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:40183
--webserver_interface=127.15.70.62
--webserver_port=37259
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:34477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:40183
--ranger_config_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.70.20:56721/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.15.70.20:56721/kms with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:58:04.602133 4450 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:58:04.602525 4450 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:58:04.602558 4450 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:58:04.604195 4450 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:58:04.604274 4450 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:58:04.604290 4450 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:58:04.604305 4450 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:58:04.604317 4450 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:58:04.606491 4450 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:34477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.15.70.20:56721/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:40183
--ranger_config_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:40183
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=37259
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4450
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:58:04.606860 4450 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:58:04.607234 4450 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:58:04.613638 4457 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:04.613647 4460 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:04.613639 4458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:58:04.614713 4450 server_base.cc:1034] running on GCE node
I20260811 00:58:04.615286 4450 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:58:04.615743 4450 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:58:04.616967 4450 hybrid_clock.cc:648] HybridClock initialized: now 1786409884616933 us; error 49 us; skew 500 ppm
Aug 11 00:58:04 dist-test-slave-h3ft krb5kdc[2811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409884, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:58:04.620726 4450 init.cc:377] Logged in from keytab as kudu/127.15.70.62@KRBTEST.COM (short username kudu)
I20260811 00:58:04.621490 4450 webserver.cc:460] Webserver started at http://127.15.70.62:37259/ using document root <none> and password file <none>
I20260811 00:58:04.621795 4450 fs_manager.cc:359] Metadata directory not provided
I20260811 00:58:04.621896 4450 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 00:58:04 dist-test-slave-h3ft krb5kdc[2811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409884, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for HTTP/127.15.70.20@KRBTEST.COM
I20260811 00:58:04.712759 4450 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260811 00:58:04.714031 4471 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:04.714383 4450 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:58:04.714535 4450 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "c844716782a14625a7b4c8bd637b67a7"
format_stamp: "Formatted at 2026-08-11 00:58:02 on dist-test-slave-h3ft"
server_key: "e886d9e0615bbcb1c77edb64a5e8f1b4"
server_key_iv: "73217dcc2ba6626163e8fbfcb32b525a"
server_key_version: "kuduclusterkey@0"
I20260811 00:58:04.715209 4450 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:58:04.733239 4450 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:58:04.736176 4450 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:58:04.736351 4450 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:58:04.742828 4450 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:40183
I20260811 00:58:04.742878 4555 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:40183 every 8 connection(s)
I20260811 00:58:04.743510 4450 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:58:04.745285 4556 sys_catalog.cc:263] Verifying existing consensus state
I20260811 00:58:04.746155 4556 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7: Bootstrap starting.
I20260811 00:58:04.750716 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 4450
I20260811 00:58:04.751176 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.70.20:56721/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.1:37331
--local_ip_for_outbound_sockets=127.15.70.1
--tserver_master_addrs=127.15.70.62:40183
--webserver_port=44275
--webserver_interface=127.15.70.1
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:34477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.15.70.20:56721/kms with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 00:58:04.757112 4556 log.cc:824] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7: Log is configured to *not* fsync() on all Append() calls
I20260811 00:58:04.759461 4556 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 00:58:04.759843 4556 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7: Bootstrap complete.
I20260811 00:58:04.762738 4556 raft_consensus.cc:348] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c844716782a14625a7b4c8bd637b67a7" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 40183 } }
I20260811 00:58:04.763276 4556 raft_consensus.cc:729] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c844716782a14625a7b4c8bd637b67a7, State: Initialized, Role: FOLLOWER
I20260811 00:58:04.763530 4556 consensus_queue.cc:260] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c844716782a14625a7b4c8bd637b67a7" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 40183 } }
I20260811 00:58:04.763636 4556 raft_consensus.cc:388] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:58:04.763696 4556 raft_consensus.cc:482] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:58:04.763749 4556 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7 [term 1 FOLLOWER]: Advancing to term 2
I20260811 00:58:04.765091 4556 raft_consensus.cc:504] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c844716782a14625a7b4c8bd637b67a7" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 40183 } }
I20260811 00:58:04.765235 4556 leader_election.cc:302] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c844716782a14625a7b4c8bd637b67a7; no voters:
I20260811 00:58:04.765471 4556 leader_election.cc:288] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 00:58:04.765573 4563 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 00:58:04.765822 4563 raft_consensus.cc:686] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7 [term 2 LEADER]: Becoming Leader. State: Replica: c844716782a14625a7b4c8bd637b67a7, State: Running, Role: LEADER
I20260811 00:58:04.765869 4556 sys_catalog.cc:564] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:58:04.765949 4563 consensus_queue.cc:237] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c844716782a14625a7b4c8bd637b67a7" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 40183 } }
I20260811 00:58:04.766278 4563 sys_catalog.cc:455] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c844716782a14625a7b4c8bd637b67a7. Latest consensus state: current_term: 2 leader_uuid: "c844716782a14625a7b4c8bd637b67a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c844716782a14625a7b4c8bd637b67a7" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 40183 } } }
I20260811 00:58:04.766355 4563 sys_catalog.cc:458] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7 [sys.catalog]: This master's current role is: LEADER
I20260811 00:58:04.766502 4564 sys_catalog.cc:455] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "c844716782a14625a7b4c8bd637b67a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c844716782a14625a7b4c8bd637b67a7" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 40183 } } }
I20260811 00:58:04.766660 4564 sys_catalog.cc:458] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7 [sys.catalog]: This master's current role is: LEADER
I20260811 00:58:04.766780 4569 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:58:04.767464 4569 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:58:04.767635 4569 catalog_manager.cc:1259] Loaded cluster ID: 05270c688dbf432aa0c79caba266e51b
I20260811 00:58:04.767678 4569 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:58:04.767920 4556 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 00:58:04.773231 4569 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:58:04.773792 4569 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7: Loaded TSK: 0
I20260811 00:58:04.774106 4569 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 00:58:04.876133 4559 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:58:04.876498 4559 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:58:04.876543 4559 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:58:04.878363 4559 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:58:04.878422 4559 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:58:04.878458 4559 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.1
I20260811 00:58:04.880363 4559 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:34477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.15.70.20:56721/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.1:37331
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.70.1
--webserver_port=44275
--tserver_master_addrs=127.15.70.62:40183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4559
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.1
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:58:04.880625 4559 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:58:04.880877 4559 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:58:04.887405 4614 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:04.887728 4612 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:04.887744 4616 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:58:04.888173 4559 server_base.cc:1034] running on GCE node
I20260811 00:58:04.888433 4559 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:58:04.888787 4559 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:58:04.889957 4559 hybrid_clock.cc:648] HybridClock initialized: now 1786409884889948 us; error 38 us; skew 500 ppm
Aug 11 00:58:04 dist-test-slave-h3ft krb5kdc[2811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409884, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:58:04.893534 4559 init.cc:377] Logged in from keytab as kudu/127.15.70.1@KRBTEST.COM (short username kudu)
I20260811 00:58:04.894294 4559 webserver.cc:460] Webserver started at http://127.15.70.1:44275/ using document root <none> and password file <none>
I20260811 00:58:04.894703 4559 fs_manager.cc:359] Metadata directory not provided
I20260811 00:58:04.894840 4559 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 00:58:04 dist-test-slave-h3ft krb5kdc[2811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409884, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for HTTP/127.15.70.20@KRBTEST.COM
I20260811 00:58:04.915792 4559 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 00:58:04.916759 4631 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:04.917112 4559 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 00:58:04.917301 4559 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-0/wal
uuid: "e47c73044b1743b3bc6942808fb63e67"
format_stamp: "Formatted at 2026-08-11 00:58:03 on dist-test-slave-h3ft"
server_key: "5f21e013e389c550329fcb1ac98fa173"
server_key_iv: "22674de039b0976c12aa2daf6f6a3ff0"
server_key_version: "kuduclusterkey@0"
I20260811 00:58:04.918080 4559 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:58:04.936596 4559 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:58:04.939611 4559 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:58:04.939850 4559 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:58:04.940248 4559 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:58:04.940754 4559 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:58:04.940817 4559 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:04.940866 4559 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:58:04.940892 4559 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:04.949874 4559 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.1:37331
I20260811 00:58:04.950080 4814 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.1:37331 every 8 connection(s)
I20260811 00:58:04.950487 4559 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
I20260811 00:58:04.957496 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 4559
I20260811 00:58:04.957967 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.70.20:56721/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.2:35717
--local_ip_for_outbound_sockets=127.15.70.2
--tserver_master_addrs=127.15.70.62:40183
--webserver_port=45857
--webserver_interface=127.15.70.2
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:34477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.15.70.20:56721/kms with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 00:58:04 dist-test-slave-h3ft krb5kdc[2811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409884, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:58:04.969077 4817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:04.951785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:40183 (local address 127.15.70.1:49229)
0811 00:58:04.952207 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:04.952260 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:04.952927 (+ 667us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:04.953732 (+ 805us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:04.953737 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:04.954048 (+ 311us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:58:04.954310 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:04.954315 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:04.955977 (+ 1662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:04.955979 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:04.957420 (+ 1441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:04.957425 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:04.958837 (+ 1412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:04.958839 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:04.959064 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:04.960217 (+ 1153us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:58:04.960237 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:58:04.962400 (+ 2163us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:58:04.965945 (+ 3545us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:04.965964 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:04.965967 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:04.966487 (+ 520us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:04.966943 (+ 456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:04.966944 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:04.966945 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:04.967241 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:04.967935 (+ 694us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:58:04.967945 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:58:04.968175 (+ 230us) client_negotiation.cc:769] Sending connection context
0811 00:58:04.968318 (+ 143us) client_negotiation.cc:240] Negotiation successful
0811 00:58:04.968572 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":139,"threads_started":1}
I20260811 00:58:04.970902 4818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:04.951916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:49229 (local address 127.15.70.62:40183)
0811 00:58:04.953175 (+ 1259us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:04.953185 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:04.953243 (+ 58us) server_negotiation.cc:407] Connection header received
0811 00:58:04.953415 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:04.953420 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:04.953469 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:04.953644 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:04.954483 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:04.955775 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:04.957587 (+ 1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:04.958510 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:04.958659 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:04.962635 (+ 3976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:04.962643 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:04.962644 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:04.962664 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:04.965755 (+ 3091us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:04.966622 (+ 867us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:04.966627 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:04.966628 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:04.966832 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:04.967335 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:04.967337 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:04.967337 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:04.967775 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:04.967895 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:04.970443 (+ 2548us) server_negotiation.cc:299] Negotiation successful
0811 00:58:04.970622 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1186,"thread_start_us":107,"threads_started":1}
I20260811 00:58:04.972215 4815 heartbeater.cc:347] Connected to a master server at 127.15.70.62:40183
I20260811 00:58:04.972388 4815 heartbeater.cc:464] Registering TS with master...
I20260811 00:58:04.972718 4815 heartbeater.cc:511] Master 127.15.70.62:40183 requested a full tablet report, sending...
W20260811 00:58:04.974124 4815 heartbeater.cc:644] Failed to heartbeat to 127.15.70.62:40183 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 00:58:04.974254 4815 heartbeater.cc:464] Registering TS with master...
I20260811 00:58:04.974361 4815 heartbeater.cc:511] Master 127.15.70.62:40183 requested a full tablet report, sending...
I20260811 00:58:04.974833 4815 heartbeater.cc:464] Registering TS with master...
I20260811 00:58:04.974959 4815 heartbeater.cc:511] Master 127.15.70.62:40183 requested a full tablet report, sending...
W20260811 00:58:04.975404 4815 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 00:58:05.100947 4820 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:58:05.101783 4820 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:58:05.101856 4820 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:58:05.105180 4820 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:58:05.105311 4820 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:58:05.105371 4820 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.2
I20260811 00:58:05.109349 4820 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:34477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.15.70.20:56721/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.2:35717
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.70.2
--webserver_port=45857
--tserver_master_addrs=127.15.70.62:40183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4820
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.2
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:58:05.109826 4820 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:58:05.110684 4820 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:58:05.120211 4829 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:05.120398 4833 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:05.120740 4827 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:58:05.121371 4820 server_base.cc:1034] running on GCE node
I20260811 00:58:05.121836 4820 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:58:05.124271 4820 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:58:05.126328 4820 hybrid_clock.cc:648] HybridClock initialized: now 1786409885126298 us; error 53 us; skew 500 ppm
Aug 11 00:58:05 dist-test-slave-h3ft krb5kdc[2811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409885, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:58:05.131187 4820 init.cc:377] Logged in from keytab as kudu/127.15.70.2@KRBTEST.COM (short username kudu)
I20260811 00:58:05.131882 4820 webserver.cc:460] Webserver started at http://127.15.70.2:45857/ using document root <none> and password file <none>
I20260811 00:58:05.132301 4820 fs_manager.cc:359] Metadata directory not provided
I20260811 00:58:05.132431 4820 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 00:58:05 dist-test-slave-h3ft krb5kdc[2811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409885, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for HTTP/127.15.70.20@KRBTEST.COM
I20260811 00:58:05.153502 4820 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260811 00:58:05.155383 4847 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:05.156657 4820 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 00:58:05.156836 4820 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-1/wal
uuid: "6e13f85e85c04d4cb2c73124744006df"
format_stamp: "Formatted at 2026-08-11 00:58:04 on dist-test-slave-h3ft"
server_key: "938292e21b42bbbd592a7a14dc3b4b00"
server_key_iv: "761e818587f9f263856ebe2096bb52c0"
server_key_version: "kuduclusterkey@0"
I20260811 00:58:05.157387 4820 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:58:05.183832 4820 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:58:05.187184 4820 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:58:05.187426 4820 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:58:05.187825 4820 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:58:05.188352 4820 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:58:05.188419 4820 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:05.188468 4820 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:58:05.188494 4820 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:05.198935 4820 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.2:35717
I20260811 00:58:05.199064 5028 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.2:35717 every 8 connection(s)
I20260811 00:58:05.199728 4820 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
I20260811 00:58:05.202597 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 4820
I20260811 00:58:05.203071 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.70.20:56721/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.3:38599
--local_ip_for_outbound_sockets=127.15.70.3
--tserver_master_addrs=127.15.70.62:40183
--webserver_port=43395
--webserver_interface=127.15.70.3
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:34477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.15.70.20:56721/kms with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 00:58:05 dist-test-slave-h3ft krb5kdc[2811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409885, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:58:05.224812 4818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:05.207250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:52933 (local address 127.15.70.62:40183)
0811 00:58:05.207318 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:05.207321 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:05.207661 (+ 340us) server_negotiation.cc:407] Connection header received
0811 00:58:05.210528 (+ 2867us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:05.210538 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:05.210571 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:05.210666 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:05.211918 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:05.212846 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:05.214729 (+ 1883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:05.215144 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:05.215244 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:05.219196 (+ 3952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:05.219199 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:05.219200 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:05.219212 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:05.221792 (+ 2580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:05.222711 (+ 919us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:05.222713 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:05.222714 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:05.222800 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:05.223418 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:05.223419 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:05.223419 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:05.223656 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:05.223750 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:05.224521 (+ 771us) server_negotiation.cc:299] Negotiation successful
0811 00:58:05.224687 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 00:58:05.226022 5039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:05.206754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:40183 (local address 127.15.70.2:52933)
0811 00:58:05.207430 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:05.207533 (+ 103us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:05.208388 (+ 855us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:05.210895 (+ 2507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:05.210902 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:05.211328 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:58:05.211735 (+ 407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:05.211745 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:05.213019 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:05.213021 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:05.214588 (+ 1567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:05.214594 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:05.215283 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:05.215284 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:05.215468 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:05.216402 (+ 934us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:58:05.216416 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:58:05.218989 (+ 2573us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:58:05.221992 (+ 3003us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:05.222008 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:05.222045 (+ 37us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:05.222576 (+ 531us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:05.222895 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:05.222896 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:05.222896 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:05.223290 (+ 394us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:05.223813 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:58:05.223825 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:58:05.224228 (+ 403us) client_negotiation.cc:769] Sending connection context
0811 00:58:05.225364 (+ 1136us) client_negotiation.cc:240] Negotiation successful
0811 00:58:05.225660 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":618,"thread_start_us":164,"threads_started":1}
I20260811 00:58:05.226706 5034 heartbeater.cc:347] Connected to a master server at 127.15.70.62:40183
I20260811 00:58:05.226854 5034 heartbeater.cc:464] Registering TS with master...
I20260811 00:58:05.227190 5034 heartbeater.cc:511] Master 127.15.70.62:40183 requested a full tablet report, sending...
W20260811 00:58:05.228169 5034 heartbeater.cc:644] Failed to heartbeat to 127.15.70.62:40183 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 00:58:05.228271 5034 heartbeater.cc:464] Registering TS with master...
I20260811 00:58:05.228360 5034 heartbeater.cc:511] Master 127.15.70.62:40183 requested a full tablet report, sending...
I20260811 00:58:05.228739 5034 heartbeater.cc:464] Registering TS with master...
I20260811 00:58:05.228828 5034 heartbeater.cc:511] Master 127.15.70.62:40183 requested a full tablet report, sending...
W20260811 00:58:05.229223 5034 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 00:58:05.325845 5037 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:58:05.326294 5037 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:58:05.326349 5037 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:58:05.328703 5037 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:58:05.328800 5037 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:58:05.328856 5037 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.3
I20260811 00:58:05.332036 5037 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:34477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.15.70.20:56721/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.3:38599
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.70.3
--webserver_port=43395
--tserver_master_addrs=127.15.70.62:40183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5037
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.3
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:58:05.332495 5037 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:58:05.332932 5037 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:58:05.342401 5057 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:05.342818 5054 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:05.342836 5055 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:58:05.344065 5037 server_base.cc:1034] running on GCE node
I20260811 00:58:05.344523 5037 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:58:05.344933 5037 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:58:05.346151 5037 hybrid_clock.cc:648] HybridClock initialized: now 1786409885346121 us; error 40 us; skew 500 ppm
Aug 11 00:58:05 dist-test-slave-h3ft krb5kdc[2811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409885, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:58:05.350452 5037 init.cc:377] Logged in from keytab as kudu/127.15.70.3@KRBTEST.COM (short username kudu)
I20260811 00:58:05.351302 5037 webserver.cc:460] Webserver started at http://127.15.70.3:43395/ using document root <none> and password file <none>
I20260811 00:58:05.351717 5037 fs_manager.cc:359] Metadata directory not provided
I20260811 00:58:05.351828 5037 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 00:58:05 dist-test-slave-h3ft krb5kdc[2811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409885, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for HTTP/127.15.70.20@KRBTEST.COM
I20260811 00:58:05.380481 5037 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:58:05.381551 5070 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:05.381829 5037 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:58:05.381935 5037 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-2/wal
uuid: "8fd2b655dea141a097d7ac9cff3e9c6a"
format_stamp: "Formatted at 2026-08-11 00:58:04 on dist-test-slave-h3ft"
server_key: "f29aa66f321cd76ebf37bb7c090c674e"
server_key_iv: "34dcd7dcdc9f132bcb9732621d16badb"
server_key_version: "kuduclusterkey@0"
I20260811 00:58:05.382565 5037 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:58:05.411705 5037 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:58:05.415407 5037 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:58:05.415642 5037 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:58:05.416038 5037 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:58:05.416575 5037 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:58:05.416630 5037 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:05.416671 5037 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:58:05.416690 5037 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:05.426435 5037 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.3:38599
I20260811 00:58:05.427534 5263 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.3:38599 every 8 connection(s)
I20260811 00:58:05.427901 5037 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
I20260811 00:58:05.437574 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 5037
Aug 11 00:58:05 dist-test-slave-h3ft krb5kdc[2811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409885, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:58:05.444267 4818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:05.429063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:54597 (local address 127.15.70.62:40183)
0811 00:58:05.429136 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:05.429139 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:05.429459 (+ 320us) server_negotiation.cc:407] Connection header received
0811 00:58:05.430416 (+ 957us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:05.430418 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:05.430437 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:05.430475 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:05.431692 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:05.432631 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:05.434478 (+ 1847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:05.434848 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:05.434908 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:05.439662 (+ 4754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:05.439666 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:05.439666 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:05.439679 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:05.441899 (+ 2220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:05.442681 (+ 782us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:05.442684 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:05.442685 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:05.442770 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:05.443199 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:05.443200 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:05.443201 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:05.443388 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:05.443438 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:05.443972 (+ 534us) server_negotiation.cc:299] Negotiation successful
0811 00:58:05.444132 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 00:58:05.445448 5271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:05.429041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:40183 (local address 127.15.70.3:54597)
0811 00:58:05.429269 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:05.429337 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:05.430240 (+ 903us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:05.430739 (+ 499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:05.430746 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:05.431167 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:58:05.431547 (+ 380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:05.431555 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:05.432781 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:05.432782 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:05.434346 (+ 1564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:05.434350 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:05.435095 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:05.435096 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:05.435304 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:05.436205 (+ 901us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:58:05.436221 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:58:05.439462 (+ 3241us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:58:05.442071 (+ 2609us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:05.442090 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:05.442095 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:05.442561 (+ 466us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:05.442858 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:05.442859 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:05.442859 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:05.443105 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:05.443491 (+ 386us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:58:05.443500 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:58:05.443767 (+ 267us) client_negotiation.cc:769] Sending connection context
0811 00:58:05.444813 (+ 1046us) client_negotiation.cc:240] Negotiation successful
0811 00:58:05.445091 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":109,"threads_started":1}
I20260811 00:58:05.446427 5265 heartbeater.cc:347] Connected to a master server at 127.15.70.62:40183
I20260811 00:58:05.446568 5265 heartbeater.cc:464] Registering TS with master...
I20260811 00:58:05.446842 5265 heartbeater.cc:511] Master 127.15.70.62:40183 requested a full tablet report, sending...
W20260811 00:58:05.447810 5265 heartbeater.cc:644] Failed to heartbeat to 127.15.70.62:40183 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 00:58:05.447902 5265 heartbeater.cc:464] Registering TS with master...
I20260811 00:58:05.447985 5265 heartbeater.cc:511] Master 127.15.70.62:40183 requested a full tablet report, sending...
I20260811 00:58:05.448422 5265 heartbeater.cc:464] Registering TS with master...
I20260811 00:58:05.448508 5265 heartbeater.cc:511] Master 127.15.70.62:40183 requested a full tablet report, sending...
W20260811 00:58:05.448861 5265 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 00:58:05.461807 4818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:05.438834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60842 (local address 127.15.70.62:40183)
0811 00:58:05.444381 (+ 5547us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:05.444383 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:05.450885 (+ 6502us) server_negotiation.cc:407] Connection header received
0811 00:58:05.450954 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:05.450955 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:05.450972 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:05.451122 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:05.452452 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:05.453385 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:05.454601 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:05.454933 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:05.455076 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:05.457092 (+ 2016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:05.457095 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:05.457096 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:05.457107 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:05.459392 (+ 2285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:05.460609 (+ 1217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:05.460612 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:05.460612 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:05.460713 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:05.461012 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:05.461013 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:05.461014 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:05.461212 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:05.461514 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:05.461566 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 00:58:05.461677 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5525,"thread_start_us":111,"threads_started":1}
I20260811 00:58:05.975677 4815 heartbeater.cc:464] Registering TS with master...
I20260811 00:58:05.975934 4815 heartbeater.cc:511] Master 127.15.70.62:40183 requested a full tablet report, sending...
I20260811 00:58:05.976501 4494 ts_manager.cc:194] Registered new tserver with Master: e47c73044b1743b3bc6942808fb63e67 (127.15.70.1:37331)
I20260811 00:58:05.977764 4494 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.1@KRBTEST.COM'} at 127.15.70.1:49229
Aug 11 00:58:06 dist-test-slave-h3ft krb5kdc[2811](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786409886, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:58:06.229506 5034 heartbeater.cc:464] Registering TS with master...
I20260811 00:58:06.229758 5034 heartbeater.cc:511] Master 127.15.70.62:40183 requested a full tablet report, sending...
I20260811 00:58:06.230419 4494 ts_manager.cc:194] Registered new tserver with Master: 6e13f85e85c04d4cb2c73124744006df (127.15.70.2:35717)
I20260811 00:58:06.231194 4494 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.2@KRBTEST.COM'} at 127.15.70.2:52933
I20260811 00:58:06.449129 5265 heartbeater.cc:464] Registering TS with master...
I20260811 00:58:06.449404 5265 heartbeater.cc:511] Master 127.15.70.62:40183 requested a full tablet report, sending...
I20260811 00:58:06.449988 4494 ts_manager.cc:194] Registered new tserver with Master: 8fd2b655dea141a097d7ac9cff3e9c6a (127.15.70.3:38599)
I20260811 00:58:06.450518 4494 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.3@KRBTEST.COM'} at 127.15.70.3:54597
I20260811 00:58:06.453086 15640 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 00:58:06.464246 5299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:06.454359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60848 (local address 127.15.70.62:40183)
0811 00:58:06.454824 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:06.454826 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:06.455086 (+ 260us) server_negotiation.cc:407] Connection header received
0811 00:58:06.455126 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:06.455127 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:06.455145 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:06.455217 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:06.456034 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:06.456782 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:06.457638 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:06.457898 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:06.457984 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:06.460360 (+ 2376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:06.460363 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:06.460363 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:06.460375 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:06.462650 (+ 2275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:06.463196 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:06.463199 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:06.463199 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:06.463284 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:06.463520 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:06.463521 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:06.463521 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:06.463685 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:06.463809 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:06.463970 (+ 161us) server_negotiation.cc:299] Negotiation successful
0811 00:58:06.464083 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":422,"thread_start_us":115,"threads_started":1}
I20260811 00:58:06.466845 4494 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60848:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:58:06.469560 4494 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:58:06.480734 5310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:06.474255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59588 (local address 127.15.70.2:35717)
0811 00:58:06.474882 (+ 627us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:06.474887 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:06.475047 (+ 160us) server_negotiation.cc:407] Connection header received
0811 00:58:06.475106 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:06.475109 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:06.475129 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:06.475233 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:58:06.475577 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:06.476804 (+ 1227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:06.479042 (+ 2238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:06.479976 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:06.480084 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:06.480188 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:06.480518 (+ 330us) server_negotiation.cc:299] Negotiation successful
0811 00:58:06.480601 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":585,"thread_start_us":101,"threads_started":1}
I20260811 00:58:06.480712 5308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:06.474299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:38599 (local address 127.0.0.1:45642)
0811 00:58:06.475135 (+ 836us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:06.475148 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:06.475192 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:06.475524 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:06.475525 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:06.475528 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:58:06.475595 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:06.475596 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:06.476945 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:06.476946 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:06.478689 (+ 1743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:06.478694 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:06.480213 (+ 1519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:06.480214 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:06.480340 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:06.480363 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 00:58:06.480436 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 00:58:06.480554 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":815,"mutex_wait_us":70,"thread_start_us":114,"threads_started":1}
I20260811 00:58:06.481163 5312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:06.473978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.2:35717 (local address 127.0.0.1:59588)
0811 00:58:06.474510 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:06.474918 (+ 408us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:06.474986 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:06.475363 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:06.475365 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:06.475369 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:58:06.475471 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:06.475478 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:06.476949 (+ 1471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:06.476951 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:06.478864 (+ 1913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:06.478869 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:06.480237 (+ 1368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:06.480238 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:06.480339 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:06.480363 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 00:58:06.480451 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 00:58:06.481091 (+ 640us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":487,"mutex_wait_us":961,"thread_start_us":140,"threads_started":1}
I20260811 00:58:06.481436 5311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:06.474228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52100 (local address 127.15.70.1:37331)
0811 00:58:06.474653 (+ 425us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:06.474660 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:06.474857 (+ 197us) server_negotiation.cc:407] Connection header received
0811 00:58:06.475081 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:06.475085 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:06.475108 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:06.475192 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:58:06.475565 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:06.477176 (+ 1611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:06.479485 (+ 2309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:06.480384 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:06.480478 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:06.480571 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:06.481253 (+ 682us) server_negotiation.cc:299] Negotiation successful
0811 00:58:06.481328 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":137,"threads_started":1}
I20260811 00:58:06.481730 5309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:06.473978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:37331 (local address 127.0.0.1:52100)
0811 00:58:06.474724 (+ 746us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:06.474743 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:06.474915 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:06.475334 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:06.475338 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:06.475342 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:58:06.475471 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:06.475474 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:06.477275 (+ 1801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:06.477276 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:06.479377 (+ 2101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:06.479380 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:06.480614 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:06.480615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:06.480681 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:06.480685 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:58:06.480742 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 00:58:06.480794 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":722,"mutex_wait_us":52,"thread_start_us":133,"threads_started":1}
I20260811 00:58:06.482216 4914 tablet_service.cc:1467] Processing CreateTablet for tablet c8a7b0bdeb0244a8a00cadd6e1a23bba (DEFAULT_TABLE table=test-table [id=b56423f6167246c68585cb5ac0c403fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:58:06.482678 4703 tablet_service.cc:1467] Processing CreateTablet for tablet c8a7b0bdeb0244a8a00cadd6e1a23bba (DEFAULT_TABLE table=test-table [id=b56423f6167246c68585cb5ac0c403fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:58:06.482815 4914 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8a7b0bdeb0244a8a00cadd6e1a23bba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:58:06.483162 4703 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8a7b0bdeb0244a8a00cadd6e1a23bba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:58:06.487339 5316 tablet_bootstrap.cc:492] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 6e13f85e85c04d4cb2c73124744006df: Bootstrap starting.
I20260811 00:58:06.488296 5314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:06.474597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45642 (local address 127.15.70.3:38599)
0811 00:58:06.475329 (+ 732us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:06.475334 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:06.475344 (+ 10us) server_negotiation.cc:407] Connection header received
0811 00:58:06.475386 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:06.475388 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:06.475404 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:06.475684 (+ 280us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:58:06.475790 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:06.476823 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:06.479092 (+ 2269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:06.480065 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:06.487836 (+ 7771us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:06.488031 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:06.488085 (+ 54us) server_negotiation.cc:299] Negotiation successful
0811 00:58:06.488184 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":684,"thread_start_us":78,"threads_started":1}
I20260811 00:58:06.488720 5316 tablet_bootstrap.cc:654] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 6e13f85e85c04d4cb2c73124744006df: Neither blocks nor log segments found. Creating new log.
I20260811 00:58:06.488893 5317 tablet_bootstrap.cc:492] T c8a7b0bdeb0244a8a00cadd6e1a23bba P e47c73044b1743b3bc6942808fb63e67: Bootstrap starting.
I20260811 00:58:06.489260 5316 log.cc:824] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 6e13f85e85c04d4cb2c73124744006df: Log is configured to *not* fsync() on all Append() calls
I20260811 00:58:06.489305 5148 tablet_service.cc:1467] Processing CreateTablet for tablet c8a7b0bdeb0244a8a00cadd6e1a23bba (DEFAULT_TABLE table=test-table [id=b56423f6167246c68585cb5ac0c403fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:58:06.489821 5148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8a7b0bdeb0244a8a00cadd6e1a23bba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:58:06.489960 5317 tablet_bootstrap.cc:654] T c8a7b0bdeb0244a8a00cadd6e1a23bba P e47c73044b1743b3bc6942808fb63e67: Neither blocks nor log segments found. Creating new log.
I20260811 00:58:06.490434 5317 log.cc:824] T c8a7b0bdeb0244a8a00cadd6e1a23bba P e47c73044b1743b3bc6942808fb63e67: Log is configured to *not* fsync() on all Append() calls
I20260811 00:58:06.491295 5316 tablet_bootstrap.cc:492] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 6e13f85e85c04d4cb2c73124744006df: No bootstrap required, opened a new log
I20260811 00:58:06.491397 5316 ts_tablet_manager.cc:1397] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 6e13f85e85c04d4cb2c73124744006df: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260811 00:58:06.491441 5317 tablet_bootstrap.cc:492] T c8a7b0bdeb0244a8a00cadd6e1a23bba P e47c73044b1743b3bc6942808fb63e67: No bootstrap required, opened a new log
I20260811 00:58:06.491508 5317 ts_tablet_manager.cc:1397] T c8a7b0bdeb0244a8a00cadd6e1a23bba P e47c73044b1743b3bc6942808fb63e67: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 00:58:06.494587 5316 raft_consensus.cc:348] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 6e13f85e85c04d4cb2c73124744006df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47c73044b1743b3bc6942808fb63e67" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37331 } } peers { permanent_uuid: "6e13f85e85c04d4cb2c73124744006df" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 35717 } } peers { permanent_uuid: "8fd2b655dea141a097d7ac9cff3e9c6a" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38599 } }
I20260811 00:58:06.494587 5317 raft_consensus.cc:348] T c8a7b0bdeb0244a8a00cadd6e1a23bba P e47c73044b1743b3bc6942808fb63e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47c73044b1743b3bc6942808fb63e67" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37331 } } peers { permanent_uuid: "6e13f85e85c04d4cb2c73124744006df" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 35717 } } peers { permanent_uuid: "8fd2b655dea141a097d7ac9cff3e9c6a" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38599 } }
I20260811 00:58:06.494819 5317 raft_consensus.cc:374] T c8a7b0bdeb0244a8a00cadd6e1a23bba P e47c73044b1743b3bc6942808fb63e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:58:06.494819 5316 raft_consensus.cc:374] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 6e13f85e85c04d4cb2c73124744006df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:58:06.494863 5317 raft_consensus.cc:729] T c8a7b0bdeb0244a8a00cadd6e1a23bba P e47c73044b1743b3bc6942808fb63e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47c73044b1743b3bc6942808fb63e67, State: Initialized, Role: FOLLOWER
I20260811 00:58:06.494863 5316 raft_consensus.cc:729] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 6e13f85e85c04d4cb2c73124744006df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e13f85e85c04d4cb2c73124744006df, State: Initialized, Role: FOLLOWER
I20260811 00:58:06.495086 5317 consensus_queue.cc:260] T c8a7b0bdeb0244a8a00cadd6e1a23bba P e47c73044b1743b3bc6942808fb63e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47c73044b1743b3bc6942808fb63e67" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37331 } } peers { permanent_uuid: "6e13f85e85c04d4cb2c73124744006df" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 35717 } } peers { permanent_uuid: "8fd2b655dea141a097d7ac9cff3e9c6a" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38599 } }
I20260811 00:58:06.495810 5317 ts_tablet_manager.cc:1428] T c8a7b0bdeb0244a8a00cadd6e1a23bba P e47c73044b1743b3bc6942808fb63e67: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260811 00:58:06.496035 4815 heartbeater.cc:503] Master 127.15.70.62:40183 was elected leader, sending a full tablet report...
I20260811 00:58:06.496116 5316 consensus_queue.cc:260] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 6e13f85e85c04d4cb2c73124744006df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47c73044b1743b3bc6942808fb63e67" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37331 } } peers { permanent_uuid: "6e13f85e85c04d4cb2c73124744006df" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 35717 } } peers { permanent_uuid: "8fd2b655dea141a097d7ac9cff3e9c6a" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38599 } }
I20260811 00:58:06.496220 5325 tablet_bootstrap.cc:492] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 8fd2b655dea141a097d7ac9cff3e9c6a: Bootstrap starting.
I20260811 00:58:06.496486 5316 ts_tablet_manager.cc:1428] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 6e13f85e85c04d4cb2c73124744006df: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260811 00:58:06.496711 5034 heartbeater.cc:503] Master 127.15.70.62:40183 was elected leader, sending a full tablet report...
I20260811 00:58:06.497803 5325 tablet_bootstrap.cc:654] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 8fd2b655dea141a097d7ac9cff3e9c6a: Neither blocks nor log segments found. Creating new log.
I20260811 00:58:06.498227 5325 log.cc:824] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 8fd2b655dea141a097d7ac9cff3e9c6a: Log is configured to *not* fsync() on all Append() calls
I20260811 00:58:06.499402 5325 tablet_bootstrap.cc:492] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 8fd2b655dea141a097d7ac9cff3e9c6a: No bootstrap required, opened a new log
I20260811 00:58:06.499533 5325 ts_tablet_manager.cc:1397] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 8fd2b655dea141a097d7ac9cff3e9c6a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 00:58:06.501737 5325 raft_consensus.cc:348] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 8fd2b655dea141a097d7ac9cff3e9c6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47c73044b1743b3bc6942808fb63e67" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37331 } } peers { permanent_uuid: "6e13f85e85c04d4cb2c73124744006df" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 35717 } } peers { permanent_uuid: "8fd2b655dea141a097d7ac9cff3e9c6a" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38599 } }
I20260811 00:58:06.501977 5325 raft_consensus.cc:374] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 8fd2b655dea141a097d7ac9cff3e9c6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:58:06.502044 5325 raft_consensus.cc:729] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 8fd2b655dea141a097d7ac9cff3e9c6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fd2b655dea141a097d7ac9cff3e9c6a, State: Initialized, Role: FOLLOWER
I20260811 00:58:06.502243 5325 consensus_queue.cc:260] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 8fd2b655dea141a097d7ac9cff3e9c6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47c73044b1743b3bc6942808fb63e67" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37331 } } peers { permanent_uuid: "6e13f85e85c04d4cb2c73124744006df" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 35717 } } peers { permanent_uuid: "8fd2b655dea141a097d7ac9cff3e9c6a" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38599 } }
I20260811 00:58:06.502686 5325 ts_tablet_manager.cc:1428] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 8fd2b655dea141a097d7ac9cff3e9c6a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 00:58:06.502779 5265 heartbeater.cc:503] Master 127.15.70.62:40183 was elected leader, sending a full tablet report...
I20260811 00:58:06.576965 5327 raft_consensus.cc:482] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 6e13f85e85c04d4cb2c73124744006df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:58:06.577263 5327 raft_consensus.cc:504] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 6e13f85e85c04d4cb2c73124744006df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47c73044b1743b3bc6942808fb63e67" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37331 } } peers { permanent_uuid: "6e13f85e85c04d4cb2c73124744006df" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 35717 } } peers { permanent_uuid: "8fd2b655dea141a097d7ac9cff3e9c6a" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38599 } }
I20260811 00:58:06.577917 5327 leader_election.cc:288] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 6e13f85e85c04d4cb2c73124744006df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e47c73044b1743b3bc6942808fb63e67 (127.15.70.1:37331), 8fd2b655dea141a097d7ac9cff3e9c6a (127.15.70.3:38599)
I20260811 00:58:06.583571 5314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:06.578550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:37561 (local address 127.15.70.3:38599)
0811 00:58:06.578619 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:06.578622 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:06.579101 (+ 479us) server_negotiation.cc:407] Connection header received
0811 00:58:06.579234 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:06.579235 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:06.579254 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:06.579291 (+ 37us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:58:06.579587 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:06.580420 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:06.582180 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:06.582924 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:06.583055 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:06.583080 (+ 25us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:06.583372 (+ 292us) server_negotiation.cc:299] Negotiation successful
0811 00:58:06.583452 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 00:58:06.584349 5331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:06.578304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:38599 (local address 127.15.70.2:37561)
0811 00:58:06.578990 (+ 686us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:06.579030 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:06.579136 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:06.579377 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:06.579378 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:06.579380 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:58:06.579481 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:06.579484 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:06.580552 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:06.580553 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:06.582017 (+ 1464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:06.582021 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:06.583167 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:06.583168 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:06.583263 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:06.583269 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 00:58:06.584128 (+ 859us) client_negotiation.cc:240] Negotiation successful
0811 00:58:06.584203 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":632,"thread_start_us":101,"threads_started":1}
I20260811 00:58:06.585098 5193 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8a7b0bdeb0244a8a00cadd6e1a23bba" candidate_uuid: "6e13f85e85c04d4cb2c73124744006df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fd2b655dea141a097d7ac9cff3e9c6a" is_pre_election: true
I20260811 00:58:06.585202 5311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:06.578563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:46853 (local address 127.15.70.1:37331)
0811 00:58:06.578625 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:06.578628 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:06.578853 (+ 225us) server_negotiation.cc:407] Connection header received
0811 00:58:06.578945 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:06.578947 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:06.578966 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:06.579062 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:58:06.579391 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:06.580280 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:06.583130 (+ 2850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:06.583907 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:06.583973 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:06.583987 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:06.585024 (+ 1037us) server_negotiation.cc:299] Negotiation successful
0811 00:58:06.585107 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 00:58:06.585386 5193 raft_consensus.cc:2454] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 8fd2b655dea141a097d7ac9cff3e9c6a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e13f85e85c04d4cb2c73124744006df in term 0.
I20260811 00:58:06.585493 5332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:06.578194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:37331 (local address 127.15.70.2:46853)
0811 00:58:06.578726 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:06.578742 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:06.578848 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:06.579136 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:06.579137 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:06.579140 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:58:06.579278 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:06.579280 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:06.580450 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:06.580451 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:06.582014 (+ 1563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:06.582019 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:06.584141 (+ 2122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:06.584143 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:06.584232 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:06.584237 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 00:58:06.585317 (+ 1080us) client_negotiation.cc:240] Negotiation successful
0811 00:58:06.585390 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":500,"mutex_wait_us":45,"thread_start_us":182,"threads_started":1}
I20260811 00:58:06.585964 4739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8a7b0bdeb0244a8a00cadd6e1a23bba" candidate_uuid: "6e13f85e85c04d4cb2c73124744006df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47c73044b1743b3bc6942808fb63e67" is_pre_election: true
I20260811 00:58:06.586192 4739 raft_consensus.cc:2454] T c8a7b0bdeb0244a8a00cadd6e1a23bba P e47c73044b1743b3bc6942808fb63e67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e13f85e85c04d4cb2c73124744006df in term 0.
I20260811 00:58:06.586371 4853 leader_election.cc:302] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 6e13f85e85c04d4cb2c73124744006df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e13f85e85c04d4cb2c73124744006df, 8fd2b655dea141a097d7ac9cff3e9c6a; no voters:
I20260811 00:58:06.586580 5327 raft_consensus.cc:2781] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 6e13f85e85c04d4cb2c73124744006df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:58:06.586655 5327 raft_consensus.cc:482] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 6e13f85e85c04d4cb2c73124744006df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:58:06.586687 5327 raft_consensus.cc:3037] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 6e13f85e85c04d4cb2c73124744006df [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:58:06.588145 5327 raft_consensus.cc:504] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 6e13f85e85c04d4cb2c73124744006df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47c73044b1743b3bc6942808fb63e67" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37331 } } peers { permanent_uuid: "6e13f85e85c04d4cb2c73124744006df" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 35717 } } peers { permanent_uuid: "8fd2b655dea141a097d7ac9cff3e9c6a" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38599 } }
I20260811 00:58:06.588382 5327 leader_election.cc:288] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 6e13f85e85c04d4cb2c73124744006df [CANDIDATE]: Term 1 election: Requested vote from peers e47c73044b1743b3bc6942808fb63e67 (127.15.70.1:37331), 8fd2b655dea141a097d7ac9cff3e9c6a (127.15.70.3:38599)
I20260811 00:58:06.588624 4739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8a7b0bdeb0244a8a00cadd6e1a23bba" candidate_uuid: "6e13f85e85c04d4cb2c73124744006df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47c73044b1743b3bc6942808fb63e67"
I20260811 00:58:06.588747 4739 raft_consensus.cc:3037] T c8a7b0bdeb0244a8a00cadd6e1a23bba P e47c73044b1743b3bc6942808fb63e67 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:58:06.588855 5193 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8a7b0bdeb0244a8a00cadd6e1a23bba" candidate_uuid: "6e13f85e85c04d4cb2c73124744006df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fd2b655dea141a097d7ac9cff3e9c6a"
I20260811 00:58:06.589042 5193 raft_consensus.cc:3037] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 8fd2b655dea141a097d7ac9cff3e9c6a [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:58:06.590061 4739 raft_consensus.cc:2454] T c8a7b0bdeb0244a8a00cadd6e1a23bba P e47c73044b1743b3bc6942808fb63e67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e13f85e85c04d4cb2c73124744006df in term 1.
I20260811 00:58:06.590333 5193 raft_consensus.cc:2454] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 8fd2b655dea141a097d7ac9cff3e9c6a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e13f85e85c04d4cb2c73124744006df in term 1.
I20260811 00:58:06.590499 4850 leader_election.cc:302] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 6e13f85e85c04d4cb2c73124744006df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e13f85e85c04d4cb2c73124744006df, e47c73044b1743b3bc6942808fb63e67; no voters:
I20260811 00:58:06.590695 5327 raft_consensus.cc:2781] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 6e13f85e85c04d4cb2c73124744006df [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:58:06.590926 5327 raft_consensus.cc:686] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 6e13f85e85c04d4cb2c73124744006df [term 1 LEADER]: Becoming Leader. State: Replica: 6e13f85e85c04d4cb2c73124744006df, State: Running, Role: LEADER
I20260811 00:58:06.591100 5327 consensus_queue.cc:237] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 6e13f85e85c04d4cb2c73124744006df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47c73044b1743b3bc6942808fb63e67" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37331 } } peers { permanent_uuid: "6e13f85e85c04d4cb2c73124744006df" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 35717 } } peers { permanent_uuid: "8fd2b655dea141a097d7ac9cff3e9c6a" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38599 } }
I20260811 00:58:06.592895 4493 catalog_manager.cc:5495] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 6e13f85e85c04d4cb2c73124744006df reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e13f85e85c04d4cb2c73124744006df (127.15.70.2). New cstate: current_term: 1 leader_uuid: "6e13f85e85c04d4cb2c73124744006df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47c73044b1743b3bc6942808fb63e67" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e13f85e85c04d4cb2c73124744006df" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 35717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fd2b655dea141a097d7ac9cff3e9c6a" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38599 } health_report { overall_health: UNKNOWN } } }
I20260811 00:58:06.629205 5310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:06.624978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59596 (local address 127.15.70.2:35717)
0811 00:58:06.625085 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:06.625088 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:06.625102 (+ 14us) server_negotiation.cc:407] Connection header received
0811 00:58:06.625165 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:06.625166 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:06.625203 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:06.625299 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:58:06.625562 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:06.626376 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:06.627696 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:06.628008 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:06.628089 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:06.628360 (+ 271us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:58:06.628560 (+ 200us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:58:06.628666 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:06.629033 (+ 367us) server_negotiation.cc:299] Negotiation successful
0811 00:58:06.629075 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 00:58:06.632395 5193 raft_consensus.cc:1261] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 8fd2b655dea141a097d7ac9cff3e9c6a [term 1 FOLLOWER]: Refusing update from remote peer 6e13f85e85c04d4cb2c73124744006df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:58:06.632575 4739 raft_consensus.cc:1261] T c8a7b0bdeb0244a8a00cadd6e1a23bba P e47c73044b1743b3bc6942808fb63e67 [term 1 FOLLOWER]: Refusing update from remote peer 6e13f85e85c04d4cb2c73124744006df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:58:06.633168 5327 consensus_queue.cc:1035] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 6e13f85e85c04d4cb2c73124744006df [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fd2b655dea141a097d7ac9cff3e9c6a" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 38599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:58:06.633401 5327 consensus_queue.cc:1035] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 6e13f85e85c04d4cb2c73124744006df [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47c73044b1743b3bc6942808fb63e67" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:58:06.639590 5341 mvcc.cc:205] Tried to move back new op lower bound from 7317134895641997312 to 7317134895477985280. Current Snapshot: MvccSnapshot[applied={T|T < 7317134895641997312}]
I20260811 00:58:06.641503 5343 mvcc.cc:205] Tried to move back new op lower bound from 7317134895641997312 to 7317134895477985280. Current Snapshot: MvccSnapshot[applied={T|T < 7317134895641997312}]
I20260811 00:58:06.643586 4494 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60848:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:58:06.643739 4494 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60848:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:58:06.645486 4494 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c844716782a14625a7b4c8bd637b67a7: Sending DeleteTablet for 3 replicas of tablet c8a7b0bdeb0244a8a00cadd6e1a23bba
I20260811 00:58:06.646040 4914 tablet_service.cc:1514] Processing DeleteTablet for tablet c8a7b0bdeb0244a8a00cadd6e1a23bba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:58:06 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:59588
I20260811 00:58:06.646332 5148 tablet_service.cc:1514] Processing DeleteTablet for tablet c8a7b0bdeb0244a8a00cadd6e1a23bba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:58:06 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:45642
I20260811 00:58:06.646835 4703 tablet_service.cc:1514] Processing DeleteTablet for tablet c8a7b0bdeb0244a8a00cadd6e1a23bba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:58:06 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:52100
I20260811 00:58:06.648262 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 4559
I20260811 00:58:06.675716 5342 mvcc.cc:205] Tried to move back new op lower bound from 7317134895641997312 to 7317134895477985280. Current Snapshot: MvccSnapshot[applied={T|T < 7317134895641997312}]
I20260811 00:58:06.676347 5352 tablet_replica.cc:330] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 6e13f85e85c04d4cb2c73124744006df: stopping tablet replica
I20260811 00:58:06.676610 5353 tablet_replica.cc:330] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 8fd2b655dea141a097d7ac9cff3e9c6a: stopping tablet replica
I20260811 00:58:06.679692 5352 raft_consensus.cc:2229] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 6e13f85e85c04d4cb2c73124744006df [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:58:06.680125 5352 raft_consensus.cc:2258] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 6e13f85e85c04d4cb2c73124744006df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:58:06.681443 5352 ts_tablet_manager.cc:1905] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 6e13f85e85c04d4cb2c73124744006df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:58:06.687201 5353 raft_consensus.cc:2229] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 8fd2b655dea141a097d7ac9cff3e9c6a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:58:06.687566 5353 raft_consensus.cc:2258] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 8fd2b655dea141a097d7ac9cff3e9c6a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:58:06.689039 5353 ts_tablet_manager.cc:1905] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 8fd2b655dea141a097d7ac9cff3e9c6a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:58:06.691463 5353 ts_tablet_manager.cc:1918] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 8fd2b655dea141a097d7ac9cff3e9c6a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:58:06.691588 5353 log.cc:1196] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 8fd2b655dea141a097d7ac9cff3e9c6a: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-2/wal/wals/c8a7b0bdeb0244a8a00cadd6e1a23bba
I20260811 00:58:06.691974 5353 ts_tablet_manager.cc:1939] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 8fd2b655dea141a097d7ac9cff3e9c6a: Deleting consensus metadata
I20260811 00:58:06.692307 5352 ts_tablet_manager.cc:1918] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 6e13f85e85c04d4cb2c73124744006df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:58:06.692574 5352 log.cc:1196] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 6e13f85e85c04d4cb2c73124744006df: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409704606556-15640-0/minicluster-data/ts-1/wal/wals/c8a7b0bdeb0244a8a00cadd6e1a23bba
I20260811 00:58:06.693017 4475 catalog_manager.cc:4841] TS 8fd2b655dea141a097d7ac9cff3e9c6a (127.15.70.3:38599): tablet c8a7b0bdeb0244a8a00cadd6e1a23bba (table test-table [id=b56423f6167246c68585cb5ac0c403fc]) successfully deleted
I20260811 00:58:06.693080 5352 ts_tablet_manager.cc:1939] T c8a7b0bdeb0244a8a00cadd6e1a23bba P 6e13f85e85c04d4cb2c73124744006df: Deleting consensus metadata
I20260811 00:58:06.693662 4475 catalog_manager.cc:4841] TS 6e13f85e85c04d4cb2c73124744006df (127.15.70.2:35717): tablet c8a7b0bdeb0244a8a00cadd6e1a23bba (table test-table [id=b56423f6167246c68585cb5ac0c403fc]) successfully deleted
W20260811 00:58:06.694109 4473 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.70.1:37331 (error 108)
I20260811 00:58:06.695667 5312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:06.695445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:37331 (local address 127.0.0.1:52108)
0811 00:58:06.695539 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:06.695602 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.1:37331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260811 00:58:06.695751 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 4820
W20260811 00:58:06.745440 4473 catalog_manager.cc:4584] TS e47c73044b1743b3bc6942808fb63e67 (127.15.70.1:37331): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c8a7b0bdeb0244a8a00cadd6e1a23bba: Network error: Client connection negotiation failed: client connection to 127.15.70.1:37331: connect: Connection refused (error 111)
I20260811 00:58:06.762676 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 5037
I20260811 00:58:06.787304 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 4450
I20260811 00:58:06.812507 15640 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 00:58:07.170626 15640 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 00:58:07.170873 15640 mini_ranger.cc:66] Stopping Ranger...
I20260811 00:58:07.537590 15640 mini_ranger.cc:68] Stopped Ranger
2026-08-11 00:58:07.537 UTC [2858] LOG: received smart shutdown request
2026-08-11 00:58:07.544 UTC [2858] LOG: background worker "logical replication launcher" (PID 2874) exited with exit code 1
2026-08-11 00:58:07.546 UTC [2867] LOG: shutting down
2026-08-11 00:58:07.802 UTC [2858] LOG: database system is shut down
2026-08-11T00:58:07Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (58387 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:58:08 dist-test-slave-h3ft krb5kdc[5370](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:58:08 dist-test-slave-h3ft krb5kdc[5370](info): set up 2 sockets
Aug 11 00:58:08 dist-test-slave-h3ft krb5kdc[5370](info): commencing operation
krb5kdc: starting...
W20260811 00:58:09.311228 15640 mini_kdc.cc:121] Time spent starting KDC: real 1.354s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Aug 11 00:58:09 dist-test-slave-h3ft krb5kdc[5370](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409889, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:58:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:58:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.70.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
I20260811 00:58:09.479074 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:37033
--webserver_interface=127.15.70.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:34707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:37033,127.15.70.61:34071,127.15.70.60:39445
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:58:09.589522 5391 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:58:09.589892 5391 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:58:09.589958 5391 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:58:09.591666 5391 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:58:09.591774 5391 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:58:09.591802 5391 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:58:09.591826 5391 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:58:09.591864 5391 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:58:09.594216 5391 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:34707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:37033,127.15.70.61:34071,127.15.70.60:39445
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:37033
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5391
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:58:09.594681 5391 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:58:09.595104 5391 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:58:09.601862 5398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:09.601884 5399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:58:09.602196 5391 server_base.cc:1034] running on GCE node
W20260811 00:58:09.601886 5407 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:58:09.602720 5391 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:58:09.603384 5391 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:58:09.604642 5391 hybrid_clock.cc:648] HybridClock initialized: now 1786409889604598 us; error 84 us; skew 500 ppm
Aug 11 00:58:09 dist-test-slave-h3ft krb5kdc[5370](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409889, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:58:09.608584 5391 init.cc:377] Logged in from keytab as kudu/127.15.70.62@KRBTEST.COM (short username kudu)
I20260811 00:58:09.609194 5391 webserver.cc:460] Webserver started at http://127.15.70.62:43295/ using document root <none> and password file <none>
I20260811 00:58:09.609534 5391 fs_manager.cc:359] Metadata directory not provided
I20260811 00:58:09.609588 5391 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:58:09.609781 5391 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:58:09.611344 5391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "dc5066185a5846b4a8c65df6a367bfe0"
format_stamp: "Formatted at 2026-08-11 00:58:09 on dist-test-slave-h3ft"
server_key: "6f8639dad0355b0157810e36db4c3022"
server_key_iv: "53bb53d2badfc41496eab68491302c90"
server_key_version: "encryptionkey@0"
I20260811 00:58:09.611811 5391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "dc5066185a5846b4a8c65df6a367bfe0"
format_stamp: "Formatted at 2026-08-11 00:58:09 on dist-test-slave-h3ft"
server_key: "6f8639dad0355b0157810e36db4c3022"
server_key_iv: "53bb53d2badfc41496eab68491302c90"
server_key_version: "encryptionkey@0"
I20260811 00:58:09.613654 5391 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 00:58:09.615196 5424 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:09.615422 5391 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:58:09.615549 5391 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "dc5066185a5846b4a8c65df6a367bfe0"
format_stamp: "Formatted at 2026-08-11 00:58:09 on dist-test-slave-h3ft"
server_key: "6f8639dad0355b0157810e36db4c3022"
server_key_iv: "53bb53d2badfc41496eab68491302c90"
server_key_version: "encryptionkey@0"
I20260811 00:58:09.615628 5391 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:58:09.635421 5391 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:58:09.638556 5391 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:58:09.638731 5391 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:58:09.644814 5391 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:37033
I20260811 00:58:09.644869 5513 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:37033 every 8 connection(s)
I20260811 00:58:09.645406 5391 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:58:09.647550 5514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:58:09.648252 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 5391
I20260811 00:58:09.648391 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 00:58:09.648629 15640 external_mini_cluster.cc:1428] Setting key 45ac13f0fa1f712b7dab241cf1661a08
I20260811 00:58:09.650866 5514 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.70.62" port: 37033 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 00:58:09 dist-test-slave-h3ft krb5kdc[5370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409889, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.70.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.61@KRBTEST.COM" created.
I20260811 00:58:09.667093 5518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:09.652122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55946 (local address 127.15.70.62:37033)
0811 00:58:09.652409 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:09.652420 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:09.652603 (+ 183us) server_negotiation.cc:407] Connection header received
0811 00:58:09.653491 (+ 888us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:09.653494 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:09.653520 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:09.653642 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:09.654705 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:09.655969 (+ 1264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:09.657638 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:09.658076 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:09.658201 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:09.661837 (+ 3636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:09.661852 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:09.661852 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:09.661864 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:09.664185 (+ 2321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:09.664952 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:09.664957 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:09.664958 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:09.665356 (+ 398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:09.665691 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:09.665692 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:09.665692 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:09.666038 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:09.666190 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:09.666421 (+ 231us) server_negotiation.cc:299] Negotiation successful
0811 00:58:09.666674 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":32,"server-negotiator.queue_time_us":235,"thread_start_us":143,"threads_started":1}
I20260811 00:58:09.667110 5517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:09.652114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:37033 (local address 127.0.0.1:55946)
0811 00:58:09.652350 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:09.652407 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:09.653251 (+ 844us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:09.653677 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:09.653681 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:09.654183 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:58:09.654498 (+ 315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:09.654518 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:09.656104 (+ 1586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:09.656105 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:09.657527 (+ 1422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:09.657533 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:09.658194 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:09.658195 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:09.658395 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:09.659376 (+ 981us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:58:09.659391 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:58:09.661702 (+ 2311us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:58:09.664327 (+ 2625us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:09.664336 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:09.664340 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:09.664650 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:09.665451 (+ 801us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:09.665452 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:09.665453 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:09.665591 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:09.666156 (+ 565us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:58:09.666163 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:58:09.666259 (+ 96us) client_negotiation.cc:769] Sending connection context
0811 00:58:09.666389 (+ 130us) client_negotiation.cc:240] Negotiation successful
0811 00:58:09.666747 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"mutex_wait_us":126,"thread_start_us":130,"threads_started":1}
I20260811 00:58:09.668672 5514 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34071 } has no permanent_uuid. Determining permanent_uuid...
I20260811 00:58:09.669314 5517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:09.669100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.61:34071 (local address 127.0.0.1:36158)
0811 00:58:09.669203 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:09.669274 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.61:34071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
W20260811 00:58:09.669739 5427 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.70.61:34071: connect: Connection refused (error 111)
I20260811 00:58:09.670522 5517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:09.670362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.61:34071 (local address 127.0.0.1:36160)
0811 00:58:09.670444 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:09.670482 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.61:34071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260811 00:58:09.670668 5514 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.70.61:34071: Network error: Client connection negotiation failed: client connection to 127.15.70.61:34071: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.61.keytab.
Entry for principal kudu/127.15.70.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.61.keytab.
I20260811 00:58:09.692065 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.61:34071
--webserver_interface=127.15.70.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.61.keytab
--principal=kudu/127.15.70.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:34707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:37033,127.15.70.61:34071,127.15.70.60:39445
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 00:58:09.719973 5514 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34071 } attempt: 1
I20260811 00:58:09.720721 5517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:09.720528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.61:34071 (local address 127.0.0.1:36168)
0811 00:58:09.720613 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:09.720672 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.61:34071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260811 00:58:09.721279 5517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:09.721169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.61:34071 (local address 127.0.0.1:36170)
0811 00:58:09.721218 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:09.721253 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.61:34071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 00:58:09.721510 5514 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.70.61:34071: Network error: Client connection negotiation failed: client connection to 127.15.70.61:34071: connect: Connection refused (error 111)
I20260811 00:58:09.789770 5514 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34071 } attempt: 2
I20260811 00:58:09.790566 5517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:09.790318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.61:34071 (local address 127.0.0.1:36174)
0811 00:58:09.790463 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:09.790521 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.61:34071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111}
I20260811 00:58:09.791249 5517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:09.790968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.61:34071 (local address 127.0.0.1:36188)
0811 00:58:09.791179 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:09.791220 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.61:34071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188}
W20260811 00:58:09.791388 5514 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.70.61:34071: Network error: Client connection negotiation failed: client connection to 127.15.70.61:34071: connect: Connection refused (error 111)
W20260811 00:58:09.801463 5522 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:58:09.801832 5522 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:58:09.801887 5522 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:58:09.803546 5522 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:58:09.803639 5522 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:58:09.803666 5522 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:58:09.803702 5522 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:58:09.803731 5522 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:58:09.805742 5522 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:34707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:37033,127.15.70.61:34071,127.15.70.60:39445
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.61.keytab
--principal=kudu/127.15.70.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.61:34071
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.15.70.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5522
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:58:09.806155 5522 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:58:09.806470 5522 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:58:09.813057 5528 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:09.813072 5527 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:09.813072 5531 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:58:09.813444 5522 server_base.cc:1034] running on GCE node
I20260811 00:58:09.813799 5522 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:58:09.814201 5522 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:58:09.815389 5522 hybrid_clock.cc:648] HybridClock initialized: now 1786409889815355 us; error 54 us; skew 500 ppm
Aug 11 00:58:09 dist-test-slave-h3ft krb5kdc[5370](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409889, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:58:09.818930 5522 init.cc:377] Logged in from keytab as kudu/127.15.70.61@KRBTEST.COM (short username kudu)
I20260811 00:58:09.819685 5522 webserver.cc:460] Webserver started at http://127.15.70.61:37713/ using document root <none> and password file <none>
I20260811 00:58:09.819999 5522 fs_manager.cc:359] Metadata directory not provided
I20260811 00:58:09.820170 5522 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:58:09.820358 5522 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:58:09.821812 5522 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-1/data/instance:
uuid: "deb1f31721a5400eb3249b23a1166790"
format_stamp: "Formatted at 2026-08-11 00:58:09 on dist-test-slave-h3ft"
server_key: "944ce42d57fbd545b11fa7180241ab9a"
server_key_iv: "20722e252badcaa97489285666bf0db8"
server_key_version: "encryptionkey@0"
I20260811 00:58:09.822304 5522 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-1/wal/instance:
uuid: "deb1f31721a5400eb3249b23a1166790"
format_stamp: "Formatted at 2026-08-11 00:58:09 on dist-test-slave-h3ft"
server_key: "944ce42d57fbd545b11fa7180241ab9a"
server_key_iv: "20722e252badcaa97489285666bf0db8"
server_key_version: "encryptionkey@0"
I20260811 00:58:09.824303 5522 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.001s
I20260811 00:58:09.825629 5544 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:09.825834 5522 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:58:09.825958 5522 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-1/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-1/wal
uuid: "deb1f31721a5400eb3249b23a1166790"
format_stamp: "Formatted at 2026-08-11 00:58:09 on dist-test-slave-h3ft"
server_key: "944ce42d57fbd545b11fa7180241ab9a"
server_key_iv: "20722e252badcaa97489285666bf0db8"
server_key_version: "encryptionkey@0"
I20260811 00:58:09.826033 5522 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:58:09.838480 5522 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:58:09.842022 5522 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:58:09.842216 5522 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:58:09.848973 5522 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.61:34071
I20260811 00:58:09.849072 5630 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.61:34071 every 8 connection(s)
I20260811 00:58:09.849633 5522 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-1/data/info.pb
I20260811 00:58:09.851148 5633 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:58:09.851226 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 5522
I20260811 00:58:09.851384 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-1/wal/instance
I20260811 00:58:09.851694 15640 external_mini_cluster.cc:1428] Setting key be66ce077dd1ff6f9b358d32286b81b0
I20260811 00:58:09.854796 5633 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.70.62" port: 37033 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 00:58:09 dist-test-slave-h3ft krb5kdc[5370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409889, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.61@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.70.60@KRBTEST.COM; defaulting to no policy
I20260811 00:58:09.868693 5518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:09.856091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55948 (local address 127.15.70.62:37033)
0811 00:58:09.856186 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:09.856188 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:09.856503 (+ 315us) server_negotiation.cc:407] Connection header received
0811 00:58:09.857212 (+ 709us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:09.857214 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:09.857237 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:09.857309 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:09.858214 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:09.858782 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:09.860084 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:09.860458 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:09.860561 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:09.864267 (+ 3706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:09.864270 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:09.864270 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:09.864284 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:09.866472 (+ 2188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:09.867200 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:09.867202 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:09.867203 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:09.867292 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:09.867674 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:09.867675 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:09.867676 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:09.867900 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:09.868002 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:09.868421 (+ 419us) server_negotiation.cc:299] Negotiation successful
0811 00:58:09.868565 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.60@KRBTEST.COM" created.
I20260811 00:58:09.868992 5638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:09.856066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:37033 (local address 127.0.0.1:55948)
0811 00:58:09.856340 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:09.856391 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:09.857035 (+ 644us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:09.857407 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:09.857411 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:09.857818 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:58:09.858092 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:09.858097 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:09.858915 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:09.858916 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:09.859958 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:09.859961 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:09.860659 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:09.860660 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:09.860854 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:09.861844 (+ 990us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:58:09.861860 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:58:09.864105 (+ 2245us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:58:09.866621 (+ 2516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:09.866639 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:09.866643 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:09.867095 (+ 452us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:09.867401 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:09.867402 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:09.867403 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:09.867585 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:09.868006 (+ 421us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:58:09.868017 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:58:09.868235 (+ 218us) client_negotiation.cc:769] Sending connection context
0811 00:58:09.868368 (+ 133us) client_negotiation.cc:240] Negotiation successful
0811 00:58:09.868627 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":154,"threads_started":1}
I20260811 00:58:09.870182 5633 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34071 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 00:58:09 dist-test-slave-h3ft krb5kdc[5370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409889, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.61@KRBTEST.COM for kudu/127.15.70.61@KRBTEST.COM
I20260811 00:58:09.881263 5638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:09.870619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.61:34071 (local address 127.0.0.1:36200)
0811 00:58:09.870714 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:09.870730 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:09.870788 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:09.871492 (+ 704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:09.871493 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:09.871741 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:58:09.871827 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:09.871829 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:09.872854 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:09.872856 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:09.873390 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:09.873392 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:09.874036 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:09.874037 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:09.874176 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:09.874849 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:58:09.874855 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:58:09.876861 (+ 2006us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:58:09.879693 (+ 2832us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:09.879694 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:09.879694 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:09.879897 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:09.880212 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:09.880213 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:09.880214 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:09.880313 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:09.880853 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:58:09.880854 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:58:09.880903 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 00:58:09.881035 (+ 132us) client_negotiation.cc:240] Negotiation successful
0811 00:58:09.881166 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260811 00:58:09.881433 5639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:09.870768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36200 (local address 127.15.70.61:34071)
0811 00:58:09.871162 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:09.871167 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:09.871289 (+ 122us) server_negotiation.cc:407] Connection header received
0811 00:58:09.871320 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:09.871323 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:09.871340 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:09.871491 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:09.871926 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:09.872732 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:09.873496 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:09.873937 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:09.874031 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:09.876981 (+ 2950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:09.877001 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:09.877001 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:09.877018 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:09.879558 (+ 2540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:09.880020 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:09.880025 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:09.880025 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:09.880113 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:09.880405 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:09.880406 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:09.880406 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:09.880696 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:09.880812 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:09.881110 (+ 298us) server_negotiation.cc:299] Negotiation successful
0811 00:58:09.881253 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":352,"thread_start_us":134,"threads_started":1}
I20260811 00:58:09.882395 5633 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.70.60" port: 39445 } has no permanent_uuid. Determining permanent_uuid...
I20260811 00:58:09.882656 5514 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34071 } attempt: 3
I20260811 00:58:09.883253 5638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:09.882835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:39445 (local address 127.0.0.1:49032)
0811 00:58:09.883128 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:09.883201 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.60:39445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":261}
W20260811 00:58:09.883486 5548 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.70.60:39445: connect: Connection refused (error 111)
I20260811 00:58:09.884178 5638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:09.884057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:39445 (local address 127.0.0.1:49042)
0811 00:58:09.884113 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:09.884145 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.60:39445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260811 00:58:09.884392 5633 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.70.60:39445: Network error: Client connection negotiation failed: client connection to 127.15.70.60:39445: connect: Connection refused (error 111)
Aug 11 00:58:09 dist-test-slave-h3ft krb5kdc[5370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409889, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for kudu/127.15.70.61@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.60.keytab.
Entry for principal kudu/127.15.70.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.60.keytab.
I20260811 00:58:09.892776 5639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:09.883327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36214 (local address 127.15.70.61:34071)
0811 00:58:09.883536 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:09.883557 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:09.883569 (+ 12us) server_negotiation.cc:407] Connection header received
0811 00:58:09.883596 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:09.883597 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:09.883611 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:09.883678 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:09.884439 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:09.885177 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:09.886012 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:09.886302 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:09.886400 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:09.889072 (+ 2672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:09.889074 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:09.889075 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:09.889084 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:09.891151 (+ 2067us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:09.891701 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:09.891703 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:09.891703 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:09.891785 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:09.892011 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:09.892013 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:09.892013 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:09.892212 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:09.892300 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:09.892566 (+ 266us) server_negotiation.cc:299] Negotiation successful
0811 00:58:09.892676 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188}
I20260811 00:58:09.892867 5517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:09.883118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.61:34071 (local address 127.0.0.1:36214)
0811 00:58:09.883195 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:09.883208 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:09.883260 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:09.883850 (+ 590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:09.883852 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:09.884165 (+ 313us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:58:09.884290 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:09.884294 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:09.885276 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:09.885277 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:09.885928 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:09.885931 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:09.886401 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:09.886402 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:09.886500 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:09.887172 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:58:09.887179 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:58:09.888955 (+ 1776us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:58:09.891289 (+ 2334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:09.891290 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:09.891291 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:09.891614 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:09.891860 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:09.891862 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:09.891862 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:09.891931 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:09.892313 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:58:09.892315 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:58:09.892397 (+ 82us) client_negotiation.cc:769] Sending connection context
0811 00:58:09.892503 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 00:58:09.892715 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260811 00:58:09.892900 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.60:39445
--webserver_interface=127.15.70.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.60.keytab
--principal=kudu/127.15.70.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:34707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:37033,127.15.70.61:34071,127.15.70.60:39445
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 00:58:09.895144 5514 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.70.60" port: 39445 } has no permanent_uuid. Determining permanent_uuid...
I20260811 00:58:09.895736 5517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:09.895569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:39445 (local address 127.0.0.1:49050)
0811 00:58:09.895648 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:09.895697 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.60:39445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260811 00:58:09.896229 5517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:09.896113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:39445 (local address 127.0.0.1:49058)
0811 00:58:09.896164 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:09.896194 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.60:39445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 00:58:09.896338 5514 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.70.60:39445: Network error: Client connection negotiation failed: client connection to 127.15.70.60:39445: connect: Connection refused (error 111)
I20260811 00:58:09.927525 5514 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.70.60" port: 39445 } attempt: 1
I20260811 00:58:09.928444 5517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:09.928184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:39445 (local address 127.0.0.1:49072)
0811 00:58:09.928299 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:09.928372 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.60:39445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260811 00:58:09.929064 5517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:09.928931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:39445 (local address 127.0.0.1:49082)
0811 00:58:09.928996 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:09.929034 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.60:39445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260811 00:58:09.929245 5514 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.70.60:39445: Network error: Client connection negotiation failed: client connection to 127.15.70.60:39445: connect: Connection refused (error 111)
I20260811 00:58:09.933789 5633 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.70.60" port: 39445 } attempt: 1
I20260811 00:58:09.934571 5638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:09.934374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:39445 (local address 127.0.0.1:49084)
0811 00:58:09.934470 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:09.934526 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.60:39445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260811 00:58:09.935184 5638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:09.934937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:39445 (local address 127.0.0.1:49092)
0811 00:58:09.935120 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:09.935156 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.60:39445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165}
W20260811 00:58:09.935314 5633 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.70.60:39445: Network error: Client connection negotiation failed: client connection to 127.15.70.60:39445: connect: Connection refused (error 111)
W20260811 00:58:09.998530 5642 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:58:09.998838 5642 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:58:09.998870 5642 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:58:10.000380 5642 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:58:10.000445 5642 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:58:10.000461 5642 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:58:10.000476 5642 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:58:10.000489 5642 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:58:10.002563 5642 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:34707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:37033,127.15.70.61:34071,127.15.70.60:39445
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.60.keytab
--principal=kudu/127.15.70.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.60:39445
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.15.70.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5642
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:58:10.003043 5642 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:58:10.003414 5642 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 00:58:10.003556 5633 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.70.60" port: 39445 } attempt: 2
I20260811 00:58:10.004279 5638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:10.004046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:39445 (local address 127.0.0.1:49106)
0811 00:58:10.004139 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:10.004206 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.60:39445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260811 00:58:10.004477 5514 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.70.60" port: 39445 } attempt: 2
I20260811 00:58:10.004940 5638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:10.004751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:39445 (local address 127.0.0.1:49114)
0811 00:58:10.004803 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:10.004845 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.60:39445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260811 00:58:10.005049 5633 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.70.60:39445: Network error: Client connection negotiation failed: client connection to 127.15.70.60:39445: connect: Connection refused (error 111)
I20260811 00:58:10.005059 5517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:10.004850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:39445 (local address 127.0.0.1:49122)
0811 00:58:10.004926 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:10.004968 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.60:39445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260811 00:58:10.005554 5517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:10.005374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:39445 (local address 127.0.0.1:49138)
0811 00:58:10.005464 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:10.005510 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.60:39445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260811 00:58:10.005757 5514 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.70.60:39445: Network error: Client connection negotiation failed: client connection to 127.15.70.60:39445: connect: Connection refused (error 111)
W20260811 00:58:10.010349 5650 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:10.010314 5649 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:58:10.010711 5642 server_base.cc:1034] running on GCE node
W20260811 00:58:10.010598 5653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:58:10.011189 5642 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:58:10.011653 5642 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:58:10.012876 5642 hybrid_clock.cc:648] HybridClock initialized: now 1786409890012850 us; error 48 us; skew 500 ppm
Aug 11 00:58:10 dist-test-slave-h3ft krb5kdc[5370](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409890, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:58:10.016944 5642 init.cc:377] Logged in from keytab as kudu/127.15.70.60@KRBTEST.COM (short username kudu)
I20260811 00:58:10.017634 5642 webserver.cc:460] Webserver started at http://127.15.70.60:38471/ using document root <none> and password file <none>
I20260811 00:58:10.017977 5642 fs_manager.cc:359] Metadata directory not provided
I20260811 00:58:10.018062 5642 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:58:10.018255 5642 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:58:10.019879 5642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-2/data/instance:
uuid: "802c61d9909f4247b2574152c29584ee"
format_stamp: "Formatted at 2026-08-11 00:58:10 on dist-test-slave-h3ft"
server_key: "f47d0f425203186c2a3bd24dd9382164"
server_key_iv: "99732fbcc691a30423fdb0b5d51ee12c"
server_key_version: "encryptionkey@0"
I20260811 00:58:10.020387 5642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-2/wal/instance:
uuid: "802c61d9909f4247b2574152c29584ee"
format_stamp: "Formatted at 2026-08-11 00:58:10 on dist-test-slave-h3ft"
server_key: "f47d0f425203186c2a3bd24dd9382164"
server_key_iv: "99732fbcc691a30423fdb0b5d51ee12c"
server_key_version: "encryptionkey@0"
I20260811 00:58:10.022601 5642 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 00:58:10.023834 5664 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:10.024226 5642 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 00:58:10.024451 5642 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-2/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-2/wal
uuid: "802c61d9909f4247b2574152c29584ee"
format_stamp: "Formatted at 2026-08-11 00:58:10 on dist-test-slave-h3ft"
server_key: "f47d0f425203186c2a3bd24dd9382164"
server_key_iv: "99732fbcc691a30423fdb0b5d51ee12c"
server_key_version: "encryptionkey@0"
I20260811 00:58:10.024701 5642 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:58:10.043295 5642 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:58:10.046605 5642 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:58:10.046784 5642 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:58:10.052750 5642 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.60:39445
I20260811 00:58:10.052788 5755 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.60:39445 every 8 connection(s)
I20260811 00:58:10.053560 5642 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-2/data/info.pb
I20260811 00:58:10.054740 5758 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:58:10.056958 5758 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.70.62" port: 37033 } has no permanent_uuid. Determining permanent_uuid...
I20260811 00:58:10.062390 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 5642
I20260811 00:58:10.062662 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409704606556-15640-0/minicluster-data/master-2/wal/instance
I20260811 00:58:10.062933 15640 external_mini_cluster.cc:1428] Setting key de572568782932460011f867f3120b4e
Aug 11 00:58:10 dist-test-slave-h3ft krb5kdc[5370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409890, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.60@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
Aug 11 00:58:10 dist-test-slave-h3ft krb5kdc[5370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409889, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.70.60@KRBTEST.COM
I20260811 00:58:10.071729 5518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:10.058206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55958 (local address 127.15.70.62:37033)
0811 00:58:10.058315 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:10.058319 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:10.058558 (+ 239us) server_negotiation.cc:407] Connection header received
0811 00:58:10.059457 (+ 899us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:10.059459 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:10.059474 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:10.059540 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:10.060488 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:10.061057 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:10.062594 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:10.062978 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:10.063119 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:10.066650 (+ 3531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:10.066653 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:10.066654 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:10.066667 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:10.069341 (+ 2674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:10.070023 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:10.070025 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:10.070026 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:10.070134 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:10.070570 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:10.070572 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:10.070573 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:10.070739 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:10.070856 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:10.071432 (+ 576us) server_negotiation.cc:299] Negotiation successful
0811 00:58:10.071552 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 00:58:10.071887 5762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:10.058089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:37033 (local address 127.0.0.1:55958)
0811 00:58:10.058386 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:10.058443 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:10.059275 (+ 832us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:10.059650 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:10.059655 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:10.060053 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:58:10.060328 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:10.060333 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:10.061263 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:10.061265 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:10.062405 (+ 1140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:10.062409 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:10.063142 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:10.063143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:10.063313 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:10.064134 (+ 821us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:58:10.064149 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:58:10.066435 (+ 2286us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:58:10.069489 (+ 3054us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:10.069507 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:10.069510 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:10.069920 (+ 410us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:10.070257 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:10.070258 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:10.070259 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:10.070435 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:10.070858 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:58:10.070865 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:58:10.071160 (+ 295us) client_negotiation.cc:769] Sending connection context
0811 00:58:10.071332 (+ 172us) client_negotiation.cc:240] Negotiation successful
0811 00:58:10.071586 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":146,"threads_started":1}
I20260811 00:58:10.073123 5758 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34071 } has no permanent_uuid. Determining permanent_uuid...
I20260811 00:58:10.074817 5764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:10.063559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49150 (local address 127.15.70.60:39445)
0811 00:58:10.063814 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:10.063819 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:10.063892 (+ 73us) server_negotiation.cc:407] Connection header received
0811 00:58:10.063948 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:10.063952 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:10.063981 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:10.064106 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:10.064888 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:10.065831 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:10.066873 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:10.067367 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:10.067462 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:10.070501 (+ 3039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:10.070514 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:10.070514 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:10.070528 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:10.073228 (+ 2700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:10.073790 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:10.073793 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:10.073793 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:10.073886 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:10.074120 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:10.074121 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:10.074122 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:10.074334 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:10.074457 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:10.074652 (+ 195us) server_negotiation.cc:299] Negotiation successful
0811 00:58:10.074724 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":212,"thread_start_us":139,"threads_started":1}
Aug 11 00:58:10 dist-test-slave-h3ft krb5kdc[5370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409890, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.60@KRBTEST.COM for kudu/127.15.70.61@KRBTEST.COM
Aug 11 00:58:10 dist-test-slave-h3ft krb5kdc[5370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409889, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:58:10.082317 5762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:10.073508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.61:34071 (local address 127.0.0.1:36222)
0811 00:58:10.073573 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:10.073587 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:10.073634 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:10.073859 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:10.073861 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:10.074041 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:58:10.074125 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:10.074127 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:10.075206 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:10.075207 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:10.075919 (+ 712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:10.075922 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:10.076299 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:10.076300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:10.076366 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:10.076882 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:58:10.076887 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:58:10.078233 (+ 1346us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:58:10.080921 (+ 2688us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:10.080923 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:10.080923 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:10.081222 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:10.081518 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:10.081519 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:10.081520 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:10.081630 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:10.081973 (+ 343us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:58:10.081974 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:58:10.082045 (+ 71us) client_negotiation.cc:769] Sending connection context
0811 00:58:10.082108 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 00:58:10.082223 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 00:58:10.082405 5639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:10.073634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36222 (local address 127.15.70.61:34071)
0811 00:58:10.073715 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:10.073717 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:10.073726 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:58:10.073761 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:10.073762 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:10.073777 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:10.073840 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:10.074244 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:10.075131 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:10.075994 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:10.076219 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:10.076307 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:10.078335 (+ 2028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:10.078337 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:10.078337 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:10.078348 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:10.080784 (+ 2436us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:10.081319 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:10.081320 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:10.081320 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:10.081417 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:10.081715 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:10.081716 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:10.081717 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:10.081873 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:10.081972 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:10.082171 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 00:58:10.082272 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 00:58:10.082974 5758 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.70.60" port: 39445 } has no permanent_uuid. Determining permanent_uuid...
I20260811 00:58:10.084836 5518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:10.075966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55962 (local address 127.15.70.62:37033)
0811 00:58:10.076017 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:10.076018 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:10.076026 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:58:10.076053 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:10.076054 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:10.076064 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:10.076117 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:10.076729 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:10.077230 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:10.077998 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:10.078237 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:10.078317 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:10.081408 (+ 3091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:10.081410 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:10.081411 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:10.081421 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:10.083447 (+ 2026us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:10.083845 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:10.083847 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:10.083847 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:10.083921 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:10.084204 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:10.084205 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:10.084205 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:10.084377 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:10.084594 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:10.084629 (+ 35us) server_negotiation.cc:299] Negotiation successful
0811 00:58:10.084717 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
Aug 11 00:58:10 dist-test-slave-h3ft krb5kdc[5370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409890, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.60@KRBTEST.COM for kudu/127.15.70.60@KRBTEST.COM
Aug 11 00:58:10 dist-test-slave-h3ft krb5kdc[5370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409889, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.70.61@KRBTEST.COM
I20260811 00:58:10.092103 5762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:10.083386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:39445 (local address 127.0.0.1:49160)
0811 00:58:10.083442 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:10.083452 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:10.083515 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:10.083634 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:10.083634 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:10.083794 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:58:10.083870 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:10.083873 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:10.084883 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:10.084884 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:10.085504 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:10.085507 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:10.085998 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:10.085999 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:10.086077 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:10.086550 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:58:10.086556 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:58:10.088033 (+ 1477us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:58:10.090526 (+ 2493us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:10.090527 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:10.090528 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:10.090752 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:10.091136 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:10.091138 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:10.091138 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:10.091236 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:10.091676 (+ 440us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:58:10.091677 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:58:10.091738 (+ 61us) client_negotiation.cc:769] Sending connection context
0811 00:58:10.091815 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 00:58:10.092004 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 00:58:10.092619 5764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:10.083451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49160 (local address 127.15.70.60:39445)
0811 00:58:10.083512 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:10.083514 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:10.083523 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:58:10.083571 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:10.083572 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:10.083585 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:10.083632 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:10.083982 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:10.084791 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:10.085587 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:10.085918 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:10.085992 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:10.088129 (+ 2137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:10.088131 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:10.088131 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:10.088140 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:10.090370 (+ 2230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:10.090881 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:10.090883 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:10.090884 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:10.090985 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:10.091334 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:10.091335 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:10.091336 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:10.091539 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:10.091642 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:10.091898 (+ 256us) server_negotiation.cc:299] Negotiation successful
0811 00:58:10.092459 (+ 561us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":87,"server-negotiator.queue_time_us":41}
I20260811 00:58:10.095188 5758 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 802c61d9909f4247b2574152c29584ee: Bootstrap starting.
I20260811 00:58:10.096237 5633 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.70.60" port: 39445 } attempt: 3
I20260811 00:58:10.097119 5758 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 802c61d9909f4247b2574152c29584ee: Neither blocks nor log segments found. Creating new log.
I20260811 00:58:10.097788 5639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:10.085804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36228 (local address 127.15.70.61:34071)
0811 00:58:10.085854 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:10.085857 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:10.085865 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:58:10.085893 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:10.085894 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:10.085907 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:10.085972 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:10.086643 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:10.087254 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:10.088263 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:10.088572 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:10.088651 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:10.093082 (+ 4431us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:10.093086 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:10.093086 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:10.093102 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:10.095753 (+ 2651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:10.096485 (+ 732us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:10.096488 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:10.096488 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:10.096591 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:10.096885 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:10.096886 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:10.096887 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:10.097095 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:10.097440 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:10.097509 (+ 69us) server_negotiation.cc:299] Negotiation successful
0811 00:58:10.097640 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 00:58:10.097797 5758 log.cc:824] T 00000000000000000000000000000000 P 802c61d9909f4247b2574152c29584ee: Log is configured to *not* fsync() on all Append() calls
I20260811 00:58:10.099936 5758 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 802c61d9909f4247b2574152c29584ee: No bootstrap required, opened a new log
I20260811 00:58:10.101711 15640 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
Aug 11 00:58:10 dist-test-slave-h3ft krb5kdc[5370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409889, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.61@KRBTEST.COM for kudu/127.15.70.60@KRBTEST.COM
I20260811 00:58:10.103552 5758 raft_consensus.cc:348] T 00000000000000000000000000000000 P 802c61d9909f4247b2574152c29584ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc5066185a5846b4a8c65df6a367bfe0" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 37033 } } peers { permanent_uuid: "deb1f31721a5400eb3249b23a1166790" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34071 } } peers { permanent_uuid: "802c61d9909f4247b2574152c29584ee" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 39445 } }
I20260811 00:58:10.103880 5758 raft_consensus.cc:374] T 00000000000000000000000000000000 P 802c61d9909f4247b2574152c29584ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:58:10.103941 5758 raft_consensus.cc:729] T 00000000000000000000000000000000 P 802c61d9909f4247b2574152c29584ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 802c61d9909f4247b2574152c29584ee, State: Initialized, Role: FOLLOWER
I20260811 00:58:10.104131 5758 consensus_queue.cc:260] T 00000000000000000000000000000000 P 802c61d9909f4247b2574152c29584ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc5066185a5846b4a8c65df6a367bfe0" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 37033 } } peers { permanent_uuid: "deb1f31721a5400eb3249b23a1166790" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34071 } } peers { permanent_uuid: "802c61d9909f4247b2574152c29584ee" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 39445 } }
I20260811 00:58:10.104636 5758 sys_catalog.cc:564] T 00000000000000000000000000000000 P 802c61d9909f4247b2574152c29584ee [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:58:10.105005 5514 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.70.60" port: 39445 } attempt: 3
I20260811 00:58:10.107044 5773 sys_catalog.cc:455] T 00000000000000000000000000000000 P 802c61d9909f4247b2574152c29584ee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc5066185a5846b4a8c65df6a367bfe0" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 37033 } } peers { permanent_uuid: "deb1f31721a5400eb3249b23a1166790" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34071 } } peers { permanent_uuid: "802c61d9909f4247b2574152c29584ee" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 39445 } } }
I20260811 00:58:10.107605 5773 sys_catalog.cc:458] T 00000000000000000000000000000000 P 802c61d9909f4247b2574152c29584ee [sys.catalog]: This master's current role is: FOLLOWER
I20260811 00:58:10.107718 5638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:10.096807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:39445 (local address 127.0.0.1:49168)
0811 00:58:10.096883 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:10.096896 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:10.096944 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:10.097315 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:10.097318 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:10.097552 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:58:10.097622 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:10.097625 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:10.098899 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:10.098901 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:10.099942 (+ 1041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:10.099946 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:10.100534 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:10.100535 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:10.100606 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:10.101247 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:58:10.101253 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:58:10.102931 (+ 1678us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:58:10.105782 (+ 2851us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:10.105785 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:10.105785 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:10.106400 (+ 615us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:10.106721 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:10.106722 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:10.106723 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:10.106812 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:10.107285 (+ 473us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:58:10.107286 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:58:10.107354 (+ 68us) client_negotiation.cc:769] Sending connection context
0811 00:58:10.107440 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 00:58:10.107589 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260811 00:58:10.108153 5764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:10.096857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49168 (local address 127.15.70.60:39445)
0811 00:58:10.096981 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:10.096983 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:10.096993 (+ 10us) server_negotiation.cc:407] Connection header received
0811 00:58:10.097031 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:10.097032 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:10.097124 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:10.097707 (+ 583us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:10.097754 (+ 47us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:10.098646 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:10.100109 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:10.100440 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:10.100534 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:10.103166 (+ 2632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:10.103169 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:10.103169 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:10.103181 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:10.105670 (+ 2489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:10.106526 (+ 856us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:10.106528 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:10.106528 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:10.106629 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:10.106891 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:10.106892 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:10.106892 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:10.107170 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:10.107281 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:10.107953 (+ 672us) server_negotiation.cc:299] Negotiation successful
0811 00:58:10.108060 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260811 00:58:10.110440 5633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P deb1f31721a5400eb3249b23a1166790: Bootstrap starting.
I20260811 00:58:10.111701 5633 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P deb1f31721a5400eb3249b23a1166790: Neither blocks nor log segments found. Creating new log.
I20260811 00:58:10.112128 5633 log.cc:824] T 00000000000000000000000000000000 P deb1f31721a5400eb3249b23a1166790: Log is configured to *not* fsync() on all Append() calls
Aug 11 00:58:10 dist-test-slave-h3ft krb5kdc[5370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409889, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for kudu/127.15.70.60@KRBTEST.COM
I20260811 00:58:10.108413 5642 master_runner.cc:186] Error getting master registration for 127.15.70.62:37033: OK, instance_id { permanent_uuid: "dc5066185a5846b4a8c65df6a367bfe0" instance_seqno: 1786409889642948 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 00:58:10.113240 5642 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 00:58:10.113535 5633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P deb1f31721a5400eb3249b23a1166790: No bootstrap required, opened a new log
I20260811 00:58:10.117084 5633 raft_consensus.cc:348] T 00000000000000000000000000000000 P deb1f31721a5400eb3249b23a1166790 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc5066185a5846b4a8c65df6a367bfe0" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 37033 } } peers { permanent_uuid: "deb1f31721a5400eb3249b23a1166790" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34071 } } peers { permanent_uuid: "802c61d9909f4247b2574152c29584ee" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 39445 } }
I20260811 00:58:10.117556 5633 raft_consensus.cc:374] T 00000000000000000000000000000000 P deb1f31721a5400eb3249b23a1166790 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:58:10.117743 5633 raft_consensus.cc:729] T 00000000000000000000000000000000 P deb1f31721a5400eb3249b23a1166790 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deb1f31721a5400eb3249b23a1166790, State: Initialized, Role: FOLLOWER
I20260811 00:58:10.117967 5517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:10.105650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:39445 (local address 127.0.0.1:49176)
0811 00:58:10.105742 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:10.105754 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:10.105800 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:10.108402 (+ 2602us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:10.108404 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:10.108637 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:58:10.108703 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:10.108707 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:10.109563 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:10.109565 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:10.110326 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:10.110331 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:10.110885 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:10.110887 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:10.110971 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:10.111542 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:58:10.111550 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:58:10.113518 (+ 1968us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:58:10.116322 (+ 2804us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:10.116325 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:10.116325 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:10.116654 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:10.116945 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:10.116946 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:10.116947 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:10.117032 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:10.117405 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:58:10.117407 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:58:10.117485 (+ 78us) client_negotiation.cc:769] Sending connection context
0811 00:58:10.117562 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 00:58:10.117714 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68}
I20260811 00:58:10.117370 5639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:10.104504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36242 (local address 127.15.70.61:34071)
0811 00:58:10.104571 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:10.104574 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:10.106306 (+ 1732us) server_negotiation.cc:407] Connection header received
0811 00:58:10.106528 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:10.106530 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:10.106547 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:10.106588 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:10.107875 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:10.108713 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:10.110079 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:10.110392 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:10.110454 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:10.112802 (+ 2348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:10.112804 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:10.112805 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:10.112814 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:10.115852 (+ 3038us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:10.116334 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:10.116336 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:10.116337 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:10.116412 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:10.116648 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:10.116649 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:10.116649 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:10.116799 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:10.116890 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:10.117121 (+ 231us) server_negotiation.cc:299] Negotiation successful
0811 00:58:10.117232 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 00:58:10.118438 5764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:10.106179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49176 (local address 127.15.70.60:39445)
0811 00:58:10.108232 (+ 2053us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:10.108235 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:10.108243 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:58:10.108269 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:10.108270 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:10.108283 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:10.108338 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:10.108797 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:10.109449 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:10.110447 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:10.110713 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:10.110775 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:10.113696 (+ 2921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:10.113697 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:10.113697 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:10.113709 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:10.116177 (+ 2468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:10.116767 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:10.116768 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:10.116768 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:10.116852 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:10.117112 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:10.117113 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:10.117114 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:10.117270 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:10.117345 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:10.118158 (+ 813us) server_negotiation.cc:299] Negotiation successful
0811 00:58:10.118263 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2035,"thread_start_us":140,"threads_started":1}
I20260811 00:58:10.119971 5633 consensus_queue.cc:260] T 00000000000000000000000000000000 P deb1f31721a5400eb3249b23a1166790 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc5066185a5846b4a8c65df6a367bfe0" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 37033 } } peers { permanent_uuid: "deb1f31721a5400eb3249b23a1166790" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34071 } } peers { permanent_uuid: "802c61d9909f4247b2574152c29584ee" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 39445 } }
I20260811 00:58:10.120709 5633 sys_catalog.cc:564] T 00000000000000000000000000000000 P deb1f31721a5400eb3249b23a1166790 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:58:10.121117 5514 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc5066185a5846b4a8c65df6a367bfe0: Bootstrap starting.
W20260811 00:58:10.121822 5792 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 802c61d9909f4247b2574152c29584ee: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 00:58:10.121878 5792 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 00:58:10.122108 5514 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dc5066185a5846b4a8c65df6a367bfe0: Neither blocks nor log segments found. Creating new log.
I20260811 00:58:10.122505 5514 log.cc:824] T 00000000000000000000000000000000 P dc5066185a5846b4a8c65df6a367bfe0: Log is configured to *not* fsync() on all Append() calls
I20260811 00:58:10.123783 5514 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc5066185a5846b4a8c65df6a367bfe0: No bootstrap required, opened a new log
I20260811 00:58:10.123793 5774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:10.104806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49174 (local address 127.15.70.60:39445)
0811 00:58:10.105047 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:10.105049 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:10.106801 (+ 1752us) server_negotiation.cc:407] Connection header received
0811 00:58:10.107055 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:10.107057 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:10.107073 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:10.107155 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:10.114425 (+ 7270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:10.115688 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:10.116892 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:10.117307 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:10.117357 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:10.119972 (+ 2615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:10.119974 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:10.119974 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:10.119984 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:10.122122 (+ 2138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:10.122660 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:10.122662 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:10.122662 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:10.122756 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:10.122987 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:10.122988 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:10.122989 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:10.123182 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:10.123302 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:10.123556 (+ 254us) server_negotiation.cc:299] Negotiation successful
0811 00:58:10.123658 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":214,"thread_start_us":152,"threads_started":1}
I20260811 00:58:10.123384 5522 master_runner.cc:186] Error getting master registration for 127.15.70.62:37033: OK, instance_id { permanent_uuid: "dc5066185a5846b4a8c65df6a367bfe0" instance_seqno: 1786409889642948 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 00:58:10.126693 5522 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 00:58:10.126663 5514 raft_consensus.cc:348] T 00000000000000000000000000000000 P dc5066185a5846b4a8c65df6a367bfe0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc5066185a5846b4a8c65df6a367bfe0" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 37033 } } peers { permanent_uuid: "deb1f31721a5400eb3249b23a1166790" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34071 } } peers { permanent_uuid: "802c61d9909f4247b2574152c29584ee" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 39445 } }
I20260811 00:58:10.126876 5514 raft_consensus.cc:374] T 00000000000000000000000000000000 P dc5066185a5846b4a8c65df6a367bfe0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:58:10.126946 5514 raft_consensus.cc:729] T 00000000000000000000000000000000 P dc5066185a5846b4a8c65df6a367bfe0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc5066185a5846b4a8c65df6a367bfe0, State: Initialized, Role: FOLLOWER
I20260811 00:58:10.127210 5514 consensus_queue.cc:260] T 00000000000000000000000000000000 P dc5066185a5846b4a8c65df6a367bfe0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc5066185a5846b4a8c65df6a367bfe0" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 37033 } } peers { permanent_uuid: "deb1f31721a5400eb3249b23a1166790" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34071 } } peers { permanent_uuid: "802c61d9909f4247b2574152c29584ee" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 39445 } }
I20260811 00:58:10.127727 5514 sys_catalog.cc:564] T 00000000000000000000000000000000 P dc5066185a5846b4a8c65df6a367bfe0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:58:10.127731 5518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:10.104261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55976 (local address 127.15.70.62:37033)
0811 00:58:10.104620 (+ 359us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:10.104622 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:10.118157 (+ 13535us) server_negotiation.cc:407] Connection header received
0811 00:58:10.118309 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:10.118311 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:10.118327 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:10.118365 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:10.119329 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:10.120047 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:10.122009 (+ 1962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:10.122319 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:10.122369 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:10.124068 (+ 1699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:10.124071 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:10.124071 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:10.124079 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:10.126073 (+ 1994us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:10.126572 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:10.126574 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:10.126575 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:10.126649 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:10.126879 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:10.126881 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:10.126881 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:10.127140 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:10.127276 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:10.127545 (+ 269us) server_negotiation.cc:299] Negotiation successful
0811 00:58:10.127658 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319}
W20260811 00:58:10.130800 5834 catalog_manager.cc:1558] T 00000000000000000000000000000000 P dc5066185a5846b4a8c65df6a367bfe0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 00:58:10.131069 5834 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 00:58:10.134907 5391 master_runner.cc:263] No leader master found from master dc5066185a5846b4a8c65df6a367bfe0
I20260811 00:58:10.135037 5391 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260811 00:58:10.135896 5816 catalog_manager.cc:1558] T 00000000000000000000000000000000 P deb1f31721a5400eb3249b23a1166790: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 00:58:10.135989 5816 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 00:58:10.136401 5794 sys_catalog.cc:455] T 00000000000000000000000000000000 P deb1f31721a5400eb3249b23a1166790 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc5066185a5846b4a8c65df6a367bfe0" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 37033 } } peers { permanent_uuid: "deb1f31721a5400eb3249b23a1166790" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34071 } } peers { permanent_uuid: "802c61d9909f4247b2574152c29584ee" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 39445 } } }
I20260811 00:58:10.136607 5794 sys_catalog.cc:458] T 00000000000000000000000000000000 P deb1f31721a5400eb3249b23a1166790 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 00:58:10.136824 5819 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc5066185a5846b4a8c65df6a367bfe0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc5066185a5846b4a8c65df6a367bfe0" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 37033 } } peers { permanent_uuid: "deb1f31721a5400eb3249b23a1166790" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34071 } } peers { permanent_uuid: "802c61d9909f4247b2574152c29584ee" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 39445 } } }
I20260811 00:58:10.137032 5819 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc5066185a5846b4a8c65df6a367bfe0 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 00:58:10.140025 5432 tablet.cc:2369] T 00000000000000000000000000000000 P dc5066185a5846b4a8c65df6a367bfe0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 00:58:10.297885 5675 tablet.cc:2369] T 00000000000000000000000000000000 P 802c61d9909f4247b2574152c29584ee: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 00:58:10.343438 5555 tablet.cc:2369] T 00000000000000000000000000000000 P deb1f31721a5400eb3249b23a1166790: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 00:58:10.410377 5794 raft_consensus.cc:482] T 00000000000000000000000000000000 P deb1f31721a5400eb3249b23a1166790 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:58:10.410645 5794 raft_consensus.cc:504] T 00000000000000000000000000000000 P deb1f31721a5400eb3249b23a1166790 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc5066185a5846b4a8c65df6a367bfe0" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 37033 } } peers { permanent_uuid: "deb1f31721a5400eb3249b23a1166790" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34071 } } peers { permanent_uuid: "802c61d9909f4247b2574152c29584ee" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 39445 } }
I20260811 00:58:10.411091 5794 leader_election.cc:288] T 00000000000000000000000000000000 P deb1f31721a5400eb3249b23a1166790 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc5066185a5846b4a8c65df6a367bfe0 (127.15.70.62:37033), 802c61d9909f4247b2574152c29584ee (127.15.70.60:39445)
I20260811 00:58:10.411633 5703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "deb1f31721a5400eb3249b23a1166790" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "802c61d9909f4247b2574152c29584ee" is_pre_election: true
I20260811 00:58:10.411716 5467 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "deb1f31721a5400eb3249b23a1166790" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc5066185a5846b4a8c65df6a367bfe0" is_pre_election: true
I20260811 00:58:10.411898 5467 raft_consensus.cc:2454] T 00000000000000000000000000000000 P dc5066185a5846b4a8c65df6a367bfe0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate deb1f31721a5400eb3249b23a1166790 in term 0.
I20260811 00:58:10.411906 5703 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 802c61d9909f4247b2574152c29584ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate deb1f31721a5400eb3249b23a1166790 in term 0.
I20260811 00:58:10.412179 5548 leader_election.cc:302] T 00000000000000000000000000000000 P deb1f31721a5400eb3249b23a1166790 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 802c61d9909f4247b2574152c29584ee, deb1f31721a5400eb3249b23a1166790; no voters:
I20260811 00:58:10.412358 5794 raft_consensus.cc:2781] T 00000000000000000000000000000000 P deb1f31721a5400eb3249b23a1166790 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:58:10.412433 5794 raft_consensus.cc:482] T 00000000000000000000000000000000 P deb1f31721a5400eb3249b23a1166790 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:58:10.412459 5794 raft_consensus.cc:3037] T 00000000000000000000000000000000 P deb1f31721a5400eb3249b23a1166790 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:58:10.413494 5794 raft_consensus.cc:504] T 00000000000000000000000000000000 P deb1f31721a5400eb3249b23a1166790 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc5066185a5846b4a8c65df6a367bfe0" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 37033 } } peers { permanent_uuid: "deb1f31721a5400eb3249b23a1166790" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34071 } } peers { permanent_uuid: "802c61d9909f4247b2574152c29584ee" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 39445 } }
I20260811 00:58:10.413708 5794 leader_election.cc:288] T 00000000000000000000000000000000 P deb1f31721a5400eb3249b23a1166790 [CANDIDATE]: Term 1 election: Requested vote from peers dc5066185a5846b4a8c65df6a367bfe0 (127.15.70.62:37033), 802c61d9909f4247b2574152c29584ee (127.15.70.60:39445)
I20260811 00:58:10.413954 5467 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "deb1f31721a5400eb3249b23a1166790" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc5066185a5846b4a8c65df6a367bfe0"
I20260811 00:58:10.413985 5703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "deb1f31721a5400eb3249b23a1166790" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "802c61d9909f4247b2574152c29584ee"
I20260811 00:58:10.414104 5703 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 802c61d9909f4247b2574152c29584ee [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:58:10.414099 5467 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dc5066185a5846b4a8c65df6a367bfe0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:58:10.415371 5703 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 802c61d9909f4247b2574152c29584ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deb1f31721a5400eb3249b23a1166790 in term 1.
I20260811 00:58:10.415371 5467 raft_consensus.cc:2454] T 00000000000000000000000000000000 P dc5066185a5846b4a8c65df6a367bfe0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deb1f31721a5400eb3249b23a1166790 in term 1.
I20260811 00:58:10.415686 5553 leader_election.cc:302] T 00000000000000000000000000000000 P deb1f31721a5400eb3249b23a1166790 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dc5066185a5846b4a8c65df6a367bfe0, deb1f31721a5400eb3249b23a1166790; no voters:
I20260811 00:58:10.415825 5794 raft_consensus.cc:2781] T 00000000000000000000000000000000 P deb1f31721a5400eb3249b23a1166790 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:58:10.416013 5794 raft_consensus.cc:686] T 00000000000000000000000000000000 P deb1f31721a5400eb3249b23a1166790 [term 1 LEADER]: Becoming Leader. State: Replica: deb1f31721a5400eb3249b23a1166790, State: Running, Role: LEADER
I20260811 00:58:10.416178 5794 consensus_queue.cc:237] T 00000000000000000000000000000000 P deb1f31721a5400eb3249b23a1166790 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc5066185a5846b4a8c65df6a367bfe0" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 37033 } } peers { permanent_uuid: "deb1f31721a5400eb3249b23a1166790" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34071 } } peers { permanent_uuid: "802c61d9909f4247b2574152c29584ee" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 39445 } }
I20260811 00:58:10.416765 5838 sys_catalog.cc:455] T 00000000000000000000000000000000 P deb1f31721a5400eb3249b23a1166790 [sys.catalog]: SysCatalogTable state changed. Reason: New leader deb1f31721a5400eb3249b23a1166790. Latest consensus state: current_term: 1 leader_uuid: "deb1f31721a5400eb3249b23a1166790" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc5066185a5846b4a8c65df6a367bfe0" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 37033 } } peers { permanent_uuid: "deb1f31721a5400eb3249b23a1166790" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34071 } } peers { permanent_uuid: "802c61d9909f4247b2574152c29584ee" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 39445 } } }
I20260811 00:58:10.416898 5838 sys_catalog.cc:458] T 00000000000000000000000000000000 P deb1f31721a5400eb3249b23a1166790 [sys.catalog]: This master's current role is: LEADER
I20260811 00:58:10.417176 5841 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:58:10.417424 5841 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:58:10.419562 5703 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 802c61d9909f4247b2574152c29584ee [term 1 FOLLOWER]: Refusing update from remote peer deb1f31721a5400eb3249b23a1166790: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:58:10.419621 5467 raft_consensus.cc:1261] T 00000000000000000000000000000000 P dc5066185a5846b4a8c65df6a367bfe0 [term 1 FOLLOWER]: Refusing update from remote peer deb1f31721a5400eb3249b23a1166790: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:58:10.420084 5794 consensus_queue.cc:1035] T 00000000000000000000000000000000 P deb1f31721a5400eb3249b23a1166790 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc5066185a5846b4a8c65df6a367bfe0" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 37033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:58:10.420257 5838 consensus_queue.cc:1035] T 00000000000000000000000000000000 P deb1f31721a5400eb3249b23a1166790 [LEADER]: Connected to new peer: Peer: permanent_uuid: "802c61d9909f4247b2574152c29584ee" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 39445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:58:10.421756 5819 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc5066185a5846b4a8c65df6a367bfe0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader deb1f31721a5400eb3249b23a1166790. Latest consensus state: current_term: 1 leader_uuid: "deb1f31721a5400eb3249b23a1166790" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc5066185a5846b4a8c65df6a367bfe0" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 37033 } } peers { permanent_uuid: "deb1f31721a5400eb3249b23a1166790" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34071 } } peers { permanent_uuid: "802c61d9909f4247b2574152c29584ee" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 39445 } } }
I20260811 00:58:10.421875 5819 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc5066185a5846b4a8c65df6a367bfe0 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 00:58:10.422147 5773 sys_catalog.cc:455] T 00000000000000000000000000000000 P 802c61d9909f4247b2574152c29584ee [sys.catalog]: SysCatalogTable state changed. Reason: New leader deb1f31721a5400eb3249b23a1166790. Latest consensus state: current_term: 1 leader_uuid: "deb1f31721a5400eb3249b23a1166790" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc5066185a5846b4a8c65df6a367bfe0" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 37033 } } peers { permanent_uuid: "deb1f31721a5400eb3249b23a1166790" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34071 } } peers { permanent_uuid: "802c61d9909f4247b2574152c29584ee" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 39445 } } }
I20260811 00:58:10.422262 5773 sys_catalog.cc:458] T 00000000000000000000000000000000 P 802c61d9909f4247b2574152c29584ee [sys.catalog]: This master's current role is: FOLLOWER
I20260811 00:58:10.423067 5794 sys_catalog.cc:455] T 00000000000000000000000000000000 P deb1f31721a5400eb3249b23a1166790 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "deb1f31721a5400eb3249b23a1166790" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc5066185a5846b4a8c65df6a367bfe0" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 37033 } } peers { permanent_uuid: "deb1f31721a5400eb3249b23a1166790" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34071 } } peers { permanent_uuid: "802c61d9909f4247b2574152c29584ee" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 39445 } } }
I20260811 00:58:10.423204 5794 sys_catalog.cc:458] T 00000000000000000000000000000000 P deb1f31721a5400eb3249b23a1166790 [sys.catalog]: This master's current role is: LEADER
I20260811 00:58:10.423094 5853 sys_catalog.cc:455] T 00000000000000000000000000000000 P deb1f31721a5400eb3249b23a1166790 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "deb1f31721a5400eb3249b23a1166790" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc5066185a5846b4a8c65df6a367bfe0" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 37033 } } peers { permanent_uuid: "deb1f31721a5400eb3249b23a1166790" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34071 } } peers { permanent_uuid: "802c61d9909f4247b2574152c29584ee" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 39445 } } }
I20260811 00:58:10.423564 5819 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc5066185a5846b4a8c65df6a367bfe0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "deb1f31721a5400eb3249b23a1166790" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc5066185a5846b4a8c65df6a367bfe0" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 37033 } } peers { permanent_uuid: "deb1f31721a5400eb3249b23a1166790" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34071 } } peers { permanent_uuid: "802c61d9909f4247b2574152c29584ee" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 39445 } } }
I20260811 00:58:10.423659 5819 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc5066185a5846b4a8c65df6a367bfe0 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 00:58:10.423684 5773 sys_catalog.cc:455] T 00000000000000000000000000000000 P 802c61d9909f4247b2574152c29584ee [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "deb1f31721a5400eb3249b23a1166790" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc5066185a5846b4a8c65df6a367bfe0" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 37033 } } peers { permanent_uuid: "deb1f31721a5400eb3249b23a1166790" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34071 } } peers { permanent_uuid: "802c61d9909f4247b2574152c29584ee" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 39445 } } }
I20260811 00:58:10.423784 5773 sys_catalog.cc:458] T 00000000000000000000000000000000 P 802c61d9909f4247b2574152c29584ee [sys.catalog]: This master's current role is: FOLLOWER
I20260811 00:58:10.423779 5841 catalog_manager.cc:1347] Generated new cluster ID: 0123de83e7434c1ca62db46d9feddbc4
I20260811 00:58:10.423879 5841 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:58:10.423988 5842 mvcc.cc:205] Tried to move back new op lower bound from 7317134911154896896 to 7317134911145512960. Current Snapshot: MvccSnapshot[applied={T|T < 7317134911154896896 or (T in {7317134911154896896})}]
I20260811 00:58:10.424131 5844 mvcc.cc:205] Tried to move back new op lower bound from 7317134911154896896 to 7317134911145512960. Current Snapshot: MvccSnapshot[applied={T|T < 7317134911154896896}]
I20260811 00:58:10.427163 5853 sys_catalog.cc:458] T 00000000000000000000000000000000 P deb1f31721a5400eb3249b23a1166790 [sys.catalog]: This master's current role is: LEADER
I20260811 00:58:10.435410 5841 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:58:10.436283 5841 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:58:10.441972 5841 catalog_manager.cc:5868] T 00000000000000000000000000000000 P deb1f31721a5400eb3249b23a1166790: Generated new TSK 0
I20260811 00:58:10.442399 5841 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:58:11.122593 5792 catalog_manager.cc:1259] Loaded cluster ID: 0123de83e7434c1ca62db46d9feddbc4
I20260811 00:58:11.122713 5792 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 802c61d9909f4247b2574152c29584ee: loading cluster ID for follower catalog manager: success
I20260811 00:58:11.123912 5792 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 802c61d9909f4247b2574152c29584ee: acquiring CA information for follower catalog manager: success
I20260811 00:58:11.124310 5792 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 802c61d9909f4247b2574152c29584ee: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 00:58:11.131855 5834 catalog_manager.cc:1259] Loaded cluster ID: 0123de83e7434c1ca62db46d9feddbc4
I20260811 00:58:11.131963 5834 catalog_manager.cc:1552] T 00000000000000000000000000000000 P dc5066185a5846b4a8c65df6a367bfe0: loading cluster ID for follower catalog manager: success
I20260811 00:58:11.132962 5834 catalog_manager.cc:1574] T 00000000000000000000000000000000 P dc5066185a5846b4a8c65df6a367bfe0: acquiring CA information for follower catalog manager: success
I20260811 00:58:11.133378 5834 catalog_manager.cc:1602] T 00000000000000000000000000000000 P dc5066185a5846b4a8c65df6a367bfe0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 00:58:11.523074 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 5391
I20260811 00:58:11.538836 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 5522
I20260811 00:58:11.555173 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 5642
2026-08-11T00:58:11Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3631 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409704606556-15640-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:58:11 dist-test-slave-h3ft krb5kdc[5867](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:58:11 dist-test-slave-h3ft krb5kdc[5867](info): set up 2 sockets
Aug 11 00:58:11 dist-test-slave-h3ft krb5kdc[5867](info): commencing operation
krb5kdc: starting...
W20260811 00:58:12.947193 15640 mini_kdc.cc:121] Time spent starting KDC: real 1.359s user 0.001s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Aug 11 00:58:13 dist-test-slave-h3ft krb5kdc[5867](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:58:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:58:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.70.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
I20260811 00:58:13.112047 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:33581
--webserver_interface=127.15.70.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:33709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:33581
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:58:13.212074 5889 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:58:13.212405 5889 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:58:13.212445 5889 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:58:13.213708 5889 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:58:13.213793 5889 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:58:13.213819 5889 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:58:13.213843 5889 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:58:13.213871 5889 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:58:13.215546 5889 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:33709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:33581
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:33581
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5889
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:58:13.215883 5889 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:58:13.216180 5889 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:58:13.222177 5903 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:13.222234 5900 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:13.222250 5898 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:58:13.222643 5889 server_base.cc:1034] running on GCE node
I20260811 00:58:13.222909 5889 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:58:13.223315 5889 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:58:13.224507 5889 hybrid_clock.cc:648] HybridClock initialized: now 1786409893224449 us; error 40 us; skew 500 ppm
Aug 11 00:58:13 dist-test-slave-h3ft krb5kdc[5867](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409893, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:58:13.232440 5889 init.cc:377] Logged in from keytab as kudu/127.15.70.62@KRBTEST.COM (short username kudu)
I20260811 00:58:13.233140 5889 webserver.cc:460] Webserver started at http://127.15.70.62:42911/ using document root <none> and password file <none>
I20260811 00:58:13.233434 5889 fs_manager.cc:359] Metadata directory not provided
I20260811 00:58:13.233497 5889 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:58:13.233685 5889 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:58:13.235164 5889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "2a94eb8a74b049e2a876eb1e7336681e"
format_stamp: "Formatted at 2026-08-11 00:58:13 on dist-test-slave-h3ft"
server_key: "34be2285749e2b3a001afc4f8c8bf0e3"
server_key_iv: "4a40722c8681db68b04bd7f4bab22c6f"
server_key_version: "encryptionkey@0"
I20260811 00:58:13.235620 5889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "2a94eb8a74b049e2a876eb1e7336681e"
format_stamp: "Formatted at 2026-08-11 00:58:13 on dist-test-slave-h3ft"
server_key: "34be2285749e2b3a001afc4f8c8bf0e3"
server_key_iv: "4a40722c8681db68b04bd7f4bab22c6f"
server_key_version: "encryptionkey@0"
I20260811 00:58:13.237372 5889 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 00:58:13.238584 5912 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:13.239041 5889 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:58:13.239159 5889 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "2a94eb8a74b049e2a876eb1e7336681e"
format_stamp: "Formatted at 2026-08-11 00:58:13 on dist-test-slave-h3ft"
server_key: "34be2285749e2b3a001afc4f8c8bf0e3"
server_key_iv: "4a40722c8681db68b04bd7f4bab22c6f"
server_key_version: "encryptionkey@0"
I20260811 00:58:13.239238 5889 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:58:13.266055 5889 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:58:13.269080 5889 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:58:13.269232 5889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:58:13.274711 5889 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:33581
I20260811 00:58:13.274761 5991 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:33581 every 8 connection(s)
I20260811 00:58:13.275260 5889 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:58:13.276520 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:58:13.279749 5992 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a94eb8a74b049e2a876eb1e7336681e: Bootstrap starting.
I20260811 00:58:13.280535 5992 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2a94eb8a74b049e2a876eb1e7336681e: Neither blocks nor log segments found. Creating new log.
I20260811 00:58:13.280965 5992 log.cc:824] T 00000000000000000000000000000000 P 2a94eb8a74b049e2a876eb1e7336681e: Log is configured to *not* fsync() on all Append() calls
I20260811 00:58:13.281019 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 5889
I20260811 00:58:13.281121 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 00:58:13.281390 15640 external_mini_cluster.cc:1428] Setting key 1e9408af5eb401102a30d665a6a1dac9
I20260811 00:58:13.281908 5992 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a94eb8a74b049e2a876eb1e7336681e: No bootstrap required, opened a new log
I20260811 00:58:13.284330 5992 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a94eb8a74b049e2a876eb1e7336681e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a94eb8a74b049e2a876eb1e7336681e" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 33581 } }
I20260811 00:58:13.284524 5992 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2a94eb8a74b049e2a876eb1e7336681e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:58:13.284550 5992 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a94eb8a74b049e2a876eb1e7336681e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a94eb8a74b049e2a876eb1e7336681e, State: Initialized, Role: FOLLOWER
I20260811 00:58:13.284765 5992 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a94eb8a74b049e2a876eb1e7336681e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a94eb8a74b049e2a876eb1e7336681e" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 33581 } }
I20260811 00:58:13.284874 5992 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2a94eb8a74b049e2a876eb1e7336681e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:58:13.284912 5992 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a94eb8a74b049e2a876eb1e7336681e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:58:13.284968 5992 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a94eb8a74b049e2a876eb1e7336681e [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:58:13.285883 5992 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a94eb8a74b049e2a876eb1e7336681e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a94eb8a74b049e2a876eb1e7336681e" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 33581 } }
I20260811 00:58:13.286002 5992 leader_election.cc:302] T 00000000000000000000000000000000 P 2a94eb8a74b049e2a876eb1e7336681e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2a94eb8a74b049e2a876eb1e7336681e; no voters:
I20260811 00:58:13.286175 5992 leader_election.cc:288] T 00000000000000000000000000000000 P 2a94eb8a74b049e2a876eb1e7336681e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:58:13.286315 6000 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2a94eb8a74b049e2a876eb1e7336681e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:58:13.286533 5992 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a94eb8a74b049e2a876eb1e7336681e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:58:13.286563 6000 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2a94eb8a74b049e2a876eb1e7336681e [term 1 LEADER]: Becoming Leader. State: Replica: 2a94eb8a74b049e2a876eb1e7336681e, State: Running, Role: LEADER
I20260811 00:58:13.286775 6000 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a94eb8a74b049e2a876eb1e7336681e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a94eb8a74b049e2a876eb1e7336681e" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 33581 } }
I20260811 00:58:13.287345 6001 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a94eb8a74b049e2a876eb1e7336681e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2a94eb8a74b049e2a876eb1e7336681e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a94eb8a74b049e2a876eb1e7336681e" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 33581 } } }
I20260811 00:58:13.287431 6001 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a94eb8a74b049e2a876eb1e7336681e [sys.catalog]: This master's current role is: LEADER
I20260811 00:58:13.287824 6005 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a94eb8a74b049e2a876eb1e7336681e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a94eb8a74b049e2a876eb1e7336681e. Latest consensus state: current_term: 1 leader_uuid: "2a94eb8a74b049e2a876eb1e7336681e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a94eb8a74b049e2a876eb1e7336681e" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 33581 } } }
I20260811 00:58:13.287887 6005 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a94eb8a74b049e2a876eb1e7336681e [sys.catalog]: This master's current role is: LEADER
W20260811 00:58:13.288908 6024 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2a94eb8a74b049e2a876eb1e7336681e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 00:58:13.289003 6024 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 00:58:13.289096 6012 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:58:13.289345 6012 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 00:58:13 dist-test-slave-h3ft krb5kdc[5867](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:58:13.291945 6012 catalog_manager.cc:1347] Generated new cluster ID: ef5c466287d64e2894fb4f5febbbc8c5
I20260811 00:58:13.292007 6012 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:58:13.296379 5999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:13.282129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51336 (local address 127.15.70.62:33581)
0811 00:58:13.282373 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:13.282391 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:13.282426 (+ 35us) server_negotiation.cc:407] Connection header received
0811 00:58:13.283532 (+ 1106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:13.283544 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:13.283616 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:13.283797 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:13.284655 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:13.286666 (+ 2011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:13.288019 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:13.288704 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:13.288833 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:13.292011 (+ 3178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:13.292015 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:13.292016 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:13.292031 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:13.294249 (+ 2218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:13.294674 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:13.294678 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:13.294678 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:13.294787 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:13.294957 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:13.294958 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:13.294958 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:13.295312 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:13.295504 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:13.295983 (+ 479us) server_negotiation.cc:299] Negotiation successful
0811 00:58:13.296135 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":117,"threads_started":1}
I20260811 00:58:13.297585 15640 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 00:58:13.312816 6012 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:58:13.313613 6012 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:58:13.316670 6012 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2a94eb8a74b049e2a876eb1e7336681e: Generated new TSK 0
I20260811 00:58:13.316931 6012 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:58:13.352917 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 5889
2026-08-11T00:58:13Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1798 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:58:13 dist-test-slave-h3ft krb5kdc[6036](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:58:13 dist-test-slave-h3ft krb5kdc[6036](info): set up 2 sockets
Aug 11 00:58:13 dist-test-slave-h3ft krb5kdc[6036](info): commencing operation
krb5kdc: starting...
W20260811 00:58:14.703809 15640 mini_kdc.cc:121] Time spent starting KDC: real 1.317s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Aug 11 00:58:14 dist-test-slave-h3ft krb5kdc[6036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409894, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:58:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:58:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.70.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
I20260811 00:58:14.859782 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:46183
--webserver_interface=127.15.70.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:39343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:46183
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:58:14.959509 6062 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:58:14.959877 6062 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:58:14.959925 6062 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:58:14.961381 6062 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:58:14.961501 6062 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:58:14.961529 6062 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:58:14.961553 6062 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:58:14.961583 6062 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:58:14.963647 6062 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:39343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:46183
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:46183
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6062
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:58:14.964069 6062 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:58:14.964393 6062 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:58:14.970279 6072 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:14.970273 6079 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:14.970448 6070 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:58:14.970678 6062 server_base.cc:1034] running on GCE node
I20260811 00:58:14.970983 6062 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:58:14.971385 6062 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:58:14.972579 6062 hybrid_clock.cc:648] HybridClock initialized: now 1786409894972554 us; error 41 us; skew 500 ppm
Aug 11 00:58:14 dist-test-slave-h3ft krb5kdc[6036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409894, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:58:14.975973 6062 init.cc:377] Logged in from keytab as kudu/127.15.70.62@KRBTEST.COM (short username kudu)
I20260811 00:58:14.976609 6062 webserver.cc:460] Webserver started at http://127.15.70.62:37601/ using document root <none> and password file <none>
I20260811 00:58:14.976873 6062 fs_manager.cc:359] Metadata directory not provided
I20260811 00:58:14.976931 6062 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:58:14.977059 6062 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:58:14.978577 6062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "3b87d21591ba4a08b98dd450617ac729"
format_stamp: "Formatted at 2026-08-11 00:58:14 on dist-test-slave-h3ft"
server_key: "dfdaedecfe0500c9de6dde0676952a65"
server_key_iv: "03d47f0ab5724fa1e914fc46a23d9542"
server_key_version: "encryptionkey@0"
I20260811 00:58:14.978995 6062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "3b87d21591ba4a08b98dd450617ac729"
format_stamp: "Formatted at 2026-08-11 00:58:14 on dist-test-slave-h3ft"
server_key: "dfdaedecfe0500c9de6dde0676952a65"
server_key_iv: "03d47f0ab5724fa1e914fc46a23d9542"
server_key_version: "encryptionkey@0"
I20260811 00:58:14.980791 6062 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260811 00:58:14.981739 6091 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:14.982060 6062 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:58:14.982188 6062 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "3b87d21591ba4a08b98dd450617ac729"
format_stamp: "Formatted at 2026-08-11 00:58:14 on dist-test-slave-h3ft"
server_key: "dfdaedecfe0500c9de6dde0676952a65"
server_key_iv: "03d47f0ab5724fa1e914fc46a23d9542"
server_key_version: "encryptionkey@0"
I20260811 00:58:14.982285 6062 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:58:14.999426 6062 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:58:15.002271 6062 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:58:15.002460 6062 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:58:15.008203 6062 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:46183
I20260811 00:58:15.008308 6172 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:46183 every 8 connection(s)
I20260811 00:58:15.008749 6062 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:58:15.010113 6174 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:58:15.013391 6174 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729: Bootstrap starting.
I20260811 00:58:15.014230 6174 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729: Neither blocks nor log segments found. Creating new log.
I20260811 00:58:15.014634 6174 log.cc:824] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729: Log is configured to *not* fsync() on all Append() calls
I20260811 00:58:15.015671 6174 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729: No bootstrap required, opened a new log
I20260811 00:58:15.017709 6174 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b87d21591ba4a08b98dd450617ac729" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 46183 } }
I20260811 00:58:15.017884 6174 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:58:15.017910 6174 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b87d21591ba4a08b98dd450617ac729, State: Initialized, Role: FOLLOWER
I20260811 00:58:15.018054 6174 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b87d21591ba4a08b98dd450617ac729" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 46183 } }
I20260811 00:58:15.018106 6174 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:58:15.018131 6174 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:58:15.018162 6174 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:58:15.018213 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 6062
I20260811 00:58:15.018421 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 00:58:15.018688 15640 external_mini_cluster.cc:1428] Setting key f5f0c7c6d42f2ae3f447f42c5cbf004f
I20260811 00:58:15.019532 6174 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b87d21591ba4a08b98dd450617ac729" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 46183 } }
I20260811 00:58:15.019682 6174 leader_election.cc:302] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3b87d21591ba4a08b98dd450617ac729; no voters:
I20260811 00:58:15.019891 6174 leader_election.cc:288] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:58:15.019920 6183 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:58:15.020180 6183 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [term 1 LEADER]: Becoming Leader. State: Replica: 3b87d21591ba4a08b98dd450617ac729, State: Running, Role: LEADER
I20260811 00:58:15.020267 6174 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:58:15.020303 6183 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b87d21591ba4a08b98dd450617ac729" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 46183 } }
I20260811 00:58:15.020701 6186 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3b87d21591ba4a08b98dd450617ac729. Latest consensus state: current_term: 1 leader_uuid: "3b87d21591ba4a08b98dd450617ac729" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b87d21591ba4a08b98dd450617ac729" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 46183 } } }
I20260811 00:58:15.020841 6186 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [sys.catalog]: This master's current role is: LEADER
I20260811 00:58:15.021167 6194 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:58:15.022073 6194 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:58:15.022801 6185 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3b87d21591ba4a08b98dd450617ac729" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b87d21591ba4a08b98dd450617ac729" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 46183 } } }
I20260811 00:58:15.022879 6185 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [sys.catalog]: This master's current role is: LEADER
I20260811 00:58:15.026896 6194 catalog_manager.cc:1347] Generated new cluster ID: df22a5d80f1b4d08b3239a02d1ef2b43
I20260811 00:58:15.026969 6194 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 00:58:15 dist-test-slave-h3ft krb5kdc[6036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409894, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:58:15.033421 6182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:15.019444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44008 (local address 127.15.70.62:46183)
0811 00:58:15.019761 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:15.019775 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:15.019815 (+ 40us) server_negotiation.cc:407] Connection header received
0811 00:58:15.019973 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:15.019983 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:15.020061 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:15.020281 (+ 220us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:15.021301 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:15.023700 (+ 2399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:15.025018 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:15.025668 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:15.025779 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:15.029182 (+ 3403us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:15.029187 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:15.029188 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:15.029202 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:15.031473 (+ 2271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:15.031947 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:15.031950 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:15.031950 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:15.032093 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:15.032332 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:15.032333 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:15.032333 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:15.032683 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:15.032856 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:15.033029 (+ 173us) server_negotiation.cc:299] Negotiation successful
0811 00:58:15.033185 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":257,"thread_start_us":161,"threads_started":1}
I20260811 00:58:15.040784 6194 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:58:15.041391 6194 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:58:15.050339 6194 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729: Generated new TSK 0
I20260811 00:58:15.050639 6194 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.70.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab.
Entry for principal kudu/127.15.70.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab.
I20260811 00:58:15.092167 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.1:0
--local_ip_for_outbound_sockets=127.15.70.1
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:46183
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:39343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:58:15.194410 6214 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:58:15.194706 6214 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:58:15.194737 6214 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:58:15.196033 6214 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:58:15.196079 6214 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:58:15.196112 6214 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.1
I20260811 00:58:15.197788 6214 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:39343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:46183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6214
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.1
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:58:15.198084 6214 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:58:15.198330 6214 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:58:15.204809 6220 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:15.204814 6221 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:58:15.204854 6214 server_base.cc:1034] running on GCE node
W20260811 00:58:15.204901 6225 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:58:15.205361 6214 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:58:15.205695 6214 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:58:15.206871 6214 hybrid_clock.cc:648] HybridClock initialized: now 1786409895206824 us; error 65 us; skew 500 ppm
Aug 11 00:58:15 dist-test-slave-h3ft krb5kdc[6036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409895, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:58:15.210436 6214 init.cc:377] Logged in from keytab as kudu/127.15.70.1@KRBTEST.COM (short username kudu)
I20260811 00:58:15.211089 6214 webserver.cc:460] Webserver started at http://127.15.70.1:37383/ using document root <none> and password file <none>
I20260811 00:58:15.211392 6214 fs_manager.cc:359] Metadata directory not provided
I20260811 00:58:15.211469 6214 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:58:15.211643 6214 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:58:15.212998 6214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/data/instance:
uuid: "5d4bc33892e24811affc6c81a15a475c"
format_stamp: "Formatted at 2026-08-11 00:58:15 on dist-test-slave-h3ft"
server_key: "42af9eea768a2f09b5cd1a140b153005"
server_key_iv: "6e83331b7a1ddbfe691a8b13fcbb4c0e"
server_key_version: "encryptionkey@0"
I20260811 00:58:15.213443 6214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance:
uuid: "5d4bc33892e24811affc6c81a15a475c"
format_stamp: "Formatted at 2026-08-11 00:58:15 on dist-test-slave-h3ft"
server_key: "42af9eea768a2f09b5cd1a140b153005"
server_key_iv: "6e83331b7a1ddbfe691a8b13fcbb4c0e"
server_key_version: "encryptionkey@0"
I20260811 00:58:15.215255 6214 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260811 00:58:15.216392 6236 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:15.216629 6214 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:58:15.216765 6214 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/wal
uuid: "5d4bc33892e24811affc6c81a15a475c"
format_stamp: "Formatted at 2026-08-11 00:58:15 on dist-test-slave-h3ft"
server_key: "42af9eea768a2f09b5cd1a140b153005"
server_key_iv: "6e83331b7a1ddbfe691a8b13fcbb4c0e"
server_key_version: "encryptionkey@0"
I20260811 00:58:15.216919 6214 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:58:15.230379 6214 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:58:15.233314 6214 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:58:15.233518 6214 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:58:15.233820 6214 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:58:15.234225 6214 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:58:15.234285 6214 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:15.234335 6214 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:58:15.234365 6214 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:15.242326 6214 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.1:37201
I20260811 00:58:15.242375 6416 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.1:37201 every 8 connection(s)
I20260811 00:58:15.242810 6214 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
I20260811 00:58:15.250586 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 6214
I20260811 00:58:15.250701 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance
I20260811 00:58:15.250952 15640 external_mini_cluster.cc:1428] Setting key 6885b4c05ca005239fe7303e213f1a2f
Aug 11 00:58:15 dist-test-slave-h3ft krb5kdc[6036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409895, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:58:15.255419 6182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:15.243896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:41021 (local address 127.15.70.62:46183)
0811 00:58:15.243979 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:15.243982 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:15.244299 (+ 317us) server_negotiation.cc:407] Connection header received
0811 00:58:15.244960 (+ 661us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:15.244963 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:15.244983 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:15.245052 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:15.246301 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:15.247164 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:15.248479 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:15.248716 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:15.248798 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:15.251770 (+ 2972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:15.251772 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:15.251773 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:15.251807 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:15.253699 (+ 1892us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:15.254188 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:15.254190 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:15.254191 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:15.254265 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:15.254559 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:15.254560 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:15.254561 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:15.254699 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:15.254775 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:15.255156 (+ 381us) server_negotiation.cc:299] Negotiation successful
0811 00:58:15.255310 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 00:58:15.255640 6421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:15.243815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.1:41021)
0811 00:58:15.244077 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:15.244129 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:15.244774 (+ 645us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:15.245145 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:15.245150 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:15.245897 (+ 747us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:58:15.246161 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:15.246167 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:15.247264 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:15.247264 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:15.248365 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:15.248369 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:15.248814 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:15.248815 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:15.248933 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:15.249659 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:58:15.249670 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:58:15.251641 (+ 1971us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:58:15.253795 (+ 2154us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:15.253805 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:15.253808 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:15.254098 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:15.254340 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:15.254341 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:15.254341 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:15.254479 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:15.254774 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:58:15.254784 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:58:15.254962 (+ 178us) client_negotiation.cc:769] Sending connection context
0811 00:58:15.255130 (+ 168us) client_negotiation.cc:240] Negotiation successful
0811 00:58:15.255347 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":90,"threads_started":1}
I20260811 00:58:15.256322 6417 heartbeater.cc:347] Connected to a master server at 127.15.70.62:46183
I20260811 00:58:15.256464 6417 heartbeater.cc:464] Registering TS with master...
I20260811 00:58:15.256716 6417 heartbeater.cc:511] Master 127.15.70.62:46183 requested a full tablet report, sending...
I20260811 00:58:15.257436 6121 ts_manager.cc:194] Registered new tserver with Master: 5d4bc33892e24811affc6c81a15a475c (127.15.70.1:37201)
I20260811 00:58:15.258558 6121 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.1@KRBTEST.COM'} at 127.15.70.1:41021
WARNING: no policy specified for kudu/127.15.70.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab.
Entry for principal kudu/127.15.70.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab.
I20260811 00:58:15.287189 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.2:0
--local_ip_for_outbound_sockets=127.15.70.2
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:46183
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:39343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:58:15.386667 6427 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:58:15.386924 6427 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:58:15.386952 6427 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:58:15.388305 6427 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:58:15.388360 6427 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:58:15.388396 6427 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.2
I20260811 00:58:15.389993 6427 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:39343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:46183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6427
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.2
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:58:15.390249 6427 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:58:15.390496 6427 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:58:15.396623 6437 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:15.396615 6434 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:15.396615 6433 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:58:15.396981 6427 server_base.cc:1034] running on GCE node
I20260811 00:58:15.397245 6427 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:58:15.397607 6427 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:58:15.398790 6427 hybrid_clock.cc:648] HybridClock initialized: now 1786409895398765 us; error 39 us; skew 500 ppm
Aug 11 00:58:15 dist-test-slave-h3ft krb5kdc[6036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409895, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:58:15.402166 6427 init.cc:377] Logged in from keytab as kudu/127.15.70.2@KRBTEST.COM (short username kudu)
I20260811 00:58:15.402751 6427 webserver.cc:460] Webserver started at http://127.15.70.2:33217/ using document root <none> and password file <none>
I20260811 00:58:15.403090 6427 fs_manager.cc:359] Metadata directory not provided
I20260811 00:58:15.403144 6427 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:58:15.403261 6427 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:58:15.404489 6427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/data/instance:
uuid: "fcece0cc2eb743b9938498213589d5ea"
format_stamp: "Formatted at 2026-08-11 00:58:15 on dist-test-slave-h3ft"
server_key: "ef1a1cfdddf9bd5a9178cbc90ee9c5c9"
server_key_iv: "a07a848d6724745b3f2ca00544a05741"
server_key_version: "encryptionkey@0"
I20260811 00:58:15.404933 6427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance:
uuid: "fcece0cc2eb743b9938498213589d5ea"
format_stamp: "Formatted at 2026-08-11 00:58:15 on dist-test-slave-h3ft"
server_key: "ef1a1cfdddf9bd5a9178cbc90ee9c5c9"
server_key_iv: "a07a848d6724745b3f2ca00544a05741"
server_key_version: "encryptionkey@0"
I20260811 00:58:15.406622 6427 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 00:58:15.407734 6448 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:15.408007 6427 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 00:58:15.408146 6427 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/wal
uuid: "fcece0cc2eb743b9938498213589d5ea"
format_stamp: "Formatted at 2026-08-11 00:58:15 on dist-test-slave-h3ft"
server_key: "ef1a1cfdddf9bd5a9178cbc90ee9c5c9"
server_key_iv: "a07a848d6724745b3f2ca00544a05741"
server_key_version: "encryptionkey@0"
I20260811 00:58:15.408242 6427 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:58:15.427349 6427 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:58:15.430157 6427 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:58:15.430401 6427 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:58:15.430742 6427 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:58:15.431241 6427 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:58:15.431309 6427 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:15.431360 6427 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:58:15.431408 6427 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:15.439925 6427 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.2:32805
I20260811 00:58:15.440047 6623 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.2:32805 every 8 connection(s)
I20260811 00:58:15.440498 6427 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
I20260811 00:58:15.445612 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 6427
I20260811 00:58:15.445775 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance
I20260811 00:58:15.445982 15640 external_mini_cluster.cc:1428] Setting key c53036d7f7d39770bb52e1e324c3efe3
Aug 11 00:58:15 dist-test-slave-h3ft krb5kdc[6036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409895, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:58:15.453397 6182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:15.441586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:37027 (local address 127.15.70.62:46183)
0811 00:58:15.441670 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:15.441675 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:15.441882 (+ 207us) server_negotiation.cc:407] Connection header received
0811 00:58:15.442499 (+ 617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:15.442500 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:15.442513 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:15.442606 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:15.443801 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:15.444361 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:15.445621 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:15.445943 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:15.446049 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:15.449407 (+ 3358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:15.449410 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:15.449411 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:15.449421 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:15.451447 (+ 2026us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:15.452007 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:15.452008 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:15.452009 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:15.452088 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:15.452453 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:15.452454 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:15.452455 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:15.452656 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:15.452745 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:15.453132 (+ 387us) server_negotiation.cc:299] Negotiation successful
0811 00:58:15.453248 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 00:58:15.453826 6627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:15.441516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.2:37027)
0811 00:58:15.441711 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:15.441764 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:15.442390 (+ 626us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:15.442686 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:15.442690 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:15.443430 (+ 740us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:58:15.443690 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:15.443697 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:15.444505 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:15.444507 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:15.445460 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:15.445464 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:15.446060 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:15.446062 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:15.446251 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:15.447115 (+ 864us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:58:15.447129 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:58:15.449251 (+ 2122us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:58:15.451568 (+ 2317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:15.451576 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:15.451579 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:15.451906 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:15.452202 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:15.452203 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:15.452203 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:15.452361 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:15.452777 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:58:15.452783 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:58:15.452961 (+ 178us) client_negotiation.cc:769] Sending connection context
0811 00:58:15.453074 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 00:58:15.453268 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":105,"threads_started":1}
I20260811 00:58:15.454641 6624 heartbeater.cc:347] Connected to a master server at 127.15.70.62:46183
I20260811 00:58:15.454769 6624 heartbeater.cc:464] Registering TS with master...
I20260811 00:58:15.455049 6624 heartbeater.cc:511] Master 127.15.70.62:46183 requested a full tablet report, sending...
I20260811 00:58:15.455587 6121 ts_manager.cc:194] Registered new tserver with Master: fcece0cc2eb743b9938498213589d5ea (127.15.70.2:32805)
I20260811 00:58:15.456079 6121 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.2@KRBTEST.COM'} at 127.15.70.2:37027
WARNING: no policy specified for kudu/127.15.70.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab.
Entry for principal kudu/127.15.70.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab.
I20260811 00:58:15.482731 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.3:0
--local_ip_for_outbound_sockets=127.15.70.3
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:46183
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:39343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:58:15.591804 6630 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:58:15.592149 6630 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:58:15.592202 6630 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:58:15.593653 6630 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:58:15.593739 6630 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:58:15.593796 6630 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.3
I20260811 00:58:15.595691 6630 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:39343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:46183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6630
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.3
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:58:15.596081 6630 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:58:15.596398 6630 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:58:15.603376 6640 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:15.603371 6636 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:15.603376 6637 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:58:15.603734 6630 server_base.cc:1034] running on GCE node
I20260811 00:58:15.603991 6630 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:58:15.604296 6630 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:58:15.605496 6630 hybrid_clock.cc:648] HybridClock initialized: now 1786409895605471 us; error 63 us; skew 500 ppm
Aug 11 00:58:15 dist-test-slave-h3ft krb5kdc[6036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409895, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:58:15.608688 6630 init.cc:377] Logged in from keytab as kudu/127.15.70.3@KRBTEST.COM (short username kudu)
I20260811 00:58:15.609264 6630 webserver.cc:460] Webserver started at http://127.15.70.3:41339/ using document root <none> and password file <none>
I20260811 00:58:15.609556 6630 fs_manager.cc:359] Metadata directory not provided
I20260811 00:58:15.609632 6630 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:58:15.609804 6630 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:58:15.611141 6630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/data/instance:
uuid: "5fc653f496e946b19a0c51b54534498b"
format_stamp: "Formatted at 2026-08-11 00:58:15 on dist-test-slave-h3ft"
server_key: "6111d7ce715deb85ac0212bbdaa30137"
server_key_iv: "1fce408e1217bf3f44c14a68b096385f"
server_key_version: "encryptionkey@0"
I20260811 00:58:15.611547 6630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance:
uuid: "5fc653f496e946b19a0c51b54534498b"
format_stamp: "Formatted at 2026-08-11 00:58:15 on dist-test-slave-h3ft"
server_key: "6111d7ce715deb85ac0212bbdaa30137"
server_key_iv: "1fce408e1217bf3f44c14a68b096385f"
server_key_version: "encryptionkey@0"
I20260811 00:58:15.613229 6630 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 00:58:15.614212 6652 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:15.614511 6630 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:58:15.614639 6630 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/wal
uuid: "5fc653f496e946b19a0c51b54534498b"
format_stamp: "Formatted at 2026-08-11 00:58:15 on dist-test-slave-h3ft"
server_key: "6111d7ce715deb85ac0212bbdaa30137"
server_key_iv: "1fce408e1217bf3f44c14a68b096385f"
server_key_version: "encryptionkey@0"
I20260811 00:58:15.614720 6630 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:58:15.636475 6630 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:58:15.638867 6630 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:58:15.639077 6630 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:58:15.639381 6630 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:58:15.639755 6630 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:58:15.639814 6630 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:15.639860 6630 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:58:15.639904 6630 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:15.647492 6630 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.3:35423
I20260811 00:58:15.647578 6816 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.3:35423 every 8 connection(s)
I20260811 00:58:15.648011 6630 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
I20260811 00:58:15.651302 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 6630
I20260811 00:58:15.651422 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance
I20260811 00:58:15.651607 15640 external_mini_cluster.cc:1428] Setting key 4b3bfde45b77c1af86283891f0892b1d
Aug 11 00:58:15 dist-test-slave-h3ft krb5kdc[6036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409895, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:58:15.660272 6182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:15.649022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:48959 (local address 127.15.70.62:46183)
0811 00:58:15.649142 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:15.649146 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:15.649389 (+ 243us) server_negotiation.cc:407] Connection header received
0811 00:58:15.649937 (+ 548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:15.649940 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:15.649955 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:15.650058 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:15.651338 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:15.652118 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:15.653432 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:15.653666 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:15.653750 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:15.656750 (+ 3000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:15.656752 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:15.656752 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:15.656763 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:15.658411 (+ 1648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:15.659046 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:15.659048 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:15.659048 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:15.659128 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:15.659465 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:15.659466 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:15.659467 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:15.659622 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:15.659703 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:15.660047 (+ 344us) server_negotiation.cc:299] Negotiation successful
0811 00:58:15.660153 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 00:58:15.660564 6821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:15.649024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.3:48959)
0811 00:58:15.649211 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:15.649259 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:15.649796 (+ 537us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:15.650143 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:15.650147 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:15.650843 (+ 696us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:58:15.651174 (+ 331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:15.651181 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:15.652271 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:15.652272 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:15.653325 (+ 1053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:15.653328 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:15.653822 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:15.653823 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:15.653972 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:15.654647 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:58:15.654656 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:58:15.656606 (+ 1950us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:58:15.658547 (+ 1941us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:15.658562 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:15.658566 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:15.658875 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:15.659204 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:15.659205 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:15.659205 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:15.659355 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:15.659706 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:58:15.659715 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:58:15.659893 (+ 178us) client_negotiation.cc:769] Sending connection context
0811 00:58:15.660022 (+ 129us) client_negotiation.cc:240] Negotiation successful
0811 00:58:15.660235 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":105,"threads_started":1}
I20260811 00:58:15.661362 6817 heartbeater.cc:347] Connected to a master server at 127.15.70.62:46183
I20260811 00:58:15.661497 6817 heartbeater.cc:464] Registering TS with master...
I20260811 00:58:15.661751 6817 heartbeater.cc:511] Master 127.15.70.62:46183 requested a full tablet report, sending...
I20260811 00:58:15.662390 6121 ts_manager.cc:194] Registered new tserver with Master: 5fc653f496e946b19a0c51b54534498b (127.15.70.3:35423)
I20260811 00:58:15.662907 6121 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.3@KRBTEST.COM'} at 127.15.70.3:48959
I20260811 00:58:15.664237 15640 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 00:58:15.673555 6182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:15.666033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44020 (local address 127.15.70.62:46183)
0811 00:58:15.666132 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:15.666134 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:15.666169 (+ 35us) server_negotiation.cc:407] Connection header received
0811 00:58:15.666220 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:15.666221 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:15.666240 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:15.666305 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:15.667254 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:15.667827 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:15.668749 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:15.668967 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:15.669054 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:15.670522 (+ 1468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:15.670524 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:15.670524 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:15.670532 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:15.672213 (+ 1681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:15.672620 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:15.672621 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:15.672622 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:15.672683 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:15.672894 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:15.672895 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:15.672895 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:15.673081 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:15.673194 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:15.673342 (+ 148us) server_negotiation.cc:299] Negotiation successful
0811 00:58:15.673430 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 00:58:15.675719 6121 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44020:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:58:15.677819 6121 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:58:15.685909 6835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:15.681253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:35423 (local address 127.0.0.1:44696)
0811 00:58:15.681537 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:15.681587 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:15.681667 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:15.682383 (+ 716us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:15.682384 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:15.682386 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:58:15.682472 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:15.682475 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:15.683658 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:15.683659 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:15.684671 (+ 1012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:15.684674 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:15.685518 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:15.685520 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:15.685621 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:15.685638 (+ 17us) client_negotiation.cc:769] Sending connection context
0811 00:58:15.685726 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 00:58:15.685807 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238,"mutex_wait_us":75,"thread_start_us":78,"threads_started":1}
I20260811 00:58:15.685921 6844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:15.681932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44696 (local address 127.15.70.3:35423)
0811 00:58:15.682142 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:15.682149 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:15.682164 (+ 15us) server_negotiation.cc:407] Connection header received
0811 00:58:15.682219 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:15.682222 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:15.682242 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:15.682560 (+ 318us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:58:15.682649 (+ 89us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:15.683529 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:15.684785 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:15.685421 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:15.685516 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:15.685648 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:15.685744 (+ 96us) server_negotiation.cc:299] Negotiation successful
0811 00:58:15.685798 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":113,"threads_started":1}
I20260811 00:58:15.686376 6840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:15.681254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.2:32805 (local address 127.0.0.1:34098)
0811 00:58:15.681537 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:15.681587 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:15.681667 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:15.682093 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:15.682096 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:15.682099 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:58:15.682196 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:15.682199 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:15.683577 (+ 1378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:15.683578 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:15.684957 (+ 1379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:15.684960 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:15.686007 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:15.686009 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:15.686104 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:15.686111 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 00:58:15.686162 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 00:58:15.686217 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"mutex_wait_us":4,"thread_start_us":157,"threads_started":1}
I20260811 00:58:15.686937 6841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:15.681638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34098 (local address 127.15.70.2:32805)
0811 00:58:15.681896 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:15.681903 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:15.681917 (+ 14us) server_negotiation.cc:407] Connection header received
0811 00:58:15.681961 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:15.681963 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:15.681980 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:15.682086 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:58:15.682293 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:15.683445 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:15.685069 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:15.685913 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:15.686543 (+ 630us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:15.686626 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:15.686762 (+ 136us) server_negotiation.cc:299] Negotiation successful
0811 00:58:15.686829 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":129,"threads_started":1}
I20260811 00:58:15.687390 6723 tablet_service.cc:1467] Processing CreateTablet for tablet ee85f6f0f29f41368965796b8274b517 (DEFAULT_TABLE table=test-table [id=e1ee752f355a4d36b3fab586e597a578]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:58:15.687768 6834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:15.681253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:37201 (local address 127.0.0.1:37836)
0811 00:58:15.682291 (+ 1038us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:15.682305 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:15.682369 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:15.682737 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:15.682738 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:15.682740 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:58:15.682791 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:15.682792 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:15.684582 (+ 1790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:15.684583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:15.685735 (+ 1152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:15.685738 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:15.687470 (+ 1732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:15.687471 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:15.687547 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:15.687553 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 00:58:15.687626 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 00:58:15.687686 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1012,"mutex_wait_us":38,"thread_start_us":173,"threads_started":1}
I20260811 00:58:15.687949 6723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee85f6f0f29f41368965796b8274b517. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:58:15.687996 6842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:15.681670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37836 (local address 127.15.70.1:37201)
0811 00:58:15.681919 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:15.681925 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:15.682464 (+ 539us) server_negotiation.cc:407] Connection header received
0811 00:58:15.682525 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:15.682527 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:15.682545 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:15.682628 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:58:15.682908 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:15.684095 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:15.685844 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:15.687355 (+ 1511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:15.687425 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:15.687463 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:15.687676 (+ 213us) server_negotiation.cc:299] Negotiation successful
0811 00:58:15.687727 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":132,"threads_started":1}
I20260811 00:58:15.688975 6316 tablet_service.cc:1467] Processing CreateTablet for tablet ee85f6f0f29f41368965796b8274b517 (DEFAULT_TABLE table=test-table [id=e1ee752f355a4d36b3fab586e597a578]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:58:15.689435 6316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee85f6f0f29f41368965796b8274b517. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:58:15.691932 6846 tablet_bootstrap.cc:492] T ee85f6f0f29f41368965796b8274b517 P 5fc653f496e946b19a0c51b54534498b: Bootstrap starting.
I20260811 00:58:15.692551 6532 tablet_service.cc:1467] Processing CreateTablet for tablet ee85f6f0f29f41368965796b8274b517 (DEFAULT_TABLE table=test-table [id=e1ee752f355a4d36b3fab586e597a578]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:58:15.692996 6532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee85f6f0f29f41368965796b8274b517. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:58:15.693040 6846 tablet_bootstrap.cc:654] T ee85f6f0f29f41368965796b8274b517 P 5fc653f496e946b19a0c51b54534498b: Neither blocks nor log segments found. Creating new log.
I20260811 00:58:15.693240 6848 tablet_bootstrap.cc:492] T ee85f6f0f29f41368965796b8274b517 P 5d4bc33892e24811affc6c81a15a475c: Bootstrap starting.
I20260811 00:58:15.694121 6848 tablet_bootstrap.cc:654] T ee85f6f0f29f41368965796b8274b517 P 5d4bc33892e24811affc6c81a15a475c: Neither blocks nor log segments found. Creating new log.
I20260811 00:58:15.694856 6848 log.cc:824] T ee85f6f0f29f41368965796b8274b517 P 5d4bc33892e24811affc6c81a15a475c: Log is configured to *not* fsync() on all Append() calls
I20260811 00:58:15.695120 6846 log.cc:824] T ee85f6f0f29f41368965796b8274b517 P 5fc653f496e946b19a0c51b54534498b: Log is configured to *not* fsync() on all Append() calls
I20260811 00:58:15.695966 6848 tablet_bootstrap.cc:492] T ee85f6f0f29f41368965796b8274b517 P 5d4bc33892e24811affc6c81a15a475c: No bootstrap required, opened a new log
I20260811 00:58:15.696076 6848 ts_tablet_manager.cc:1397] T ee85f6f0f29f41368965796b8274b517 P 5d4bc33892e24811affc6c81a15a475c: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260811 00:58:15.697299 6854 tablet_bootstrap.cc:492] T ee85f6f0f29f41368965796b8274b517 P fcece0cc2eb743b9938498213589d5ea: Bootstrap starting.
I20260811 00:58:15.697808 6848 raft_consensus.cc:348] T ee85f6f0f29f41368965796b8274b517 P 5d4bc33892e24811affc6c81a15a475c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcece0cc2eb743b9938498213589d5ea" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 32805 } } peers { permanent_uuid: "5d4bc33892e24811affc6c81a15a475c" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37201 } } peers { permanent_uuid: "5fc653f496e946b19a0c51b54534498b" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35423 } }
I20260811 00:58:15.698011 6848 raft_consensus.cc:374] T ee85f6f0f29f41368965796b8274b517 P 5d4bc33892e24811affc6c81a15a475c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:58:15.698047 6854 tablet_bootstrap.cc:654] T ee85f6f0f29f41368965796b8274b517 P fcece0cc2eb743b9938498213589d5ea: Neither blocks nor log segments found. Creating new log.
I20260811 00:58:15.698052 6848 raft_consensus.cc:729] T ee85f6f0f29f41368965796b8274b517 P 5d4bc33892e24811affc6c81a15a475c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d4bc33892e24811affc6c81a15a475c, State: Initialized, Role: FOLLOWER
I20260811 00:58:15.698204 6848 consensus_queue.cc:260] T ee85f6f0f29f41368965796b8274b517 P 5d4bc33892e24811affc6c81a15a475c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcece0cc2eb743b9938498213589d5ea" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 32805 } } peers { permanent_uuid: "5d4bc33892e24811affc6c81a15a475c" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37201 } } peers { permanent_uuid: "5fc653f496e946b19a0c51b54534498b" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35423 } }
I20260811 00:58:15.698599 6848 ts_tablet_manager.cc:1428] T ee85f6f0f29f41368965796b8274b517 P 5d4bc33892e24811affc6c81a15a475c: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260811 00:58:15.698645 6417 heartbeater.cc:503] Master 127.15.70.62:46183 was elected leader, sending a full tablet report...
I20260811 00:58:15.698755 6854 log.cc:824] T ee85f6f0f29f41368965796b8274b517 P fcece0cc2eb743b9938498213589d5ea: Log is configured to *not* fsync() on all Append() calls
I20260811 00:58:15.699211 6846 tablet_bootstrap.cc:492] T ee85f6f0f29f41368965796b8274b517 P 5fc653f496e946b19a0c51b54534498b: No bootstrap required, opened a new log
I20260811 00:58:15.699304 6846 ts_tablet_manager.cc:1397] T ee85f6f0f29f41368965796b8274b517 P 5fc653f496e946b19a0c51b54534498b: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.002s
I20260811 00:58:15.699630 6854 tablet_bootstrap.cc:492] T ee85f6f0f29f41368965796b8274b517 P fcece0cc2eb743b9938498213589d5ea: No bootstrap required, opened a new log
I20260811 00:58:15.699708 6854 ts_tablet_manager.cc:1397] T ee85f6f0f29f41368965796b8274b517 P fcece0cc2eb743b9938498213589d5ea: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 00:58:15.701355 6846 raft_consensus.cc:348] T ee85f6f0f29f41368965796b8274b517 P 5fc653f496e946b19a0c51b54534498b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcece0cc2eb743b9938498213589d5ea" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 32805 } } peers { permanent_uuid: "5d4bc33892e24811affc6c81a15a475c" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37201 } } peers { permanent_uuid: "5fc653f496e946b19a0c51b54534498b" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35423 } }
I20260811 00:58:15.701508 6846 raft_consensus.cc:374] T ee85f6f0f29f41368965796b8274b517 P 5fc653f496e946b19a0c51b54534498b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:58:15.701532 6846 raft_consensus.cc:729] T ee85f6f0f29f41368965796b8274b517 P 5fc653f496e946b19a0c51b54534498b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fc653f496e946b19a0c51b54534498b, State: Initialized, Role: FOLLOWER
I20260811 00:58:15.701684 6846 consensus_queue.cc:260] T ee85f6f0f29f41368965796b8274b517 P 5fc653f496e946b19a0c51b54534498b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcece0cc2eb743b9938498213589d5ea" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 32805 } } peers { permanent_uuid: "5d4bc33892e24811affc6c81a15a475c" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37201 } } peers { permanent_uuid: "5fc653f496e946b19a0c51b54534498b" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35423 } }
I20260811 00:58:15.701575 6854 raft_consensus.cc:348] T ee85f6f0f29f41368965796b8274b517 P fcece0cc2eb743b9938498213589d5ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcece0cc2eb743b9938498213589d5ea" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 32805 } } peers { permanent_uuid: "5d4bc33892e24811affc6c81a15a475c" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37201 } } peers { permanent_uuid: "5fc653f496e946b19a0c51b54534498b" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35423 } }
I20260811 00:58:15.701833 6854 raft_consensus.cc:374] T ee85f6f0f29f41368965796b8274b517 P fcece0cc2eb743b9938498213589d5ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:58:15.701884 6854 raft_consensus.cc:729] T ee85f6f0f29f41368965796b8274b517 P fcece0cc2eb743b9938498213589d5ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcece0cc2eb743b9938498213589d5ea, State: Initialized, Role: FOLLOWER
I20260811 00:58:15.702024 6854 consensus_queue.cc:260] T ee85f6f0f29f41368965796b8274b517 P fcece0cc2eb743b9938498213589d5ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcece0cc2eb743b9938498213589d5ea" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 32805 } } peers { permanent_uuid: "5d4bc33892e24811affc6c81a15a475c" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37201 } } peers { permanent_uuid: "5fc653f496e946b19a0c51b54534498b" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35423 } }
I20260811 00:58:15.702059 6846 ts_tablet_manager.cc:1428] T ee85f6f0f29f41368965796b8274b517 P 5fc653f496e946b19a0c51b54534498b: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260811 00:58:15.702117 6817 heartbeater.cc:503] Master 127.15.70.62:46183 was elected leader, sending a full tablet report...
I20260811 00:58:15.702386 6854 ts_tablet_manager.cc:1428] T ee85f6f0f29f41368965796b8274b517 P fcece0cc2eb743b9938498213589d5ea: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 00:58:15.702522 6624 heartbeater.cc:503] Master 127.15.70.62:46183 was elected leader, sending a full tablet report...
W20260811 00:58:15.743872 6420 tablet.cc:2369] T ee85f6f0f29f41368965796b8274b517 P 5d4bc33892e24811affc6c81a15a475c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 00:58:15.898766 6819 tablet.cc:2369] T ee85f6f0f29f41368965796b8274b517 P 5fc653f496e946b19a0c51b54534498b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 00:58:15.941514 6625 tablet.cc:2369] T ee85f6f0f29f41368965796b8274b517 P fcece0cc2eb743b9938498213589d5ea: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 00:58:15.951435 6858 raft_consensus.cc:482] T ee85f6f0f29f41368965796b8274b517 P fcece0cc2eb743b9938498213589d5ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:58:15.951601 6858 raft_consensus.cc:504] T ee85f6f0f29f41368965796b8274b517 P fcece0cc2eb743b9938498213589d5ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcece0cc2eb743b9938498213589d5ea" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 32805 } } peers { permanent_uuid: "5d4bc33892e24811affc6c81a15a475c" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37201 } } peers { permanent_uuid: "5fc653f496e946b19a0c51b54534498b" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35423 } }
I20260811 00:58:15.952020 6858 leader_election.cc:288] T ee85f6f0f29f41368965796b8274b517 P fcece0cc2eb743b9938498213589d5ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d4bc33892e24811affc6c81a15a475c (127.15.70.1:37201), 5fc653f496e946b19a0c51b54534498b (127.15.70.3:35423)
I20260811 00:58:15.955809 6844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:15.952568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:49971 (local address 127.15.70.3:35423)
0811 00:58:15.952662 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:15.952664 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:15.952722 (+ 58us) server_negotiation.cc:407] Connection header received
0811 00:58:15.952850 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:15.952851 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:15.952866 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:15.952961 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:58:15.953167 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:15.953713 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:15.954820 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:15.955359 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:15.955454 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:15.955468 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:15.955676 (+ 208us) server_negotiation.cc:299] Negotiation successful
0811 00:58:15.955718 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 00:58:15.955809 6627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:15.952407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:35423 (local address 127.15.70.2:49971)
0811 00:58:15.952521 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:15.952542 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:15.952752 (+ 210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:15.952969 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:15.952971 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:15.952973 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:58:15.953064 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:15.953067 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:15.953809 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:15.953810 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:15.954712 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:15.954714 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:15.955453 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:15.955454 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:15.955570 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:15.955574 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:58:15.955660 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 00:58:15.955717 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":78,"mutex_wait_us":1}
I20260811 00:58:15.956043 6842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:15.952521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:35239 (local address 127.15.70.1:37201)
0811 00:58:15.952639 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:15.952642 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:15.952968 (+ 326us) server_negotiation.cc:407] Connection header received
0811 00:58:15.953071 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:15.953073 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:15.953098 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:15.953179 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:58:15.953394 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:15.953985 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:15.955152 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:15.955600 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:15.955696 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:15.955713 (+ 17us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:15.955901 (+ 188us) server_negotiation.cc:299] Negotiation successful
0811 00:58:15.955952 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 00:58:15.956058 6859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:15.952407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:37201 (local address 127.15.70.2:35239)
0811 00:58:15.952812 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:15.952835 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:15.952987 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:15.953184 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:15.953185 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:15.953187 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:58:15.953308 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:15.953310 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:15.954102 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:15.954104 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:15.954995 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:15.955070 (+ 75us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:15.955715 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:15.955717 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:15.955807 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:15.955812 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 00:58:15.955887 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 00:58:15.955939 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":385,"mutex_wait_us":198,"thread_start_us":146,"threads_started":1}
I20260811 00:58:15.956282 6750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee85f6f0f29f41368965796b8274b517" candidate_uuid: "fcece0cc2eb743b9938498213589d5ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fc653f496e946b19a0c51b54534498b" is_pre_election: true
I20260811 00:58:15.956482 6750 raft_consensus.cc:2454] T ee85f6f0f29f41368965796b8274b517 P 5fc653f496e946b19a0c51b54534498b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcece0cc2eb743b9938498213589d5ea in term 0.
I20260811 00:58:15.956548 6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee85f6f0f29f41368965796b8274b517" candidate_uuid: "fcece0cc2eb743b9938498213589d5ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d4bc33892e24811affc6c81a15a475c" is_pre_election: true
I20260811 00:58:15.956774 6344 raft_consensus.cc:2454] T ee85f6f0f29f41368965796b8274b517 P 5d4bc33892e24811affc6c81a15a475c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcece0cc2eb743b9938498213589d5ea in term 0.
I20260811 00:58:15.956823 6450 leader_election.cc:302] T ee85f6f0f29f41368965796b8274b517 P fcece0cc2eb743b9938498213589d5ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5fc653f496e946b19a0c51b54534498b, fcece0cc2eb743b9938498213589d5ea; no voters:
I20260811 00:58:15.956969 6858 raft_consensus.cc:2781] T ee85f6f0f29f41368965796b8274b517 P fcece0cc2eb743b9938498213589d5ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:58:15.957060 6858 raft_consensus.cc:482] T ee85f6f0f29f41368965796b8274b517 P fcece0cc2eb743b9938498213589d5ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:58:15.957091 6858 raft_consensus.cc:3037] T ee85f6f0f29f41368965796b8274b517 P fcece0cc2eb743b9938498213589d5ea [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:58:15.957998 6858 raft_consensus.cc:504] T ee85f6f0f29f41368965796b8274b517 P fcece0cc2eb743b9938498213589d5ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcece0cc2eb743b9938498213589d5ea" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 32805 } } peers { permanent_uuid: "5d4bc33892e24811affc6c81a15a475c" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37201 } } peers { permanent_uuid: "5fc653f496e946b19a0c51b54534498b" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35423 } }
I20260811 00:58:15.958194 6858 leader_election.cc:288] T ee85f6f0f29f41368965796b8274b517 P fcece0cc2eb743b9938498213589d5ea [CANDIDATE]: Term 1 election: Requested vote from peers 5d4bc33892e24811affc6c81a15a475c (127.15.70.1:37201), 5fc653f496e946b19a0c51b54534498b (127.15.70.3:35423)
I20260811 00:58:15.958485 6344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee85f6f0f29f41368965796b8274b517" candidate_uuid: "fcece0cc2eb743b9938498213589d5ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d4bc33892e24811affc6c81a15a475c"
I20260811 00:58:15.958492 6750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee85f6f0f29f41368965796b8274b517" candidate_uuid: "fcece0cc2eb743b9938498213589d5ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fc653f496e946b19a0c51b54534498b"
I20260811 00:58:15.958617 6344 raft_consensus.cc:3037] T ee85f6f0f29f41368965796b8274b517 P 5d4bc33892e24811affc6c81a15a475c [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:58:15.958618 6750 raft_consensus.cc:3037] T ee85f6f0f29f41368965796b8274b517 P 5fc653f496e946b19a0c51b54534498b [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:58:15.959982 6344 raft_consensus.cc:2454] T ee85f6f0f29f41368965796b8274b517 P 5d4bc33892e24811affc6c81a15a475c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcece0cc2eb743b9938498213589d5ea in term 1.
I20260811 00:58:15.959982 6750 raft_consensus.cc:2454] T ee85f6f0f29f41368965796b8274b517 P 5fc653f496e946b19a0c51b54534498b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcece0cc2eb743b9938498213589d5ea in term 1.
I20260811 00:58:15.960240 6457 leader_election.cc:302] T ee85f6f0f29f41368965796b8274b517 P fcece0cc2eb743b9938498213589d5ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d4bc33892e24811affc6c81a15a475c, fcece0cc2eb743b9938498213589d5ea; no voters:
I20260811 00:58:15.960400 6858 raft_consensus.cc:2781] T ee85f6f0f29f41368965796b8274b517 P fcece0cc2eb743b9938498213589d5ea [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:58:15.960671 6858 raft_consensus.cc:686] T ee85f6f0f29f41368965796b8274b517 P fcece0cc2eb743b9938498213589d5ea [term 1 LEADER]: Becoming Leader. State: Replica: fcece0cc2eb743b9938498213589d5ea, State: Running, Role: LEADER
I20260811 00:58:15.960796 6858 consensus_queue.cc:237] T ee85f6f0f29f41368965796b8274b517 P fcece0cc2eb743b9938498213589d5ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcece0cc2eb743b9938498213589d5ea" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 32805 } } peers { permanent_uuid: "5d4bc33892e24811affc6c81a15a475c" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37201 } } peers { permanent_uuid: "5fc653f496e946b19a0c51b54534498b" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35423 } }
I20260811 00:58:15.961939 6121 catalog_manager.cc:5495] T ee85f6f0f29f41368965796b8274b517 P fcece0cc2eb743b9938498213589d5ea reported cstate change: term changed from 0 to 1, leader changed from <none> to fcece0cc2eb743b9938498213589d5ea (127.15.70.2). New cstate: current_term: 1 leader_uuid: "fcece0cc2eb743b9938498213589d5ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcece0cc2eb743b9938498213589d5ea" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 32805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d4bc33892e24811affc6c81a15a475c" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5fc653f496e946b19a0c51b54534498b" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35423 } health_report { overall_health: UNKNOWN } } }
I20260811 00:58:15.975668 6841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:15.972655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34110 (local address 127.15.70.2:32805)
0811 00:58:15.972745 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:15.972747 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:15.972759 (+ 12us) server_negotiation.cc:407] Connection header received
0811 00:58:15.972849 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:15.972850 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:15.972874 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:15.973004 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:58:15.973148 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:15.973710 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:15.974587 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:15.974804 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:15.974874 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:15.975213 (+ 339us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:58:15.975350 (+ 137us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:58:15.975441 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:15.975466 (+ 25us) server_negotiation.cc:299] Negotiation successful
0811 00:58:15.975489 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 00:58:15.978255 6750 raft_consensus.cc:1261] T ee85f6f0f29f41368965796b8274b517 P 5fc653f496e946b19a0c51b54534498b [term 1 FOLLOWER]: Refusing update from remote peer fcece0cc2eb743b9938498213589d5ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:58:15.978302 6344 raft_consensus.cc:1261] T ee85f6f0f29f41368965796b8274b517 P 5d4bc33892e24811affc6c81a15a475c [term 1 FOLLOWER]: Refusing update from remote peer fcece0cc2eb743b9938498213589d5ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:58:15.978771 6862 consensus_queue.cc:1035] T ee85f6f0f29f41368965796b8274b517 P fcece0cc2eb743b9938498213589d5ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fc653f496e946b19a0c51b54534498b" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:58:15.978920 6858 consensus_queue.cc:1035] T ee85f6f0f29f41368965796b8274b517 P fcece0cc2eb743b9938498213589d5ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d4bc33892e24811affc6c81a15a475c" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:58:15.982481 6867 mvcc.cc:205] Tried to move back new op lower bound from 7317134933922725888 to 7317134933856452608. Current Snapshot: MvccSnapshot[applied={T|T < 7317134933922725888}]
I20260811 00:58:15.983072 6868 mvcc.cc:205] Tried to move back new op lower bound from 7317134933922725888 to 7317134933856452608. Current Snapshot: MvccSnapshot[applied={T|T < 7317134933922725888}]
I20260811 00:58:15.983618 6870 mvcc.cc:205] Tried to move back new op lower bound from 7317134933922725888 to 7317134933856452608. Current Snapshot: MvccSnapshot[applied={T|T < 7317134933922725888 or (T in {7317134933922725888})}]
I20260811 00:58:15.985975 6120 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44020:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:58:15.986128 6120 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44020:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:58:15.987072 6120 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729: Sending DeleteTablet for 3 replicas of tablet ee85f6f0f29f41368965796b8274b517
I20260811 00:58:15.987455 6316 tablet_service.cc:1514] Processing DeleteTablet for tablet ee85f6f0f29f41368965796b8274b517 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:58:15 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:37836
I20260811 00:58:15.987459 6532 tablet_service.cc:1514] Processing DeleteTablet for tablet ee85f6f0f29f41368965796b8274b517 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:58:15 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:34098
I20260811 00:58:15.987496 6723 tablet_service.cc:1514] Processing DeleteTablet for tablet ee85f6f0f29f41368965796b8274b517 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:58:15 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:44696
I20260811 00:58:15.987730 6882 tablet_replica.cc:330] T ee85f6f0f29f41368965796b8274b517 P 5d4bc33892e24811affc6c81a15a475c: stopping tablet replica
I20260811 00:58:15.987808 6883 tablet_replica.cc:330] T ee85f6f0f29f41368965796b8274b517 P 5fc653f496e946b19a0c51b54534498b: stopping tablet replica
I20260811 00:58:15.987854 6882 raft_consensus.cc:2229] T ee85f6f0f29f41368965796b8274b517 P 5d4bc33892e24811affc6c81a15a475c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:58:15.987884 6883 raft_consensus.cc:2229] T ee85f6f0f29f41368965796b8274b517 P 5fc653f496e946b19a0c51b54534498b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:58:15.987941 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 6214
I20260811 00:58:15.987973 6883 raft_consensus.cc:2258] T ee85f6f0f29f41368965796b8274b517 P 5fc653f496e946b19a0c51b54534498b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:58:15.987974 6882 raft_consensus.cc:2258] T ee85f6f0f29f41368965796b8274b517 P 5d4bc33892e24811affc6c81a15a475c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:58:15.988473 6883 ts_tablet_manager.cc:1905] T ee85f6f0f29f41368965796b8274b517 P 5fc653f496e946b19a0c51b54534498b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:58:15.990448 6883 ts_tablet_manager.cc:1918] T ee85f6f0f29f41368965796b8274b517 P 5fc653f496e946b19a0c51b54534498b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:58:15.990511 6883 log.cc:1196] T ee85f6f0f29f41368965796b8274b517 P 5fc653f496e946b19a0c51b54534498b: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/wal/wals/ee85f6f0f29f41368965796b8274b517
I20260811 00:58:15.990754 6883 ts_tablet_manager.cc:1939] T ee85f6f0f29f41368965796b8274b517 P 5fc653f496e946b19a0c51b54534498b: Deleting consensus metadata
I20260811 00:58:15.991338 6094 catalog_manager.cc:4841] TS 5fc653f496e946b19a0c51b54534498b (127.15.70.3:35423): tablet ee85f6f0f29f41368965796b8274b517 (table test-table [id=e1ee752f355a4d36b3fab586e597a578]) successfully deleted
I20260811 00:58:16.002569 6885 tablet_replica.cc:330] T ee85f6f0f29f41368965796b8274b517 P fcece0cc2eb743b9938498213589d5ea: stopping tablet replica
I20260811 00:58:16.002699 6885 raft_consensus.cc:2229] T ee85f6f0f29f41368965796b8274b517 P fcece0cc2eb743b9938498213589d5ea [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:58:16.002831 6885 raft_consensus.cc:2258] T ee85f6f0f29f41368965796b8274b517 P fcece0cc2eb743b9938498213589d5ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:58:16.005084 6885 ts_tablet_manager.cc:1905] T ee85f6f0f29f41368965796b8274b517 P fcece0cc2eb743b9938498213589d5ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:58:16.007567 6885 ts_tablet_manager.cc:1918] T ee85f6f0f29f41368965796b8274b517 P fcece0cc2eb743b9938498213589d5ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:58:16.007665 6885 log.cc:1196] T ee85f6f0f29f41368965796b8274b517 P fcece0cc2eb743b9938498213589d5ea: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/wal/wals/ee85f6f0f29f41368965796b8274b517
I20260811 00:58:16.007961 6885 ts_tablet_manager.cc:1939] T ee85f6f0f29f41368965796b8274b517 P fcece0cc2eb743b9938498213589d5ea: Deleting consensus metadata
I20260811 00:58:16.008523 6099 catalog_manager.cc:4841] TS fcece0cc2eb743b9938498213589d5ea (127.15.70.2:32805): tablet ee85f6f0f29f41368965796b8274b517 (table test-table [id=e1ee752f355a4d36b3fab586e597a578]) successfully deleted
W20260811 00:58:16.017858 6096 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.70.1:37201 (error 108)
I20260811 00:58:16.018175 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 6427
I20260811 00:58:16.028946 6834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:16.028626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:37201 (local address 127.0.0.1:37838)
0811 00:58:16.028747 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:16.028853 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.1:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260811 00:58:16.029394 6096 catalog_manager.cc:4584] TS 5d4bc33892e24811affc6c81a15a475c (127.15.70.1:37201): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ee85f6f0f29f41368965796b8274b517: Network error: Client connection negotiation failed: client connection to 127.15.70.1:37201: connect: Connection refused (error 111)
I20260811 00:58:16.035909 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 6630
I20260811 00:58:16.051401 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 6062
I20260811 00:58:16.073556 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:46183
--webserver_interface=127.15.70.62
--webserver_port=37601
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:39343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:46183
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:58:16.165170 6888 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:58:16.165490 6888 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:58:16.165521 6888 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:58:16.166731 6888 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:58:16.166781 6888 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:58:16.166796 6888 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:58:16.166808 6888 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:58:16.166821 6888 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:58:16.168383 6888 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:39343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:46183
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:46183
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=37601
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6888
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:58:16.168737 6888 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:58:16.169016 6888 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:58:16.182228 6895 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:16.182164 6896 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:16.182192 6898 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:58:16.182261 6888 server_base.cc:1034] running on GCE node
I20260811 00:58:16.182911 6888 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:58:16.183306 6888 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:58:16.184480 6888 hybrid_clock.cc:648] HybridClock initialized: now 1786409896184448 us; error 61 us; skew 500 ppm
Aug 11 00:58:16 dist-test-slave-h3ft krb5kdc[6036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409896, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:58:16.187920 6888 init.cc:377] Logged in from keytab as kudu/127.15.70.62@KRBTEST.COM (short username kudu)
I20260811 00:58:16.188515 6888 webserver.cc:460] Webserver started at http://127.15.70.62:37601/ using document root <none> and password file <none>
I20260811 00:58:16.188829 6888 fs_manager.cc:359] Metadata directory not provided
I20260811 00:58:16.188925 6888 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:58:16.190493 6888 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:58:16.191473 6908 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:16.191756 6888 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:58:16.191886 6888 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "3b87d21591ba4a08b98dd450617ac729"
format_stamp: "Formatted at 2026-08-11 00:58:14 on dist-test-slave-h3ft"
server_key: "dfdaedecfe0500c9de6dde0676952a65"
server_key_iv: "03d47f0ab5724fa1e914fc46a23d9542"
server_key_version: "encryptionkey@0"
I20260811 00:58:16.192497 6888 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:58:16.205395 6888 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:58:16.208230 6888 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:58:16.208423 6888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:58:16.213896 6888 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:46183
I20260811 00:58:16.213961 6981 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:46183 every 8 connection(s)
I20260811 00:58:16.214500 6888 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:58:16.216773 6982 sys_catalog.cc:263] Verifying existing consensus state
I20260811 00:58:16.217598 6982 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729: Bootstrap starting.
I20260811 00:58:16.222324 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 6888
I20260811 00:58:16.222751 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.1:37201
--local_ip_for_outbound_sockets=127.15.70.1
--tserver_master_addrs=127.15.70.62:46183
--webserver_port=37383
--webserver_interface=127.15.70.1
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:39343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 00:58:16.228950 6982 log.cc:824] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729: Log is configured to *not* fsync() on all Append() calls
I20260811 00:58:16.231621 6982 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 00:58:16.232023 6982 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729: Bootstrap complete.
I20260811 00:58:16.234846 6982 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b87d21591ba4a08b98dd450617ac729" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 46183 } }
I20260811 00:58:16.235213 6982 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b87d21591ba4a08b98dd450617ac729, State: Initialized, Role: FOLLOWER
I20260811 00:58:16.235451 6982 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b87d21591ba4a08b98dd450617ac729" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 46183 } }
I20260811 00:58:16.235564 6982 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:58:16.235639 6982 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:58:16.235699 6982 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [term 1 FOLLOWER]: Advancing to term 2
I20260811 00:58:16.236856 6982 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b87d21591ba4a08b98dd450617ac729" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 46183 } }
I20260811 00:58:16.236991 6982 leader_election.cc:302] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3b87d21591ba4a08b98dd450617ac729; no voters:
I20260811 00:58:16.237236 6982 leader_election.cc:288] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 00:58:16.237279 6987 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 00:58:16.237411 6987 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [term 2 LEADER]: Becoming Leader. State: Replica: 3b87d21591ba4a08b98dd450617ac729, State: Running, Role: LEADER
I20260811 00:58:16.237537 6987 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b87d21591ba4a08b98dd450617ac729" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 46183 } }
I20260811 00:58:16.237567 6982 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:58:16.237923 6987 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3b87d21591ba4a08b98dd450617ac729. Latest consensus state: current_term: 2 leader_uuid: "3b87d21591ba4a08b98dd450617ac729" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b87d21591ba4a08b98dd450617ac729" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 46183 } } }
I20260811 00:58:16.238024 6987 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [sys.catalog]: This master's current role is: LEADER
I20260811 00:58:16.237934 6988 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "3b87d21591ba4a08b98dd450617ac729" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b87d21591ba4a08b98dd450617ac729" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 46183 } } }
I20260811 00:58:16.238118 6988 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [sys.catalog]: This master's current role is: LEADER
I20260811 00:58:16.239895 7015 catalog_manager.cc:1259] Loaded cluster ID: df22a5d80f1b4d08b3239a02d1ef2b43
I20260811 00:58:16.239976 7015 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729: loading cluster ID for follower catalog manager: success
W20260811 00:58:16.240223 7015 catalog_manager.cc:1576] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729: acquiring CA information for follower catalog manager: Runtime error: could not decrypt private key with the password returned by the configured command: unable to load data from memory: error reading private key: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D07803A:asn1 encoding routines:ASN1_ITEM_EX_D2I:nested asn1 error:tasn_dec.c:386:Type=X509_ALGOR error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=algor, Type=X509_SIG
W20260811 00:58:16.240279 7015 catalog_manager.cc:873] Runtime error: could not decrypt private key with the password returned by the configured command: unable to load data from memory: error reading private key: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D07803A:asn1 encoding routines:ASN1_ITEM_EX_D2I:nested asn1 error:tasn_dec.c:386:Type=X509_ALGOR error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=algor, Type=X509_SIG: failed to prepare follower catalog manager, will retry
I20260811 00:58:16.240320 6991 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:58:16.240737 6991 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:58:16.240837 6991 catalog_manager.cc:1259] Loaded cluster ID: df22a5d80f1b4d08b3239a02d1ef2b43
I20260811 00:58:16.240880 6991 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:58:16.241050 6991 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260811 00:58:16.246378 6991 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260811 00:58:16.249811 6991 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:58:16.250099 6991 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729: Loaded TSK: 0
I20260811 00:58:16.250386 6991 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 00:58:16.322705 6984 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:58:16.323048 6984 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:58:16.323096 6984 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:58:16.324402 6984 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:58:16.324477 6984 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:58:16.324528 6984 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.1
I20260811 00:58:16.326148 6984 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:39343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.1:37201
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.70.1
--webserver_port=37383
--tserver_master_addrs=127.15.70.62:46183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6984
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.1
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:58:16.326473 6984 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:58:16.326754 6984 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:58:16.333043 7032 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:16.333081 7027 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:58:16.333361 6984 server_base.cc:1034] running on GCE node
W20260811 00:58:16.333096 7029 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:58:16.333813 6984 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:58:16.334133 6984 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:58:16.335354 6984 hybrid_clock.cc:648] HybridClock initialized: now 1786409896335312 us; error 61 us; skew 500 ppm
Aug 11 00:58:16 dist-test-slave-h3ft krb5kdc[6036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409896, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:58:16.339282 6984 init.cc:377] Logged in from keytab as kudu/127.15.70.1@KRBTEST.COM (short username kudu)
I20260811 00:58:16.339944 6984 webserver.cc:460] Webserver started at http://127.15.70.1:37383/ using document root <none> and password file <none>
I20260811 00:58:16.340233 6984 fs_manager.cc:359] Metadata directory not provided
I20260811 00:58:16.340339 6984 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:58:16.342077 6984 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:58:16.342980 7042 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:16.343356 6984 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:58:16.343509 6984 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/wal
uuid: "5d4bc33892e24811affc6c81a15a475c"
format_stamp: "Formatted at 2026-08-11 00:58:15 on dist-test-slave-h3ft"
server_key: "42af9eea768a2f09b5cd1a140b153005"
server_key_iv: "6e83331b7a1ddbfe691a8b13fcbb4c0e"
server_key_version: "encryptionkey@0"
I20260811 00:58:16.344003 6984 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:58:16.378533 6984 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:58:16.381932 6984 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:58:16.382138 6984 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:58:16.382413 6984 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:58:16.383128 7056 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 00:58:16.385140 6984 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 00:58:16.385245 6984 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 00:58:16.385288 6984 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 00:58:16.386399 6984 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 00:58:16.386454 6984 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 00:58:16.386605 7056 tablet_bootstrap.cc:492] T ee85f6f0f29f41368965796b8274b517 P 5d4bc33892e24811affc6c81a15a475c: Bootstrap starting.
I20260811 00:58:16.398730 6984 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.1:37201
I20260811 00:58:16.398849 7216 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.1:37201 every 8 connection(s)
I20260811 00:58:16.399830 6984 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
I20260811 00:58:16.401495 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 6984
I20260811 00:58:16.401907 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.2:32805
--local_ip_for_outbound_sockets=127.15.70.2
--tserver_master_addrs=127.15.70.62:46183
--webserver_port=33217
--webserver_interface=127.15.70.2
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:39343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 00:58:16.403075 7056 log.cc:824] T ee85f6f0f29f41368965796b8274b517 P 5d4bc33892e24811affc6c81a15a475c: Log is configured to *not* fsync() on all Append() calls
I20260811 00:58:16.407454 7056 tablet_bootstrap.cc:492] T ee85f6f0f29f41368965796b8274b517 P 5d4bc33892e24811affc6c81a15a475c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 00:58:16.407881 7056 tablet_bootstrap.cc:492] T ee85f6f0f29f41368965796b8274b517 P 5d4bc33892e24811affc6c81a15a475c: Bootstrap complete.
I20260811 00:58:16.409456 7056 ts_tablet_manager.cc:1397] T ee85f6f0f29f41368965796b8274b517 P 5d4bc33892e24811affc6c81a15a475c: Time spent bootstrapping tablet: real 0.023s user 0.010s sys 0.010s
I20260811 00:58:16.411402 7056 raft_consensus.cc:348] T ee85f6f0f29f41368965796b8274b517 P 5d4bc33892e24811affc6c81a15a475c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcece0cc2eb743b9938498213589d5ea" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 32805 } } peers { permanent_uuid: "5d4bc33892e24811affc6c81a15a475c" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37201 } } peers { permanent_uuid: "5fc653f496e946b19a0c51b54534498b" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35423 } }
I20260811 00:58:16.411732 7056 raft_consensus.cc:729] T ee85f6f0f29f41368965796b8274b517 P 5d4bc33892e24811affc6c81a15a475c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d4bc33892e24811affc6c81a15a475c, State: Initialized, Role: FOLLOWER
Aug 11 00:58:16 dist-test-slave-h3ft krb5kdc[6036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409896, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:58:16.411967 7056 consensus_queue.cc:260] T ee85f6f0f29f41368965796b8274b517 P 5d4bc33892e24811affc6c81a15a475c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcece0cc2eb743b9938498213589d5ea" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 32805 } } peers { permanent_uuid: "5d4bc33892e24811affc6c81a15a475c" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37201 } } peers { permanent_uuid: "5fc653f496e946b19a0c51b54534498b" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35423 } }
I20260811 00:58:16.412346 7056 ts_tablet_manager.cc:1428] T ee85f6f0f29f41368965796b8274b517 P 5d4bc33892e24811affc6c81a15a475c: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 00:58:16.417115 7221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:16.401461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:34777 (local address 127.15.70.62:46183)
0811 00:58:16.403215 (+ 1754us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:16.403226 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:16.403275 (+ 49us) server_negotiation.cc:407] Connection header received
0811 00:58:16.403433 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:16.403440 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:16.403502 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:16.403668 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:16.404655 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:16.406317 (+ 1662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:16.407841 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:16.408626 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:16.408762 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:16.412681 (+ 3919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:16.412687 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:16.412687 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:16.412702 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:16.414841 (+ 2139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:16.415435 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:16.415439 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:16.415440 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:16.415562 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:16.415893 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:16.415898 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:16.415899 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:16.416196 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:16.416318 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:16.416682 (+ 364us) server_negotiation.cc:299] Negotiation successful
0811 00:58:16.416855 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1683,"thread_start_us":152,"threads_started":1}
I20260811 00:58:16.417141 7220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:16.401265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.1:34777)
0811 00:58:16.401904 (+ 639us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:16.401972 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:16.402901 (+ 929us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:16.403778 (+ 877us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:16.403784 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:16.404157 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:58:16.404418 (+ 261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:16.404426 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:16.406518 (+ 2092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:16.406520 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:16.407712 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:16.407716 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:16.408888 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:16.408889 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:16.409082 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:16.409969 (+ 887us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:58:16.409996 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:58:16.412463 (+ 2467us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:58:16.414984 (+ 2521us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:16.414993 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:16.414996 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:16.415323 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:16.415655 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:16.415657 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:16.415657 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:16.415803 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:16.416289 (+ 486us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:58:16.416298 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:58:16.416478 (+ 180us) client_negotiation.cc:769] Sending connection context
0811 00:58:16.416605 (+ 127us) client_negotiation.cc:240] Negotiation successful
0811 00:58:16.416854 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":573,"thread_start_us":145,"threads_started":1}
I20260811 00:58:16.418551 7217 heartbeater.cc:347] Connected to a master server at 127.15.70.62:46183
I20260811 00:58:16.418746 7217 heartbeater.cc:464] Registering TS with master...
I20260811 00:58:16.419032 7217 heartbeater.cc:511] Master 127.15.70.62:46183 requested a full tablet report, sending...
I20260811 00:58:16.420146 6932 ts_manager.cc:194] Registered new tserver with Master: 5d4bc33892e24811affc6c81a15a475c (127.15.70.1:37201)
I20260811 00:58:16.421496 6932 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.1@KRBTEST.COM'} at 127.15.70.1:34777
I20260811 00:58:16.422621 7217 heartbeater.cc:503] Master 127.15.70.62:46183 was elected leader, sending a full tablet report...
Aug 11 00:58:16 dist-test-slave-h3ft krb5kdc[6036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409896, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for kudu/127.15.70.1@KRBTEST.COM
I20260811 00:58:16.432225 7229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:16.421319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37848 (local address 127.15.70.1:37201)
0811 00:58:16.421532 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:16.421538 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:16.421552 (+ 14us) server_negotiation.cc:407] Connection header received
0811 00:58:16.421601 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:16.421603 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:16.421622 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:16.421727 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:16.422490 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:16.423680 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:16.425025 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:16.425351 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:16.425451 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:16.428383 (+ 2932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:16.428391 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:16.428392 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:16.428400 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:16.430267 (+ 1867us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:16.431064 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:16.431068 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:16.431069 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:16.431159 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:16.431459 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:16.431460 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:16.431460 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:16.431648 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:16.431737 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:16.432022 (+ 285us) server_negotiation.cc:299] Negotiation successful
0811 00:58:16.432138 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":94,"threads_started":1}
I20260811 00:58:16.432250 7228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:16.421006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:37201 (local address 127.0.0.1:37848)
0811 00:58:16.421252 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:16.421297 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:16.421390 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:16.421823 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:16.421831 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:16.422281 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:58:16.422375 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:16.422379 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:16.423774 (+ 1395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:16.423775 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:16.424907 (+ 1132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:16.424911 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:16.425479 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:16.425480 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:16.425579 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:16.426291 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:58:16.426299 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:58:16.428257 (+ 1958us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:58:16.430368 (+ 2111us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:16.430378 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:16.430381 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:16.430827 (+ 446us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:16.431250 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:16.431251 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:16.431252 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:16.431349 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:16.431742 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:58:16.431750 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:58:16.431834 (+ 84us) client_negotiation.cc:769] Sending connection context
0811 00:58:16.431950 (+ 116us) client_negotiation.cc:240] Negotiation successful
0811 00:58:16.432121 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":136,"threads_started":1}
I20260811 00:58:16.432878 7121 tablet_service.cc:1514] Processing DeleteTablet for tablet ee85f6f0f29f41368965796b8274b517 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:58:15 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:37848
I20260811 00:58:16.433702 7230 tablet_replica.cc:330] stopping tablet replica
I20260811 00:58:16.433835 7230 raft_consensus.cc:2229] T ee85f6f0f29f41368965796b8274b517 P 5d4bc33892e24811affc6c81a15a475c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:58:16.433919 7230 raft_consensus.cc:2258] T ee85f6f0f29f41368965796b8274b517 P 5d4bc33892e24811affc6c81a15a475c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:58:16.434374 7230 ts_tablet_manager.cc:1905] T ee85f6f0f29f41368965796b8274b517 P 5d4bc33892e24811affc6c81a15a475c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:58:16.437045 7230 ts_tablet_manager.cc:1918] T ee85f6f0f29f41368965796b8274b517 P 5d4bc33892e24811affc6c81a15a475c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:58:16.437142 7230 log.cc:1196] T ee85f6f0f29f41368965796b8274b517 P 5d4bc33892e24811affc6c81a15a475c: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/wal/wals/ee85f6f0f29f41368965796b8274b517
I20260811 00:58:16.437435 7230 ts_tablet_manager.cc:1939] T ee85f6f0f29f41368965796b8274b517 P 5d4bc33892e24811affc6c81a15a475c: Deleting consensus metadata
I20260811 00:58:16.438176 6911 catalog_manager.cc:4841] TS 5d4bc33892e24811affc6c81a15a475c (127.15.70.1:37201): tablet ee85f6f0f29f41368965796b8274b517 (table test-table [id=e1ee752f355a4d36b3fab586e597a578]) successfully deleted
W20260811 00:58:16.512866 7223 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:58:16.513211 7223 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:58:16.513262 7223 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:58:16.514613 7223 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:58:16.514690 7223 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:58:16.514750 7223 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.2
I20260811 00:58:16.516513 7223 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:39343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.2:32805
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.70.2
--webserver_port=33217
--tserver_master_addrs=127.15.70.62:46183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7223
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.2
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:58:16.516856 7223 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:58:16.517158 7223 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:58:16.523339 7244 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:16.523339 7243 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:16.523485 7247 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:58:16.523592 7223 server_base.cc:1034] running on GCE node
I20260811 00:58:16.524019 7223 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:58:16.524292 7223 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:58:16.525444 7223 hybrid_clock.cc:648] HybridClock initialized: now 1786409896525426 us; error 46 us; skew 500 ppm
Aug 11 00:58:16 dist-test-slave-h3ft krb5kdc[6036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409896, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:58:16.528715 7223 init.cc:377] Logged in from keytab as kudu/127.15.70.2@KRBTEST.COM (short username kudu)
I20260811 00:58:16.529258 7223 webserver.cc:460] Webserver started at http://127.15.70.2:33217/ using document root <none> and password file <none>
I20260811 00:58:16.529516 7223 fs_manager.cc:359] Metadata directory not provided
I20260811 00:58:16.529583 7223 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:58:16.531316 7223 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:58:16.532123 7258 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:16.532363 7223 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:58:16.532512 7223 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/wal
uuid: "fcece0cc2eb743b9938498213589d5ea"
format_stamp: "Formatted at 2026-08-11 00:58:15 on dist-test-slave-h3ft"
server_key: "ef1a1cfdddf9bd5a9178cbc90ee9c5c9"
server_key_iv: "a07a848d6724745b3f2ca00544a05741"
server_key_version: "encryptionkey@0"
I20260811 00:58:16.532975 7223 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:58:16.544777 7223 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:58:16.547736 7223 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:58:16.547926 7223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:58:16.548198 7223 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:58:16.548606 7223 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:58:16.548657 7223 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:16.548703 7223 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:58:16.548729 7223 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:16.556474 7223 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.2:32805
I20260811 00:58:16.556552 7426 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.2:32805 every 8 connection(s)
I20260811 00:58:16.556995 7223 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
I20260811 00:58:16.563063 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 7223
I20260811 00:58:16.563413 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.3:35423
--local_ip_for_outbound_sockets=127.15.70.3
--tserver_master_addrs=127.15.70.62:46183
--webserver_port=41339
--webserver_interface=127.15.70.3
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:39343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 00:58:16 dist-test-slave-h3ft krb5kdc[6036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409896, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:58:16.569841 7221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:16.557915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:34521 (local address 127.15.70.62:46183)
0811 00:58:16.558003 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:16.558005 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:16.558254 (+ 249us) server_negotiation.cc:407] Connection header received
0811 00:58:16.558930 (+ 676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:16.558932 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:16.558952 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:16.559072 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:16.560199 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:16.560767 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:16.561887 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:16.562131 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:16.562228 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:16.566245 (+ 4017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:16.566247 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:16.566248 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:16.566264 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:16.567938 (+ 1674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:16.568440 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:16.568442 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:16.568442 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:16.568513 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:16.568852 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:16.568854 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:16.568854 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:16.569091 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:16.569191 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:16.569549 (+ 358us) server_negotiation.cc:299] Negotiation successful
0811 00:58:16.569683 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 00:58:16.569886 7429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:16.557907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.2:34521)
0811 00:58:16.558107 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:16.558151 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:16.558789 (+ 638us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:16.559132 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:16.559137 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:16.559845 (+ 708us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:58:16.560092 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:16.560097 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:16.560881 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:16.560882 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:16.561779 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:16.561782 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:16.562244 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:16.562245 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:16.562396 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:16.563067 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:58:16.563079 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:58:16.566121 (+ 3042us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:58:16.568058 (+ 1937us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:16.568066 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:16.568069 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:16.568335 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:16.568586 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:16.568586 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:16.568587 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:16.568750 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:16.569198 (+ 448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:58:16.569205 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:58:16.569382 (+ 177us) client_negotiation.cc:769] Sending connection context
0811 00:58:16.569496 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 00:58:16.569665 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":90,"threads_started":1}
I20260811 00:58:16.570685 7427 heartbeater.cc:347] Connected to a master server at 127.15.70.62:46183
I20260811 00:58:16.570837 7427 heartbeater.cc:464] Registering TS with master...
I20260811 00:58:16.571148 7427 heartbeater.cc:511] Master 127.15.70.62:46183 requested a full tablet report, sending...
I20260811 00:58:16.571688 6932 ts_manager.cc:194] Registered new tserver with Master: fcece0cc2eb743b9938498213589d5ea (127.15.70.2:32805)
I20260811 00:58:16.572129 6932 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.2@KRBTEST.COM'} at 127.15.70.2:34521
W20260811 00:58:16.662961 7430 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:58:16.663308 7430 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:58:16.663337 7430 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:58:16.664608 7430 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:58:16.664669 7430 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:58:16.664700 7430 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.3
I20260811 00:58:16.666483 7430 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:39343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.3:35423
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.70.3
--webserver_port=41339
--tserver_master_addrs=127.15.70.62:46183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7430
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.3
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:58:16.666813 7430 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:58:16.667165 7430 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:58:16.673184 7439 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:16.673197 7443 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:16.673197 7440 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:58:16.673501 7430 server_base.cc:1034] running on GCE node
I20260811 00:58:16.673775 7430 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:58:16.674117 7430 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:58:16.675320 7430 hybrid_clock.cc:648] HybridClock initialized: now 1786409896675319 us; error 48 us; skew 500 ppm
Aug 11 00:58:16 dist-test-slave-h3ft krb5kdc[6036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409896, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:58:16.678508 7430 init.cc:377] Logged in from keytab as kudu/127.15.70.3@KRBTEST.COM (short username kudu)
I20260811 00:58:16.679193 7430 webserver.cc:460] Webserver started at http://127.15.70.3:41339/ using document root <none> and password file <none>
I20260811 00:58:16.679569 7430 fs_manager.cc:359] Metadata directory not provided
I20260811 00:58:16.679694 7430 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:58:16.681351 7430 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:58:16.682066 7453 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:16.682266 7430 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:58:16.682402 7430 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/wal
uuid: "5fc653f496e946b19a0c51b54534498b"
format_stamp: "Formatted at 2026-08-11 00:58:15 on dist-test-slave-h3ft"
server_key: "6111d7ce715deb85ac0212bbdaa30137"
server_key_iv: "1fce408e1217bf3f44c14a68b096385f"
server_key_version: "encryptionkey@0"
I20260811 00:58:16.682854 7430 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:58:16.696904 7430 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:58:16.699481 7430 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:58:16.699682 7430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:58:16.699990 7430 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:58:16.700414 7430 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:58:16.700475 7430 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:16.700527 7430 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:58:16.700559 7430 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:16.708331 7430 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.3:35423
I20260811 00:58:16.708452 7625 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.3:35423 every 8 connection(s)
I20260811 00:58:16.708922 7430 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
I20260811 00:58:16.711644 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 7430
Aug 11 00:58:16 dist-test-slave-h3ft krb5kdc[6036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409896, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:58:16.720472 7631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:16.712279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44030 (local address 127.15.70.62:46183)
0811 00:58:16.712471 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:16.712474 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:16.712487 (+ 13us) server_negotiation.cc:407] Connection header received
0811 00:58:16.712562 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:16.712563 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:16.712577 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:16.712691 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:16.713568 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:16.714195 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:16.715191 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:16.715399 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:16.715488 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:16.717029 (+ 1541us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:16.717031 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:16.717032 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:16.717041 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:16.719042 (+ 2001us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:16.719458 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:16.719460 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:16.719461 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:16.719533 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:16.719762 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:16.719764 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:16.719764 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:16.719927 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:16.720180 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:16.720222 (+ 42us) server_negotiation.cc:299] Negotiation successful
0811 00:58:16.720325 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":118,"threads_started":1}
I20260811 00:58:16.722118 7221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:16.710116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:49973 (local address 127.15.70.62:46183)
0811 00:58:16.710228 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:16.710231 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:16.710498 (+ 267us) server_negotiation.cc:407] Connection header received
0811 00:58:16.711209 (+ 711us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:16.711210 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:16.711224 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:16.711306 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:16.712983 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:16.713781 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:16.715150 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:16.715384 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:16.715443 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:16.718552 (+ 3109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:16.718555 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:16.718555 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:16.718564 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:16.720138 (+ 1574us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:16.720756 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:16.720757 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:16.720757 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:16.720824 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:16.721308 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:16.721309 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:16.721310 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:16.721488 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:16.721571 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:16.721944 (+ 373us) server_negotiation.cc:299] Negotiation successful
0811 00:58:16.722032 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 00:58:16.722450 7628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:16.710126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.3:49973)
0811 00:58:16.710324 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:16.710378 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:16.711063 (+ 685us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:16.711424 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:16.711430 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:16.712422 (+ 992us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:58:16.712827 (+ 405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:16.712835 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:16.713892 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:16.713893 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:16.714964 (+ 1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:16.714967 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:16.715477 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:16.715479 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:16.715654 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:16.716422 (+ 768us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:58:16.716432 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:58:16.718435 (+ 2003us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:58:16.720254 (+ 1819us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:16.720264 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:16.720267 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:16.720691 (+ 424us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:16.721030 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:16.721031 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:16.721031 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:16.721216 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:16.721571 (+ 355us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:58:16.721580 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:58:16.721807 (+ 227us) client_negotiation.cc:769] Sending connection context
0811 00:58:16.721909 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 00:58:16.722121 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":109,"threads_started":1}
I20260811 00:58:16.723055 7626 heartbeater.cc:347] Connected to a master server at 127.15.70.62:46183
I20260811 00:58:16.723194 7626 heartbeater.cc:464] Registering TS with master...
I20260811 00:58:16.723405 7626 heartbeater.cc:511] Master 127.15.70.62:46183 requested a full tablet report, sending...
I20260811 00:58:16.723851 6932 ts_manager.cc:194] Registered new tserver with Master: 5fc653f496e946b19a0c51b54534498b (127.15.70.3:35423)
I20260811 00:58:16.724259 6932 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.3@KRBTEST.COM'} at 127.15.70.3:49973
I20260811 00:58:16.732903 15640 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 00:58:16.736483 7221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:16.733448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44042 (local address 127.15.70.62:46183)
0811 00:58:16.733527 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:16.733530 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:16.733640 (+ 110us) server_negotiation.cc:407] Connection header received
0811 00:58:16.733723 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:16.733724 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:16.733775 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:16.733853 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:58:16.733985 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:16.734510 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:16.735487 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:16.735690 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:16.735766 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:16.735989 (+ 223us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:58:16.736115 (+ 126us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:58:16.736201 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:16.736313 (+ 112us) server_negotiation.cc:299] Negotiation successful
0811 00:58:16.736342 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 00:58:16.736857 6932 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:44042:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:58:16.739461 6932 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:58:16.742762 7121 tablet_service.cc:1467] Processing CreateTablet for tablet b15282f43dc54a10bf84b6da90cfe468 (DEFAULT_TABLE table=test-table [id=2f7fe6a86ef2453ab1ee04dedc18a985]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:58:16.743088 7121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b15282f43dc54a10bf84b6da90cfe468. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:58:16.744973 7056 tablet_bootstrap.cc:492] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c: Bootstrap starting.
I20260811 00:58:16.745466 7056 tablet_bootstrap.cc:654] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c: Neither blocks nor log segments found. Creating new log.
I20260811 00:58:16.746210 7056 tablet_bootstrap.cc:492] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c: No bootstrap required, opened a new log
I20260811 00:58:16.746285 7056 ts_tablet_manager.cc:1397] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260811 00:58:16.746682 7056 raft_consensus.cc:348] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcece0cc2eb743b9938498213589d5ea" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 32805 } } peers { permanent_uuid: "5fc653f496e946b19a0c51b54534498b" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35423 } } peers { permanent_uuid: "5d4bc33892e24811affc6c81a15a475c" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37201 } }
I20260811 00:58:16.746781 7056 raft_consensus.cc:374] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:58:16.746840 7056 raft_consensus.cc:729] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d4bc33892e24811affc6c81a15a475c, State: Initialized, Role: FOLLOWER
I20260811 00:58:16.746876 7228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:16.742094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.2:32805 (local address 127.0.0.1:34124)
0811 00:58:16.742162 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:16.742179 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:16.742229 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:16.742757 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:16.742759 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:16.742761 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:58:16.742829 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:16.742831 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:16.744033 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:16.744034 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:16.745404 (+ 1370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:16.745408 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:16.746541 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:16.746542 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:16.746632 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:16.746659 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 00:58:16.746692 (+ 33us) client_negotiation.cc:240] Negotiation successful
0811 00:58:16.746759 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 00:58:16.746987 7056 consensus_queue.cc:260] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcece0cc2eb743b9938498213589d5ea" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 32805 } } peers { permanent_uuid: "5fc653f496e946b19a0c51b54534498b" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35423 } } peers { permanent_uuid: "5d4bc33892e24811affc6c81a15a475c" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37201 } }
I20260811 00:58:16.747187 7056 ts_tablet_manager.cc:1428] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260811 00:58:16.747293 7638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:16.742318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34124 (local address 127.15.70.2:32805)
0811 00:58:16.742560 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:16.742566 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:16.742579 (+ 13us) server_negotiation.cc:407] Connection header received
0811 00:58:16.742626 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:16.742627 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:16.742642 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:16.742716 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:58:16.742984 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:16.743909 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:16.745563 (+ 1654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:16.746429 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:16.746993 (+ 564us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:16.747113 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:16.747145 (+ 32us) server_negotiation.cc:299] Negotiation successful
0811 00:58:16.747189 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":131,"threads_started":1}
I20260811 00:58:16.748394 7325 tablet_service.cc:1467] Processing CreateTablet for tablet b15282f43dc54a10bf84b6da90cfe468 (DEFAULT_TABLE table=test-table [id=2f7fe6a86ef2453ab1ee04dedc18a985]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:58:16.748807 7325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b15282f43dc54a10bf84b6da90cfe468. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:58:16.749259 7635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:16.742094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:35423 (local address 127.0.0.1:44698)
0811 00:58:16.742399 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:16.742410 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:16.742475 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:16.745282 (+ 2807us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:16.745283 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:16.745286 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:58:16.745344 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:16.745346 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:16.746832 (+ 1486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:16.746833 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:16.748072 (+ 1239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:16.748075 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:16.748981 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:16.748982 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:16.749064 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:16.749069 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 00:58:16.749134 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 00:58:16.749180 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"mutex_wait_us":173,"thread_start_us":83,"threads_started":1}
I20260811 00:58:16.749293 7639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:16.742352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44698 (local address 127.15.70.3:35423)
0811 00:58:16.745071 (+ 2719us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:16.745076 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:16.745090 (+ 14us) server_negotiation.cc:407] Connection header received
0811 00:58:16.745140 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:16.745142 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:16.745162 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:16.745265 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:58:16.745475 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:16.746705 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:16.748191 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:16.748836 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:16.748973 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:16.749042 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:16.749149 (+ 107us) server_negotiation.cc:299] Negotiation successful
0811 00:58:16.749198 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2665,"thread_start_us":124,"threads_started":1}
I20260811 00:58:16.751775 7522 tablet_service.cc:1467] Processing CreateTablet for tablet b15282f43dc54a10bf84b6da90cfe468 (DEFAULT_TABLE table=test-table [id=2f7fe6a86ef2453ab1ee04dedc18a985]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:58:16.752156 7522 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b15282f43dc54a10bf84b6da90cfe468. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:58:16.752300 7642 tablet_bootstrap.cc:492] T b15282f43dc54a10bf84b6da90cfe468 P fcece0cc2eb743b9938498213589d5ea: Bootstrap starting.
I20260811 00:58:16.752995 7642 tablet_bootstrap.cc:654] T b15282f43dc54a10bf84b6da90cfe468 P fcece0cc2eb743b9938498213589d5ea: Neither blocks nor log segments found. Creating new log.
I20260811 00:58:16.753777 7642 log.cc:824] T b15282f43dc54a10bf84b6da90cfe468 P fcece0cc2eb743b9938498213589d5ea: Log is configured to *not* fsync() on all Append() calls
I20260811 00:58:16.754591 7642 tablet_bootstrap.cc:492] T b15282f43dc54a10bf84b6da90cfe468 P fcece0cc2eb743b9938498213589d5ea: No bootstrap required, opened a new log
I20260811 00:58:16.754652 7642 ts_tablet_manager.cc:1397] T b15282f43dc54a10bf84b6da90cfe468 P fcece0cc2eb743b9938498213589d5ea: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 00:58:16.755879 7646 tablet_bootstrap.cc:492] T b15282f43dc54a10bf84b6da90cfe468 P 5fc653f496e946b19a0c51b54534498b: Bootstrap starting.
I20260811 00:58:16.756692 7646 tablet_bootstrap.cc:654] T b15282f43dc54a10bf84b6da90cfe468 P 5fc653f496e946b19a0c51b54534498b: Neither blocks nor log segments found. Creating new log.
I20260811 00:58:16.756601 7642 raft_consensus.cc:348] T b15282f43dc54a10bf84b6da90cfe468 P fcece0cc2eb743b9938498213589d5ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcece0cc2eb743b9938498213589d5ea" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 32805 } } peers { permanent_uuid: "5fc653f496e946b19a0c51b54534498b" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35423 } } peers { permanent_uuid: "5d4bc33892e24811affc6c81a15a475c" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37201 } }
I20260811 00:58:16.756803 7642 raft_consensus.cc:374] T b15282f43dc54a10bf84b6da90cfe468 P fcece0cc2eb743b9938498213589d5ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:58:16.756853 7642 raft_consensus.cc:729] T b15282f43dc54a10bf84b6da90cfe468 P fcece0cc2eb743b9938498213589d5ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcece0cc2eb743b9938498213589d5ea, State: Initialized, Role: FOLLOWER
I20260811 00:58:16.757022 7642 consensus_queue.cc:260] T b15282f43dc54a10bf84b6da90cfe468 P fcece0cc2eb743b9938498213589d5ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcece0cc2eb743b9938498213589d5ea" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 32805 } } peers { permanent_uuid: "5fc653f496e946b19a0c51b54534498b" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35423 } } peers { permanent_uuid: "5d4bc33892e24811affc6c81a15a475c" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37201 } }
I20260811 00:58:16.757381 7642 ts_tablet_manager.cc:1428] T b15282f43dc54a10bf84b6da90cfe468 P fcece0cc2eb743b9938498213589d5ea: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 00:58:16.757406 7427 heartbeater.cc:503] Master 127.15.70.62:46183 was elected leader, sending a full tablet report...
I20260811 00:58:16.757653 7646 log.cc:824] T b15282f43dc54a10bf84b6da90cfe468 P 5fc653f496e946b19a0c51b54534498b: Log is configured to *not* fsync() on all Append() calls
I20260811 00:58:16.758673 7646 tablet_bootstrap.cc:492] T b15282f43dc54a10bf84b6da90cfe468 P 5fc653f496e946b19a0c51b54534498b: No bootstrap required, opened a new log
I20260811 00:58:16.758733 7646 ts_tablet_manager.cc:1397] T b15282f43dc54a10bf84b6da90cfe468 P 5fc653f496e946b19a0c51b54534498b: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 00:58:16.760231 7646 raft_consensus.cc:348] T b15282f43dc54a10bf84b6da90cfe468 P 5fc653f496e946b19a0c51b54534498b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcece0cc2eb743b9938498213589d5ea" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 32805 } } peers { permanent_uuid: "5fc653f496e946b19a0c51b54534498b" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35423 } } peers { permanent_uuid: "5d4bc33892e24811affc6c81a15a475c" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37201 } }
I20260811 00:58:16.760367 7646 raft_consensus.cc:374] T b15282f43dc54a10bf84b6da90cfe468 P 5fc653f496e946b19a0c51b54534498b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:58:16.760391 7646 raft_consensus.cc:729] T b15282f43dc54a10bf84b6da90cfe468 P 5fc653f496e946b19a0c51b54534498b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fc653f496e946b19a0c51b54534498b, State: Initialized, Role: FOLLOWER
I20260811 00:58:16.760520 7646 consensus_queue.cc:260] T b15282f43dc54a10bf84b6da90cfe468 P 5fc653f496e946b19a0c51b54534498b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcece0cc2eb743b9938498213589d5ea" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 32805 } } peers { permanent_uuid: "5fc653f496e946b19a0c51b54534498b" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35423 } } peers { permanent_uuid: "5d4bc33892e24811affc6c81a15a475c" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37201 } }
I20260811 00:58:16.760834 7646 ts_tablet_manager.cc:1428] T b15282f43dc54a10bf84b6da90cfe468 P 5fc653f496e946b19a0c51b54534498b: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 00:58:16.760851 7626 heartbeater.cc:503] Master 127.15.70.62:46183 was elected leader, sending a full tablet report...
W20260811 00:58:16.807816 7428 tablet.cc:2369] T b15282f43dc54a10bf84b6da90cfe468 P fcece0cc2eb743b9938498213589d5ea: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 00:58:16.901072 7219 tablet.cc:2369] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 00:58:16.959733 7627 tablet.cc:2369] T b15282f43dc54a10bf84b6da90cfe468 P 5fc653f496e946b19a0c51b54534498b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 00:58:17.054250 7648 raft_consensus.cc:482] T b15282f43dc54a10bf84b6da90cfe468 P fcece0cc2eb743b9938498213589d5ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:58:17.054486 7648 raft_consensus.cc:504] T b15282f43dc54a10bf84b6da90cfe468 P fcece0cc2eb743b9938498213589d5ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcece0cc2eb743b9938498213589d5ea" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 32805 } } peers { permanent_uuid: "5fc653f496e946b19a0c51b54534498b" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35423 } } peers { permanent_uuid: "5d4bc33892e24811affc6c81a15a475c" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37201 } }
I20260811 00:58:17.054982 7648 leader_election.cc:288] T b15282f43dc54a10bf84b6da90cfe468 P fcece0cc2eb743b9938498213589d5ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5fc653f496e946b19a0c51b54534498b (127.15.70.3:35423), 5d4bc33892e24811affc6c81a15a475c (127.15.70.1:37201)
I20260811 00:58:17.056427 7225 raft_consensus.cc:482] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:58:17.056571 7225 raft_consensus.cc:504] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcece0cc2eb743b9938498213589d5ea" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 32805 } } peers { permanent_uuid: "5fc653f496e946b19a0c51b54534498b" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35423 } } peers { permanent_uuid: "5d4bc33892e24811affc6c81a15a475c" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37201 } }
I20260811 00:58:17.056988 7225 leader_election.cc:288] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcece0cc2eb743b9938498213589d5ea (127.15.70.2:32805), 5fc653f496e946b19a0c51b54534498b (127.15.70.3:35423)
I20260811 00:58:17.059491 7651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:17.055297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:37201 (local address 127.15.70.2:45671)
0811 00:58:17.055559 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:17.055570 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:17.055646 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:17.056055 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:17.056056 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:17.056058 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:58:17.056140 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:17.056142 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:17.057139 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:17.057140 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:17.058258 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:17.058260 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:17.059219 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:17.059220 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:17.059282 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:17.059285 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:58:17.059333 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 00:58:17.059374 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"mutex_wait_us":108,"thread_start_us":84,"threads_started":1}
I20260811 00:58:17.059558 7639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:17.055434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:41385 (local address 127.15.70.3:35423)
0811 00:58:17.055508 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:17.055510 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:17.055524 (+ 14us) server_negotiation.cc:407] Connection header received
0811 00:58:17.055570 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:17.055571 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:17.055594 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:17.055659 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:58:17.056004 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:17.056792 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:17.058379 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:17.058972 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:17.059078 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:17.059095 (+ 17us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:17.059421 (+ 326us) server_negotiation.cc:299] Negotiation successful
0811 00:58:17.059469 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 00:58:17.059823 7653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:17.055445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:45671 (local address 127.15.70.1:37201)
0811 00:58:17.055594 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:17.055596 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:17.055683 (+ 87us) server_negotiation.cc:407] Connection header received
0811 00:58:17.055716 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:17.055717 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:17.055755 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:17.055914 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:58:17.056248 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:17.057039 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:17.058362 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:17.059050 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:17.059110 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:17.059285 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:17.059678 (+ 393us) server_negotiation.cc:299] Negotiation successful
0811 00:58:17.059737 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":77,"server-negotiator.queue_time_us":118,"thread_start_us":77,"threads_started":1}
I20260811 00:58:17.060108 7429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:17.055297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:35423 (local address 127.15.70.2:41385)
0811 00:58:17.055395 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:17.055412 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:17.055477 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:17.055684 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:17.055685 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:17.055688 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:58:17.055794 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:17.055797 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:17.056898 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:17.056899 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:17.058250 (+ 1351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:17.058253 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:17.059172 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:17.059173 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:17.059265 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:17.059270 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 00:58:17.059326 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 00:58:17.059378 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260811 00:58:17.060073 7150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b15282f43dc54a10bf84b6da90cfe468" candidate_uuid: "fcece0cc2eb743b9938498213589d5ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d4bc33892e24811affc6c81a15a475c" is_pre_election: true
I20260811 00:58:17.060235 7150 raft_consensus.cc:2454] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcece0cc2eb743b9938498213589d5ea in term 0.
I20260811 00:58:17.060505 7264 leader_election.cc:302] T b15282f43dc54a10bf84b6da90cfe468 P fcece0cc2eb743b9938498213589d5ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d4bc33892e24811affc6c81a15a475c, fcece0cc2eb743b9938498213589d5ea; no voters:
I20260811 00:58:17.060511 7553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b15282f43dc54a10bf84b6da90cfe468" candidate_uuid: "fcece0cc2eb743b9938498213589d5ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fc653f496e946b19a0c51b54534498b" is_pre_election: true
I20260811 00:58:17.060679 7553 raft_consensus.cc:2454] T b15282f43dc54a10bf84b6da90cfe468 P 5fc653f496e946b19a0c51b54534498b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcece0cc2eb743b9938498213589d5ea in term 0.
I20260811 00:58:17.060869 7648 raft_consensus.cc:2781] T b15282f43dc54a10bf84b6da90cfe468 P fcece0cc2eb743b9938498213589d5ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:58:17.061491 7659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:17.057178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:35423 (local address 127.15.70.1:42139)
0811 00:58:17.057503 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:17.057512 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:17.057552 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:17.057784 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:17.057785 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:17.057788 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:58:17.057857 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:17.057859 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:17.059104 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:17.059105 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:17.060420 (+ 1315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:17.060424 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:17.061217 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:17.061219 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:17.061292 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:17.061297 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 00:58:17.061355 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 00:58:17.061403 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"mutex_wait_us":111,"thread_start_us":42,"threads_started":1}
I20260811 00:58:17.061445 7648 raft_consensus.cc:482] T b15282f43dc54a10bf84b6da90cfe468 P fcece0cc2eb743b9938498213589d5ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:58:17.061564 7660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:17.057310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:42139 (local address 127.15.70.3:35423)
0811 00:58:17.057634 (+ 324us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:17.057636 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:17.057641 (+ 5us) server_negotiation.cc:407] Connection header received
0811 00:58:17.057663 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:17.057663 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:17.057686 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:17.057766 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:58:17.057960 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:17.058962 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:17.060520 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:17.061118 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:17.061178 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:17.061188 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:17.061403 (+ 215us) server_negotiation.cc:299] Negotiation successful
0811 00:58:17.061453 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":139,"threads_started":1}
I20260811 00:58:17.061797 7553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b15282f43dc54a10bf84b6da90cfe468" candidate_uuid: "5d4bc33892e24811affc6c81a15a475c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fc653f496e946b19a0c51b54534498b" is_pre_election: true
I20260811 00:58:17.061533 7648 raft_consensus.cc:3037] T b15282f43dc54a10bf84b6da90cfe468 P fcece0cc2eb743b9938498213589d5ea [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:58:17.061890 7553 raft_consensus.cc:2454] T b15282f43dc54a10bf84b6da90cfe468 P 5fc653f496e946b19a0c51b54534498b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d4bc33892e24811affc6c81a15a475c in term 0.
I20260811 00:58:17.061916 7638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:17.057873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:38091 (local address 127.15.70.2:32805)
0811 00:58:17.057924 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:17.057926 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:17.057934 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:58:17.057956 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:17.057957 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:17.057967 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:17.058024 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:58:17.058233 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:17.058931 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:17.060682 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:17.061224 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:17.061295 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:17.061305 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:17.061541 (+ 236us) server_negotiation.cc:299] Negotiation successful
0811 00:58:17.061586 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 00:58:17.062036 7655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:17.057121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.2:32805 (local address 127.15.70.1:38091)
0811 00:58:17.057314 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:17.057327 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:17.057405 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:17.058107 (+ 702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:17.058109 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:17.058111 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:58:17.058151 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:17.058153 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:17.059071 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:17.059072 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:17.060563 (+ 1491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:17.060565 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:17.061319 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:17.061320 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:17.061412 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:17.061416 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:58:17.061756 (+ 340us) client_negotiation.cc:240] Negotiation successful
0811 00:58:17.061812 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"mutex_wait_us":2,"thread_start_us":77,"threads_started":1}
I20260811 00:58:17.062114 7044 leader_election.cc:302] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d4bc33892e24811affc6c81a15a475c, 5fc653f496e946b19a0c51b54534498b; no voters:
I20260811 00:58:17.062258 7225 raft_consensus.cc:2781] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:58:17.062314 7225 raft_consensus.cc:482] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:58:17.062342 7225 raft_consensus.cc:3037] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:58:17.062405 7352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b15282f43dc54a10bf84b6da90cfe468" candidate_uuid: "5d4bc33892e24811affc6c81a15a475c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcece0cc2eb743b9938498213589d5ea" is_pre_election: true
I20260811 00:58:17.063238 7648 raft_consensus.cc:504] T b15282f43dc54a10bf84b6da90cfe468 P fcece0cc2eb743b9938498213589d5ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcece0cc2eb743b9938498213589d5ea" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 32805 } } peers { permanent_uuid: "5fc653f496e946b19a0c51b54534498b" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35423 } } peers { permanent_uuid: "5d4bc33892e24811affc6c81a15a475c" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37201 } }
I20260811 00:58:17.063267 7225 raft_consensus.cc:504] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcece0cc2eb743b9938498213589d5ea" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 32805 } } peers { permanent_uuid: "5fc653f496e946b19a0c51b54534498b" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35423 } } peers { permanent_uuid: "5d4bc33892e24811affc6c81a15a475c" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37201 } }
I20260811 00:58:17.063422 7352 raft_consensus.cc:2379] T b15282f43dc54a10bf84b6da90cfe468 P fcece0cc2eb743b9938498213589d5ea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d4bc33892e24811affc6c81a15a475c in current term 1: Already voted for candidate fcece0cc2eb743b9938498213589d5ea in this term.
I20260811 00:58:17.063453 7225 leader_election.cc:288] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [CANDIDATE]: Term 1 election: Requested vote from peers fcece0cc2eb743b9938498213589d5ea (127.15.70.2:32805), 5fc653f496e946b19a0c51b54534498b (127.15.70.3:35423)
I20260811 00:58:17.063628 7351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b15282f43dc54a10bf84b6da90cfe468" candidate_uuid: "5d4bc33892e24811affc6c81a15a475c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcece0cc2eb743b9938498213589d5ea"
I20260811 00:58:17.063629 7552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b15282f43dc54a10bf84b6da90cfe468" candidate_uuid: "5d4bc33892e24811affc6c81a15a475c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fc653f496e946b19a0c51b54534498b"
I20260811 00:58:17.063727 7351 raft_consensus.cc:2379] T b15282f43dc54a10bf84b6da90cfe468 P fcece0cc2eb743b9938498213589d5ea [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d4bc33892e24811affc6c81a15a475c in current term 1: Already voted for candidate fcece0cc2eb743b9938498213589d5ea in this term.
I20260811 00:58:17.063725 7552 raft_consensus.cc:3037] T b15282f43dc54a10bf84b6da90cfe468 P 5fc653f496e946b19a0c51b54534498b [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:58:17.064668 7552 raft_consensus.cc:2454] T b15282f43dc54a10bf84b6da90cfe468 P 5fc653f496e946b19a0c51b54534498b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d4bc33892e24811affc6c81a15a475c in term 1.
I20260811 00:58:17.064765 7553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b15282f43dc54a10bf84b6da90cfe468" candidate_uuid: "fcece0cc2eb743b9938498213589d5ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fc653f496e946b19a0c51b54534498b"
I20260811 00:58:17.064850 7553 raft_consensus.cc:2379] T b15282f43dc54a10bf84b6da90cfe468 P 5fc653f496e946b19a0c51b54534498b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fcece0cc2eb743b9938498213589d5ea in current term 1: Already voted for candidate 5d4bc33892e24811affc6c81a15a475c in this term.
I20260811 00:58:17.065007 7044 leader_election.cc:302] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d4bc33892e24811affc6c81a15a475c, 5fc653f496e946b19a0c51b54534498b; no voters: fcece0cc2eb743b9938498213589d5ea
I20260811 00:58:17.065172 7225 raft_consensus.cc:2781] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:58:17.065256 7150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b15282f43dc54a10bf84b6da90cfe468" candidate_uuid: "fcece0cc2eb743b9938498213589d5ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d4bc33892e24811affc6c81a15a475c"
I20260811 00:58:17.065376 7225 raft_consensus.cc:686] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [term 1 LEADER]: Becoming Leader. State: Replica: 5d4bc33892e24811affc6c81a15a475c, State: Running, Role: LEADER
I20260811 00:58:17.065186 7648 leader_election.cc:288] T b15282f43dc54a10bf84b6da90cfe468 P fcece0cc2eb743b9938498213589d5ea [CANDIDATE]: Term 1 election: Requested vote from peers 5fc653f496e946b19a0c51b54534498b (127.15.70.3:35423), 5d4bc33892e24811affc6c81a15a475c (127.15.70.1:37201)
I20260811 00:58:17.065488 7225 consensus_queue.cc:237] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcece0cc2eb743b9938498213589d5ea" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 32805 } } peers { permanent_uuid: "5fc653f496e946b19a0c51b54534498b" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35423 } } peers { permanent_uuid: "5d4bc33892e24811affc6c81a15a475c" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37201 } }
I20260811 00:58:17.066248 7264 leader_election.cc:302] T b15282f43dc54a10bf84b6da90cfe468 P fcece0cc2eb743b9938498213589d5ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcece0cc2eb743b9938498213589d5ea; no voters: 5d4bc33892e24811affc6c81a15a475c, 5fc653f496e946b19a0c51b54534498b
I20260811 00:58:17.066380 7648 raft_consensus.cc:2726] T b15282f43dc54a10bf84b6da90cfe468 P fcece0cc2eb743b9938498213589d5ea [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260811 00:58:17.066570 6931 catalog_manager.cc:5495] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d4bc33892e24811affc6c81a15a475c (127.15.70.1). New cstate: current_term: 1 leader_uuid: "5d4bc33892e24811affc6c81a15a475c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcece0cc2eb743b9938498213589d5ea" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 32805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5fc653f496e946b19a0c51b54534498b" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d4bc33892e24811affc6c81a15a475c" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37201 } health_report { overall_health: HEALTHY } } }
I20260811 00:58:17.106841 7653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:17.104023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37862 (local address 127.15.70.1:37201)
0811 00:58:17.104110 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:17.104113 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:17.104124 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:58:17.104179 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:17.104180 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:17.104210 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:17.104284 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:58:17.104525 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:17.105116 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:17.105968 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:17.106170 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:17.106235 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:17.106393 (+ 158us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:58:17.106529 (+ 136us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:58:17.106596 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:17.106637 (+ 41us) server_negotiation.cc:299] Negotiation successful
0811 00:58:17.106660 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 00:58:17.109030 7351 raft_consensus.cc:1261] T b15282f43dc54a10bf84b6da90cfe468 P fcece0cc2eb743b9938498213589d5ea [term 1 FOLLOWER]: Refusing update from remote peer 5d4bc33892e24811affc6c81a15a475c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:58:17.109063 7553 raft_consensus.cc:1261] T b15282f43dc54a10bf84b6da90cfe468 P 5fc653f496e946b19a0c51b54534498b [term 1 FOLLOWER]: Refusing update from remote peer 5d4bc33892e24811affc6c81a15a475c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:58:17.109409 7225 consensus_queue.cc:1035] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcece0cc2eb743b9938498213589d5ea" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 32805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:58:17.109616 7662 consensus_queue.cc:1035] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fc653f496e946b19a0c51b54534498b" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:58:17.113485 7668 mvcc.cc:205] Tried to move back new op lower bound from 7317134938555363328 to 7317134938381049856. Current Snapshot: MvccSnapshot[applied={T|T < 7317134938555363328}]
I20260811 00:58:17.116585 6931 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:44042:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:58:17.116729 6931 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:44042:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:58:17.117705 6931 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729: Sending DeleteTablet for 3 replicas of tablet b15282f43dc54a10bf84b6da90cfe468
I20260811 00:58:17.118058 7121 tablet_service.cc:1514] Processing DeleteTablet for tablet b15282f43dc54a10bf84b6da90cfe468 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:58:17 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:37848
I20260811 00:58:17.118208 7522 tablet_service.cc:1514] Processing DeleteTablet for tablet b15282f43dc54a10bf84b6da90cfe468 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:58:17 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:44698
I20260811 00:58:17.118232 7325 tablet_service.cc:1514] Processing DeleteTablet for tablet b15282f43dc54a10bf84b6da90cfe468 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:58:17 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:34124
I20260811 00:58:17.118523 7684 tablet_replica.cc:330] T b15282f43dc54a10bf84b6da90cfe468 P 5fc653f496e946b19a0c51b54534498b: stopping tablet replica
I20260811 00:58:17.118592 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 6984
I20260811 00:58:17.118660 7684 raft_consensus.cc:2229] T b15282f43dc54a10bf84b6da90cfe468 P 5fc653f496e946b19a0c51b54534498b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:58:17.133052 7684 raft_consensus.cc:2258] T b15282f43dc54a10bf84b6da90cfe468 P 5fc653f496e946b19a0c51b54534498b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:58:17.133490 7683 tablet_replica.cc:330] T b15282f43dc54a10bf84b6da90cfe468 P fcece0cc2eb743b9938498213589d5ea: stopping tablet replica
I20260811 00:58:17.133692 7683 raft_consensus.cc:2229] T b15282f43dc54a10bf84b6da90cfe468 P fcece0cc2eb743b9938498213589d5ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:58:17.133868 7683 raft_consensus.cc:2258] T b15282f43dc54a10bf84b6da90cfe468 P fcece0cc2eb743b9938498213589d5ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:58:17.134696 7683 ts_tablet_manager.cc:1905] T b15282f43dc54a10bf84b6da90cfe468 P fcece0cc2eb743b9938498213589d5ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:58:17.134737 7684 ts_tablet_manager.cc:1905] T b15282f43dc54a10bf84b6da90cfe468 P 5fc653f496e946b19a0c51b54534498b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:58:17.136806 7684 ts_tablet_manager.cc:1918] T b15282f43dc54a10bf84b6da90cfe468 P 5fc653f496e946b19a0c51b54534498b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:58:17.136902 7684 log.cc:1196] T b15282f43dc54a10bf84b6da90cfe468 P 5fc653f496e946b19a0c51b54534498b: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/wal/wals/b15282f43dc54a10bf84b6da90cfe468
I20260811 00:58:17.137435 7683 ts_tablet_manager.cc:1918] T b15282f43dc54a10bf84b6da90cfe468 P fcece0cc2eb743b9938498213589d5ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:58:17.137487 7684 ts_tablet_manager.cc:1939] T b15282f43dc54a10bf84b6da90cfe468 P 5fc653f496e946b19a0c51b54534498b: Deleting consensus metadata
I20260811 00:58:17.137643 7683 log.cc:1196] T b15282f43dc54a10bf84b6da90cfe468 P fcece0cc2eb743b9938498213589d5ea: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/wal/wals/b15282f43dc54a10bf84b6da90cfe468
I20260811 00:58:17.138203 6910 catalog_manager.cc:4841] TS 5fc653f496e946b19a0c51b54534498b (127.15.70.3:35423): tablet b15282f43dc54a10bf84b6da90cfe468 (table test-table [id=2f7fe6a86ef2453ab1ee04dedc18a985]) successfully deleted
I20260811 00:58:17.138533 7683 ts_tablet_manager.cc:1939] T b15282f43dc54a10bf84b6da90cfe468 P fcece0cc2eb743b9938498213589d5ea: Deleting consensus metadata
I20260811 00:58:17.139123 6913 catalog_manager.cc:4841] TS fcece0cc2eb743b9938498213589d5ea (127.15.70.2:32805): tablet b15282f43dc54a10bf84b6da90cfe468 (table test-table [id=2f7fe6a86ef2453ab1ee04dedc18a985]) successfully deleted
W20260811 00:58:17.141918 6911 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.70.1:37201 (error 108)
I20260811 00:58:17.142263 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 7223
I20260811 00:58:17.145620 7635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:17.142457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:37201 (local address 127.0.0.1:37876)
0811 00:58:17.145485 (+ 3028us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:17.145560 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.1:37201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2986}
W20260811 00:58:17.145772 6911 catalog_manager.cc:4584] TS 5d4bc33892e24811affc6c81a15a475c (127.15.70.1:37201): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b15282f43dc54a10bf84b6da90cfe468: Network error: Client connection negotiation failed: client connection to 127.15.70.1:37201: connect: Connection refused (error 111)
I20260811 00:58:17.158015 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 7430
I20260811 00:58:17.175930 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 6888
I20260811 00:58:17.198199 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:46183
--webserver_interface=127.15.70.62
--webserver_port=37601
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:39343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:46183
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:58:17.295439 7688 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:58:17.295722 7688 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:58:17.295747 7688 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:58:17.296976 7688 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:58:17.297025 7688 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:58:17.297039 7688 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:58:17.297052 7688 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:58:17.297065 7688 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:58:17.298702 7688 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:39343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:46183
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:46183
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=37601
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7688
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:58:17.298974 7688 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:58:17.299304 7688 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:58:17.305169 7703 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:17.305177 7699 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:17.305177 7698 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:58:17.305292 7688 server_base.cc:1034] running on GCE node
I20260811 00:58:17.305744 7688 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:58:17.306102 7688 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:58:17.307253 7688 hybrid_clock.cc:648] HybridClock initialized: now 1786409897307222 us; error 44 us; skew 500 ppm
Aug 11 00:58:17 dist-test-slave-h3ft krb5kdc[6036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409897, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:58:17.310334 7688 init.cc:377] Logged in from keytab as kudu/127.15.70.62@KRBTEST.COM (short username kudu)
I20260811 00:58:17.310791 7688 webserver.cc:460] Webserver started at http://127.15.70.62:37601/ using document root <none> and password file <none>
I20260811 00:58:17.311096 7688 fs_manager.cc:359] Metadata directory not provided
I20260811 00:58:17.311152 7688 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:58:17.312711 7688 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 00:58:17.313603 7712 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:17.313829 7688 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 00:58:17.313961 7688 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "3b87d21591ba4a08b98dd450617ac729"
format_stamp: "Formatted at 2026-08-11 00:58:14 on dist-test-slave-h3ft"
server_key: "dfdaedecfe0500c9de6dde0676952a65"
server_key_iv: "03d47f0ab5724fa1e914fc46a23d9542"
server_key_version: "encryptionkey@0"
I20260811 00:58:17.314438 7688 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:58:17.335273 7688 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:58:17.338037 7688 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:58:17.338196 7688 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:58:17.343449 7688 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:46183
I20260811 00:58:17.343487 7796 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:46183 every 8 connection(s)
I20260811 00:58:17.343983 7688 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:58:17.345968 7797 sys_catalog.cc:263] Verifying existing consensus state
I20260811 00:58:17.346289 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 7688
I20260811 00:58:17.346657 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.1:37201
--local_ip_for_outbound_sockets=127.15.70.1
--tserver_master_addrs=127.15.70.62:46183
--webserver_port=37383
--webserver_interface=127.15.70.1
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:39343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 00:58:17.346961 7797 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729: Bootstrap starting.
I20260811 00:58:17.359375 7797 log.cc:824] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729: Log is configured to *not* fsync() on all Append() calls
I20260811 00:58:17.362182 7797 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 00:58:17.362571 7797 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729: Bootstrap complete.
I20260811 00:58:17.365648 7797 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b87d21591ba4a08b98dd450617ac729" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 46183 } }
I20260811 00:58:17.365937 7797 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b87d21591ba4a08b98dd450617ac729, State: Initialized, Role: FOLLOWER
I20260811 00:58:17.366183 7797 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b87d21591ba4a08b98dd450617ac729" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 46183 } }
I20260811 00:58:17.366295 7797 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:58:17.366359 7797 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:58:17.366425 7797 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [term 2 FOLLOWER]: Advancing to term 3
I20260811 00:58:17.367707 7797 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b87d21591ba4a08b98dd450617ac729" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 46183 } }
I20260811 00:58:17.367843 7797 leader_election.cc:302] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3b87d21591ba4a08b98dd450617ac729; no voters:
I20260811 00:58:17.368113 7797 leader_election.cc:288] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 00:58:17.368167 7803 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 00:58:17.368304 7803 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [term 3 LEADER]: Becoming Leader. State: Replica: 3b87d21591ba4a08b98dd450617ac729, State: Running, Role: LEADER
I20260811 00:58:17.368460 7797 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:58:17.368445 7803 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b87d21591ba4a08b98dd450617ac729" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 46183 } }
I20260811 00:58:17.368772 7805 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "3b87d21591ba4a08b98dd450617ac729" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b87d21591ba4a08b98dd450617ac729" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 46183 } } }
I20260811 00:58:17.368865 7805 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [sys.catalog]: This master's current role is: LEADER
I20260811 00:58:17.368762 7803 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3b87d21591ba4a08b98dd450617ac729. Latest consensus state: current_term: 3 leader_uuid: "3b87d21591ba4a08b98dd450617ac729" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b87d21591ba4a08b98dd450617ac729" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 46183 } } }
I20260811 00:58:17.369078 7803 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b87d21591ba4a08b98dd450617ac729 [sys.catalog]: This master's current role is: LEADER
I20260811 00:58:17.369515 7807 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:58:17.370563 7807 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:58:17.370677 7807 catalog_manager.cc:1259] Loaded cluster ID: df22a5d80f1b4d08b3239a02d1ef2b43
I20260811 00:58:17.370707 7807 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260811 00:58:17.371126 7807 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f00d578a9ad google::LogMessage::Fail() at ??:0
@ 0x7f00d578d88a google::LogMessage::SendToLog() at ??:0
@ 0x7f00d578a4de google::LogMessage::Flush() at ??:0
@ 0x7f00d578ba19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f00dd6ab0f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f00dd6b48b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f00d76580d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f00d764d954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f00d84b16db start_thread at ??:0
@ 0x7f00d428861f clone at ??:0
W20260811 00:58:17.487406 7801 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:58:17.487804 7801 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:58:17.487852 7801 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:58:17.490289 7801 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:58:17.490401 7801 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:58:17.490465 7801 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.1
I20260811 00:58:17.493557 7801 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:39343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.1:37201
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.70.1
--webserver_port=37383
--tserver_master_addrs=127.15.70.62:46183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7801
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.1
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:58:17.493975 7801 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:58:17.494349 7801 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:58:17.501328 7848 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:17.501329 7851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:17.501328 7847 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:58:17.501685 7801 server_base.cc:1034] running on GCE node
I20260811 00:58:17.501946 7801 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:58:17.502254 7801 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:58:17.503449 7801 hybrid_clock.cc:648] HybridClock initialized: now 1786409897503424 us; error 41 us; skew 500 ppm
Aug 11 00:58:17 dist-test-slave-h3ft krb5kdc[6036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409897, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:58:17.506760 7801 init.cc:377] Logged in from keytab as kudu/127.15.70.1@KRBTEST.COM (short username kudu)
I20260811 00:58:17.507387 7801 webserver.cc:460] Webserver started at http://127.15.70.1:37383/ using document root <none> and password file <none>
I20260811 00:58:17.507694 7801 fs_manager.cc:359] Metadata directory not provided
I20260811 00:58:17.507771 7801 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:58:17.509486 7801 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:58:17.510471 7860 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:17.510751 7801 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:58:17.510936 7801 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/wal
uuid: "5d4bc33892e24811affc6c81a15a475c"
format_stamp: "Formatted at 2026-08-11 00:58:15 on dist-test-slave-h3ft"
server_key: "42af9eea768a2f09b5cd1a140b153005"
server_key_iv: "6e83331b7a1ddbfe691a8b13fcbb4c0e"
server_key_version: "encryptionkey@0"
I20260811 00:58:17.511545 7801 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:58:17.519403 7801 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:58:17.522217 7801 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:58:17.522457 7801 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:58:17.522791 7801 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:58:17.523463 7868 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 00:58:17.525943 7801 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 00:58:17.526055 7801 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.003s user 0.000s sys 0.000s
I20260811 00:58:17.526109 7801 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 00:58:17.526961 7801 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 00:58:17.527071 7801 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.001s
I20260811 00:58:17.527148 7868 tablet_bootstrap.cc:492] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c: Bootstrap starting.
I20260811 00:58:17.536334 7801 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.1:37201
I20260811 00:58:17.536655 8033 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.1:37201 every 8 connection(s)
I20260811 00:58:17.536937 7801 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
I20260811 00:58:17.541191 7868 log.cc:824] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c: Log is configured to *not* fsync() on all Append() calls
I20260811 00:58:17.544727 7868 tablet_bootstrap.cc:492] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 00:58:17.545126 7868 tablet_bootstrap.cc:492] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c: Bootstrap complete.
I20260811 00:58:17.546591 7868 ts_tablet_manager.cc:1397] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.014s
I20260811 00:58:17.546690 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 7801
I20260811 00:58:17.547125 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.2:32805
--local_ip_for_outbound_sockets=127.15.70.2
--tserver_master_addrs=127.15.70.62:46183
--webserver_port=33217
--webserver_interface=127.15.70.2
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:39343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 00:58:17.548395 7868 raft_consensus.cc:348] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcece0cc2eb743b9938498213589d5ea" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 32805 } } peers { permanent_uuid: "5fc653f496e946b19a0c51b54534498b" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35423 } } peers { permanent_uuid: "5d4bc33892e24811affc6c81a15a475c" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37201 } }
I20260811 00:58:17.548786 7868 raft_consensus.cc:729] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d4bc33892e24811affc6c81a15a475c, State: Initialized, Role: FOLLOWER
I20260811 00:58:17.548959 7868 consensus_queue.cc:260] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcece0cc2eb743b9938498213589d5ea" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 32805 } } peers { permanent_uuid: "5fc653f496e946b19a0c51b54534498b" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35423 } } peers { permanent_uuid: "5d4bc33892e24811affc6c81a15a475c" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37201 } }
I20260811 00:58:17.549322 7868 ts_tablet_manager.cc:1428] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c: Time spent starting tablet: real 0.003s user 0.004s sys 0.002s
W20260811 00:58:17.655519 8039 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:58:17.655884 8039 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:58:17.655938 8039 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:58:17.657686 8039 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:58:17.657763 8039 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:58:17.657814 8039 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.2
W20260811 00:58:17.657882 8036 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:58:17.537909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.1:49315)
0811 00:58:17.538129 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:17.538188 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:17.538764 (+ 576us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:17.657574 (+118810us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":119,"threads_started":1}
W20260811 00:58:17.658234 8034 heartbeater.cc:644] Failed to heartbeat to 127.15.70.62:46183 (0 consecutive failures): Network error: Failed to ping master at 127.15.70.62:46183: Client connection negotiation failed: client connection to 127.15.70.62:46183: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 00:58:17.658723 8036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:17.658560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.1:58631)
0811 00:58:17.658630 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:17.658692 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260811 00:58:17.659090 8036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:17.658966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.1:43405)
0811 00:58:17.659037 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:17.659068 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260811 00:58:17.659236 8034 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 00:58:17.660676 8039 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:39343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.2:32805
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.70.2
--webserver_port=33217
--tserver_master_addrs=127.15.70.62:46183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8039
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.2
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:58:17.661036 8039 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:58:17.661360 8039 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:58:17.667760 8054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:17.667775 8051 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:58:17.667979 8039 server_base.cc:1034] running on GCE node
W20260811 00:58:17.667773 8049 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:58:17.668305 8039 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:58:17.668663 8039 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:58:17.669828 8039 hybrid_clock.cc:648] HybridClock initialized: now 1786409897669807 us; error 42 us; skew 500 ppm
Aug 11 00:58:17 dist-test-slave-h3ft krb5kdc[6036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409897, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:58:17.673054 8039 init.cc:377] Logged in from keytab as kudu/127.15.70.2@KRBTEST.COM (short username kudu)
I20260811 00:58:17.673627 8039 webserver.cc:460] Webserver started at http://127.15.70.2:33217/ using document root <none> and password file <none>
I20260811 00:58:17.673943 8039 fs_manager.cc:359] Metadata directory not provided
I20260811 00:58:17.674029 8039 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:58:17.675758 8039 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 00:58:17.676651 8066 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:17.676874 8039 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 00:58:17.677038 8039 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/wal
uuid: "fcece0cc2eb743b9938498213589d5ea"
format_stamp: "Formatted at 2026-08-11 00:58:15 on dist-test-slave-h3ft"
server_key: "ef1a1cfdddf9bd5a9178cbc90ee9c5c9"
server_key_iv: "a07a848d6724745b3f2ca00544a05741"
server_key_version: "encryptionkey@0"
I20260811 00:58:17.677479 8039 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:58:17.686605 8039 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:58:17.689507 8039 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:58:17.689733 8039 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:58:17.690055 8039 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:58:17.690451 8039 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:58:17.690515 8039 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:17.690564 8039 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:58:17.690595 8039 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:17.698786 8039 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.2:32805
I20260811 00:58:17.698843 8241 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.2:32805 every 8 connection(s)
I20260811 00:58:17.699368 8039 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
I20260811 00:58:17.700717 8246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:17.700216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.2:60101)
0811 00:58:17.700404 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:17.700530 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":76,"threads_started":1}
W20260811 00:58:17.701208 8242 heartbeater.cc:644] Failed to heartbeat to 127.15.70.62:46183 (0 consecutive failures): Network error: Failed to ping master at 127.15.70.62:46183: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
I20260811 00:58:17.701536 8246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:17.701418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.2:43311)
0811 00:58:17.701464 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:17.701515 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 00:58:17.701788 8246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:17.701735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.2:57493)
0811 00:58:17.701757 (+ 22us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:17.701776 (+ 19us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":12}
W20260811 00:58:17.701900 8242 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 00:58:17.702503 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 8039
I20260811 00:58:17.702809 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.3:35423
--local_ip_for_outbound_sockets=127.15.70.3
--tserver_master_addrs=127.15.70.62:46183
--webserver_port=41339
--webserver_interface=127.15.70.3
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:39343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:58:17.807246 8247 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:58:17.807546 8247 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:58:17.807576 8247 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:58:17.808911 8247 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:58:17.808964 8247 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:58:17.808996 8247 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.3
I20260811 00:58:17.810782 8247 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:39343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.3:35423
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.70.3
--webserver_port=41339
--tserver_master_addrs=127.15.70.62:46183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8247
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.3
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:58:17.811112 8247 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:58:17.811391 8247 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:58:17.817873 8257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:17.817836 8254 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:17.817839 8255 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:58:17.818080 8247 server_base.cc:1034] running on GCE node
I20260811 00:58:17.818312 8247 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:58:17.818668 8247 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:58:17.819834 8247 hybrid_clock.cc:648] HybridClock initialized: now 1786409897819809 us; error 42 us; skew 500 ppm
Aug 11 00:58:17 dist-test-slave-h3ft krb5kdc[6036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409897, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:58:17.823083 8247 init.cc:377] Logged in from keytab as kudu/127.15.70.3@KRBTEST.COM (short username kudu)
I20260811 00:58:17.823715 8247 webserver.cc:460] Webserver started at http://127.15.70.3:41339/ using document root <none> and password file <none>
I20260811 00:58:17.823971 8247 fs_manager.cc:359] Metadata directory not provided
I20260811 00:58:17.824019 8247 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:58:17.825702 8247 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:58:17.826437 8266 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:17.826663 8247 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:58:17.826750 8247 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/wal
uuid: "5fc653f496e946b19a0c51b54534498b"
format_stamp: "Formatted at 2026-08-11 00:58:15 on dist-test-slave-h3ft"
server_key: "6111d7ce715deb85ac0212bbdaa30137"
server_key_iv: "1fce408e1217bf3f44c14a68b096385f"
server_key_version: "encryptionkey@0"
I20260811 00:58:17.827343 8247 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:58:17.848299 8247 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:58:17.852030 8247 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:58:17.852191 8247 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:58:17.852450 8247 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:58:17.852813 8247 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:58:17.852857 8247 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:17.852885 8247 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:58:17.852900 8247 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:17.860935 8247 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.3:35423
I20260811 00:58:17.861198 8440 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.3:35423 every 8 connection(s)
I20260811 00:58:17.861491 8247 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
I20260811 00:58:17.863317 8444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:17.862587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.3:44381)
0811 00:58:17.862812 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:17.862981 (+ 169us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":104,"threads_started":1}
W20260811 00:58:17.863938 8441 heartbeater.cc:644] Failed to heartbeat to 127.15.70.62:46183 (0 consecutive failures): Network error: Failed to ping master at 127.15.70.62:46183: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
I20260811 00:58:17.864423 8444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:17.864228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.3:36063)
0811 00:58:17.864332 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:17.864388 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260811 00:58:17.865077 8444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:17.864827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.3:58935)
0811 00:58:17.864878 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:17.865047 (+ 169us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 00:58:17.865257 8441 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 00:58:17.871587 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 8247
I20260811 00:58:18.660223 8447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:18.659734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.1:53501)
0811 00:58:18.660013 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:18.660104 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":87,"threads_started":1}
I20260811 00:58:18.702677 8449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:18.702367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.2:36727)
0811 00:58:18.702550 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:18.702608 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":101,"threads_started":1}
I20260811 00:58:18.866159 8451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:18.865690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.3:52633)
0811 00:58:18.865922 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:18.866019 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":71,"threads_started":1}
I20260811 00:58:18.914489 8453 raft_consensus.cc:482] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:58:18.914706 8453 raft_consensus.cc:504] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcece0cc2eb743b9938498213589d5ea" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 32805 } } peers { permanent_uuid: "5fc653f496e946b19a0c51b54534498b" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35423 } } peers { permanent_uuid: "5d4bc33892e24811affc6c81a15a475c" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37201 } }
I20260811 00:58:18.915243 8453 leader_election.cc:288] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcece0cc2eb743b9938498213589d5ea (127.15.70.2:32805), 5fc653f496e946b19a0c51b54534498b (127.15.70.3:35423)
Aug 11 00:58:18 dist-test-slave-h3ft krb5kdc[6036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409897, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for kudu/127.15.70.2@KRBTEST.COM
Aug 11 00:58:18 dist-test-slave-h3ft krb5kdc[6036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409897, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for kudu/127.15.70.3@KRBTEST.COM
I20260811 00:58:18.938252 8454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:18.915636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.2:32805 (local address 127.15.70.1:38163)
0811 00:58:18.915909 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:18.915921 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:18.915969 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:18.917230 (+ 1261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:18.917231 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:18.917821 (+ 590us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:58:18.918148 (+ 327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:18.918157 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:18.920335 (+ 2178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:18.920336 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:18.921786 (+ 1450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:18.921790 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:18.922882 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:18.922883 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:18.923089 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:18.929926 (+ 6837us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:58:18.929942 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:58:18.932504 (+ 2562us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:58:18.935659 (+ 3155us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:18.935672 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:18.935675 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:18.936052 (+ 377us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:18.936504 (+ 452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:18.936505 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:18.936505 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:18.936724 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:18.937425 (+ 701us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:58:18.937434 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:58:18.937640 (+ 206us) client_negotiation.cc:769] Sending connection context
0811 00:58:18.937851 (+ 211us) client_negotiation.cc:240] Negotiation successful
0811 00:58:18.938120 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"mutex_wait_us":26,"thread_start_us":93,"threads_started":1}
I20260811 00:58:18.938366 8456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:18.915757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:38163 (local address 127.15.70.2:32805)
0811 00:58:18.916018 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:18.916027 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:18.916065 (+ 38us) server_negotiation.cc:407] Connection header received
0811 00:58:18.916785 (+ 720us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:18.916790 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:18.916870 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:18.917090 (+ 220us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:18.918366 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:18.920153 (+ 1787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:18.921910 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:18.922728 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:18.922882 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:18.932777 (+ 9895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:18.932787 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:18.932788 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:18.932813 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:18.935513 (+ 2700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:18.936195 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:18.936199 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:18.936199 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:18.936388 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:18.936823 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:18.936824 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:18.936825 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:18.937250 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:18.937332 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:18.937940 (+ 608us) server_negotiation.cc:299] Negotiation successful
0811 00:58:18.938192 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":74,"threads_started":1}
I20260811 00:58:18.938416 8455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:18.915673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:47739 (local address 127.15.70.3:35423)
0811 00:58:18.915890 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:18.915908 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:18.915966 (+ 58us) server_negotiation.cc:407] Connection header received
0811 00:58:18.916786 (+ 820us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:18.916790 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:18.916868 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:18.917090 (+ 222us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:18.918366 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:18.920153 (+ 1787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:18.921909 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:18.922728 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:18.922882 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:18.933212 (+ 10330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:18.933219 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:18.933219 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:18.933236 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:18.936199 (+ 2963us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:18.936773 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:18.936778 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:18.936779 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:18.936902 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:18.937177 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:18.937178 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:18.937179 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:18.937703 (+ 524us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:18.937822 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:18.938076 (+ 254us) server_negotiation.cc:299] Negotiation successful
0811 00:58:18.938271 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":77,"threads_started":1}
I20260811 00:58:18.938398 8447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:18.915478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:35423 (local address 127.15.70.1:47739)
0811 00:58:18.915527 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:18.915540 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:18.915644 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:18.917223 (+ 1579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:18.917227 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:18.917821 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:58:18.918148 (+ 327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:18.918157 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:18.920333 (+ 2176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:18.920335 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:18.921786 (+ 1451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:18.921790 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:18.922883 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:18.922884 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:18.923089 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:18.929926 (+ 6837us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:58:18.929942 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:58:18.932986 (+ 3044us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:58:18.936310 (+ 3324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:18.936311 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:18.936312 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:18.936592 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:18.936988 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:18.936989 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:18.936990 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:18.937062 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:18.937805 (+ 743us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:58:18.937806 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:58:18.937895 (+ 89us) client_negotiation.cc:769] Sending connection context
0811 00:58:18.937981 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 00:58:18.938220 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22,"mutex_wait_us":295}
W20260811 00:58:18.939853 7865 leader_election.cc:341] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fcece0cc2eb743b9938498213589d5ea (127.15.70.2:32805): Not found: Tablet not found: b15282f43dc54a10bf84b6da90cfe468
W20260811 00:58:18.940050 7861 leader_election.cc:341] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5fc653f496e946b19a0c51b54534498b (127.15.70.3:35423): Not found: Tablet not found: b15282f43dc54a10bf84b6da90cfe468
I20260811 00:58:18.940143 7861 leader_election.cc:302] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d4bc33892e24811affc6c81a15a475c; no voters: 5fc653f496e946b19a0c51b54534498b, fcece0cc2eb743b9938498213589d5ea
I20260811 00:58:18.940349 8453 raft_consensus.cc:2726] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 00:58:19.661572 8457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:19.661144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.1:59841)
0811 00:58:19.661414 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:19.661497 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":129,"threads_started":1}
I20260811 00:58:19.703784 8458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:19.703418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.2:48205)
0811 00:58:19.703635 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:19.703711 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":92,"threads_started":1}
I20260811 00:58:19.867501 8459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:19.866944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.3:47507)
0811 00:58:19.867228 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:19.867293 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":190,"threads_started":1}
I20260811 00:58:20.662847 8460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:20.662454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.1:50785)
0811 00:58:20.662694 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:20.662771 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":118,"threads_started":1}
I20260811 00:58:20.705026 8461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:20.704693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.2:33375)
0811 00:58:20.704874 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:20.704947 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":79,"threads_started":1}
I20260811 00:58:20.747841 8462 raft_consensus.cc:482] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:58:20.748003 8462 raft_consensus.cc:504] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcece0cc2eb743b9938498213589d5ea" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 32805 } } peers { permanent_uuid: "5fc653f496e946b19a0c51b54534498b" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35423 } } peers { permanent_uuid: "5d4bc33892e24811affc6c81a15a475c" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37201 } }
I20260811 00:58:20.748225 8462 leader_election.cc:288] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcece0cc2eb743b9938498213589d5ea (127.15.70.2:32805), 5fc653f496e946b19a0c51b54534498b (127.15.70.3:35423)
W20260811 00:58:20.748855 7865 leader_election.cc:341] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fcece0cc2eb743b9938498213589d5ea (127.15.70.2:32805): Not found: Tablet not found: b15282f43dc54a10bf84b6da90cfe468
W20260811 00:58:20.748996 7861 leader_election.cc:341] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5fc653f496e946b19a0c51b54534498b (127.15.70.3:35423): Not found: Tablet not found: b15282f43dc54a10bf84b6da90cfe468
I20260811 00:58:20.749116 7861 leader_election.cc:302] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d4bc33892e24811affc6c81a15a475c; no voters: 5fc653f496e946b19a0c51b54534498b, fcece0cc2eb743b9938498213589d5ea
I20260811 00:58:20.749212 8462 raft_consensus.cc:2726] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 00:58:20.868813 8463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:20.868432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.3:47893)
0811 00:58:20.868661 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:20.868718 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":125,"threads_started":1}
I20260811 00:58:21.663861 8464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:21.663503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.1:48417)
0811 00:58:21.663755 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:21.663802 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":134,"threads_started":1}
I20260811 00:58:21.705971 8465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:21.705595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.2:59459)
0811 00:58:21.705788 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:21.705845 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":80,"threads_started":1}
I20260811 00:58:21.870082 8466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:21.869719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.3:54323)
0811 00:58:21.869953 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:21.870018 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":122,"threads_started":1}
I20260811 00:58:22.664887 8472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:22.664552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.1:47975)
0811 00:58:22.664740 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:22.664817 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":75,"threads_started":1}
I20260811 00:58:22.707152 8474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:22.706682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.2:55881)
0811 00:58:22.706938 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:22.707082 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":113,"threads_started":1}
I20260811 00:58:22.871186 8477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:22.870801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.3:41081)
0811 00:58:22.870979 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:22.871114 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":82,"threads_started":1}
I20260811 00:58:22.983592 8478 raft_consensus.cc:482] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:58:22.983754 8478 raft_consensus.cc:504] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcece0cc2eb743b9938498213589d5ea" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 32805 } } peers { permanent_uuid: "5fc653f496e946b19a0c51b54534498b" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35423 } } peers { permanent_uuid: "5d4bc33892e24811affc6c81a15a475c" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37201 } }
I20260811 00:58:22.984071 8478 leader_election.cc:288] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcece0cc2eb743b9938498213589d5ea (127.15.70.2:32805), 5fc653f496e946b19a0c51b54534498b (127.15.70.3:35423)
W20260811 00:58:22.984939 7861 leader_election.cc:341] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5fc653f496e946b19a0c51b54534498b (127.15.70.3:35423): Not found: Tablet not found: b15282f43dc54a10bf84b6da90cfe468
W20260811 00:58:22.985112 7865 leader_election.cc:341] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fcece0cc2eb743b9938498213589d5ea (127.15.70.2:32805): Not found: Tablet not found: b15282f43dc54a10bf84b6da90cfe468
I20260811 00:58:22.985153 7861 leader_election.cc:302] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d4bc33892e24811affc6c81a15a475c; no voters: 5fc653f496e946b19a0c51b54534498b, fcece0cc2eb743b9938498213589d5ea
I20260811 00:58:22.985285 8478 raft_consensus.cc:2726] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 00:58:23.666054 8479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:23.665735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.1:55337)
0811 00:58:23.665913 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:23.665981 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":80,"threads_started":1}
I20260811 00:58:23.708179 8480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:23.707841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.2:43841)
0811 00:58:23.708053 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:23.708120 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":100,"threads_started":1}
I20260811 00:58:23.872280 8481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:23.871895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.3:33737)
0811 00:58:23.872144 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:23.872214 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":99,"threads_started":1}
I20260811 00:58:24.666983 8482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:24.666672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.1:45671)
0811 00:58:24.666855 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:24.666911 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":89,"threads_started":1}
I20260811 00:58:24.709372 8484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:24.709006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.2:36337)
0811 00:58:24.709219 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:24.709274 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":102,"threads_started":1}
I20260811 00:58:24.873484 8485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:24.873033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.3:46259)
0811 00:58:24.873328 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:24.873395 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":131,"threads_started":1}
I20260811 00:58:25.668082 8486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:25.667754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.1:37981)
0811 00:58:25.667961 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:25.668009 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":89,"threads_started":1}
I20260811 00:58:25.710685 8488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:25.710360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.2:58499)
0811 00:58:25.710560 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:25.710599 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":131,"threads_started":1}
I20260811 00:58:25.874444 8490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:25.874138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.3:57893)
0811 00:58:25.874324 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:25.874372 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":102,"threads_started":1}
I20260811 00:58:26.669176 8491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:26.668804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.1:53791)
0811 00:58:26.669039 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:26.669099 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":120,"threads_started":1}
I20260811 00:58:26.711884 8492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:26.711465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.2:46465)
0811 00:58:26.711751 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:26.711822 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":137,"threads_started":1}
I20260811 00:58:26.875406 8493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:26.875070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.3:42987)
0811 00:58:26.875273 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:26.875336 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":81,"threads_started":1}
I20260811 00:58:27.103382 8494 raft_consensus.cc:482] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:58:27.103585 8494 raft_consensus.cc:504] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcece0cc2eb743b9938498213589d5ea" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 32805 } } peers { permanent_uuid: "5fc653f496e946b19a0c51b54534498b" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35423 } } peers { permanent_uuid: "5d4bc33892e24811affc6c81a15a475c" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 37201 } }
I20260811 00:58:27.104146 8494 leader_election.cc:288] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcece0cc2eb743b9938498213589d5ea (127.15.70.2:32805), 5fc653f496e946b19a0c51b54534498b (127.15.70.3:35423)
W20260811 00:58:27.104527 7865 leader_election.cc:341] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fcece0cc2eb743b9938498213589d5ea (127.15.70.2:32805): Not found: Tablet not found: b15282f43dc54a10bf84b6da90cfe468
W20260811 00:58:27.104614 7861 leader_election.cc:341] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5fc653f496e946b19a0c51b54534498b (127.15.70.3:35423): Not found: Tablet not found: b15282f43dc54a10bf84b6da90cfe468
I20260811 00:58:27.104647 7861 leader_election.cc:302] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d4bc33892e24811affc6c81a15a475c; no voters: 5fc653f496e946b19a0c51b54534498b, fcece0cc2eb743b9938498213589d5ea
I20260811 00:58:27.104763 8494 raft_consensus.cc:2726] T b15282f43dc54a10bf84b6da90cfe468 P 5d4bc33892e24811affc6c81a15a475c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 00:58:27.670383 8495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:27.670016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.1:58421)
0811 00:58:27.670230 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:27.670310 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":90,"threads_started":1}
I20260811 00:58:27.713030 8496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:27.712697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.2:38107)
0811 00:58:27.712908 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:27.712973 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":104,"threads_started":1}
I20260811 00:58:27.876542 8497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:27.876216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.3:49605)
0811 00:58:27.876382 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:27.876450 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":100,"threads_started":1}
I20260811 00:58:28.671535 8500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:28.671207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.1:57621)
0811 00:58:28.671405 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:28.671478 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":87,"threads_started":1}
I20260811 00:58:28.714291 8501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:28.713828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.2:35681)
0811 00:58:28.714118 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:28.714191 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":103,"threads_started":1}
I20260811 00:58:28.877424 8503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:28.877153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.3:41219)
0811 00:58:28.877322 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:28.877359 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":103,"threads_started":1}
I20260811 00:58:29.672555 8504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:29.672241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.1:39169)
0811 00:58:29.672438 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:29.672500 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":94,"threads_started":1}
I20260811 00:58:29.715477 8505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:29.715144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.2:47509)
0811 00:58:29.715348 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:29.715403 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":129,"threads_started":1}
I20260811 00:58:29.878571 8506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:29.878188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.3:60893)
0811 00:58:29.878435 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:29.878509 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":104,"threads_started":1}
I20260811 00:58:30.673938 8507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:30.673449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.1:37571)
0811 00:58:30.673758 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:30.673835 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":120,"threads_started":1}
I20260811 00:58:30.716787 8508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:30.716448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.2:40771)
0811 00:58:30.716666 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:30.716714 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":139,"threads_started":1}
I20260811 00:58:30.880064 8519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:30.879601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.3:39239)
0811 00:58:30.879835 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:30.879951 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":115,"threads_started":1}
I20260811 00:58:31.675140 8520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:31.674691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.1:33581)
0811 00:58:31.674940 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:31.675062 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":124,"threads_started":1}
I20260811 00:58:31.717851 8521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:31.717434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.2:56929)
0811 00:58:31.717684 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:31.717761 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":100,"threads_started":1}
I20260811 00:58:31.881243 8522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:31.880861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.3:33269)
0811 00:58:31.881086 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:31.881159 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":117,"threads_started":1}
I20260811 00:58:32.676265 8523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:32.675918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.1:56937)
0811 00:58:32.676143 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:32.676210 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":84,"threads_started":1}
I20260811 00:58:32.719084 8524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:32.718618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.2:48243)
0811 00:58:32.718874 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:32.718966 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":171,"threads_started":1}
I20260811 00:58:32.878885 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 7801
I20260811 00:58:32.920459 8525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:32.920059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46183 (local address 127.15.70.3:46705)
0811 00:58:32.920303 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:32.920375 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:46183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":90,"threads_started":1}
I20260811 00:58:32.926836 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 8039
I20260811 00:58:32.953122 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 8247
2026-08-11T00:58:32Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19605 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:58:33 dist-test-slave-h3ft krb5kdc[8530](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:58:33 dist-test-slave-h3ft krb5kdc[8530](info): set up 2 sockets
Aug 11 00:58:33 dist-test-slave-h3ft krb5kdc[8530](info): commencing operation
krb5kdc: starting...
W20260811 00:58:34.343899 15640 mini_kdc.cc:121] Time spent starting KDC: real 1.351s user 0.008s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Aug 11 00:58:34 dist-test-slave-h3ft krb5kdc[8530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409914, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:58:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:58:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.70.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
I20260811 00:58:34.503901 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:39031
--webserver_interface=127.15.70.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:46229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:39031
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:58:34.600100 8550 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:58:34.600371 8550 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:58:34.600395 8550 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:58:34.601739 8550 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 00:58:34.601795 8550 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 00:58:34.601809 8550 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 00:58:34.601820 8550 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:58:34.601835 8550 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:58:34.601848 8550 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:58:34.601861 8550 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:58:34.601928 8550 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:58:34.603693 8550 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:46229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:39031
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:39031
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8550
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:58:34.604060 8550 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:58:34.604387 8550 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:58:34.610414 8558 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:34.610440 8562 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:34.610460 8557 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:58:34.610808 8550 server_base.cc:1034] running on GCE node
I20260811 00:58:34.611181 8550 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:58:34.611580 8550 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:58:34.612794 8550 hybrid_clock.cc:648] HybridClock initialized: now 1786409914612774 us; error 59 us; skew 500 ppm
Aug 11 00:58:34 dist-test-slave-h3ft krb5kdc[8530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409914, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:58:34.616009 8550 init.cc:377] Logged in from keytab as kudu/127.15.70.62@KRBTEST.COM (short username kudu)
I20260811 00:58:34.616533 8550 webserver.cc:460] Webserver started at http://127.15.70.62:41265/ using document root <none> and password file <none>
I20260811 00:58:34.616823 8550 fs_manager.cc:359] Metadata directory not provided
I20260811 00:58:34.616892 8550 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:58:34.617048 8550 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:58:34.618239 8550 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "9509e9d198ab43748599b0b69444812f"
format_stamp: "Formatted at 2026-08-11 00:58:34 on dist-test-slave-h3ft"
server_key: "7dc897b60d7cd2bd54e8c7e8bf7a34cf"
server_key_iv: "ab85e0805fc7a6e771aa91c973b6eea7"
server_key_version: "encryptionkey@0"
I20260811 00:58:34.618629 8550 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "9509e9d198ab43748599b0b69444812f"
format_stamp: "Formatted at 2026-08-11 00:58:34 on dist-test-slave-h3ft"
server_key: "7dc897b60d7cd2bd54e8c7e8bf7a34cf"
server_key_iv: "ab85e0805fc7a6e771aa91c973b6eea7"
server_key_version: "encryptionkey@0"
I20260811 00:58:34.620288 8550 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 00:58:34.621377 8572 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:34.621634 8550 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:58:34.621790 8550 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "9509e9d198ab43748599b0b69444812f"
format_stamp: "Formatted at 2026-08-11 00:58:34 on dist-test-slave-h3ft"
server_key: "7dc897b60d7cd2bd54e8c7e8bf7a34cf"
server_key_iv: "ab85e0805fc7a6e771aa91c973b6eea7"
server_key_version: "encryptionkey@0"
I20260811 00:58:34.621879 8550 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:58:34.631778 8550 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:58:34.634297 8550 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:58:34.634479 8550 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:58:34.639449 8550 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:39031
I20260811 00:58:34.639525 8652 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:39031 every 8 connection(s)
I20260811 00:58:34.639957 8550 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:58:34.641189 8653 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:58:34.641316 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 8550
I20260811 00:58:34.641453 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 00:58:34.641712 15640 external_mini_cluster.cc:1428] Setting key 57e2bd9c2756f8977ec2edc295501ee5
I20260811 00:58:34.645886 8653 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f: Bootstrap starting.
I20260811 00:58:34.646709 8653 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f: Neither blocks nor log segments found. Creating new log.
I20260811 00:58:34.647142 8653 log.cc:824] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f: Log is configured to *not* fsync() on all Append() calls
I20260811 00:58:34.648202 8653 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f: No bootstrap required, opened a new log
Aug 11 00:58:34 dist-test-slave-h3ft krb5kdc[8530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409914, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:58:34.651532 8653 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9509e9d198ab43748599b0b69444812f" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 39031 } }
I20260811 00:58:34.651793 8653 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:58:34.651842 8653 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9509e9d198ab43748599b0b69444812f, State: Initialized, Role: FOLLOWER
I20260811 00:58:34.652047 8653 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9509e9d198ab43748599b0b69444812f" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 39031 } }
I20260811 00:58:34.652148 8653 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:58:34.652177 8653 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:58:34.652259 8653 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:58:34.653086 8653 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9509e9d198ab43748599b0b69444812f" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 39031 } }
I20260811 00:58:34.653195 8653 leader_election.cc:302] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9509e9d198ab43748599b0b69444812f; no voters:
I20260811 00:58:34.653502 8653 leader_election.cc:288] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:58:34.653606 8658 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:58:34.653870 8653 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:58:34.653903 8658 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [term 1 LEADER]: Becoming Leader. State: Replica: 9509e9d198ab43748599b0b69444812f, State: Running, Role: LEADER
I20260811 00:58:34.654238 8658 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9509e9d198ab43748599b0b69444812f" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 39031 } }
I20260811 00:58:34.655154 8659 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9509e9d198ab43748599b0b69444812f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9509e9d198ab43748599b0b69444812f" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 39031 } } }
I20260811 00:58:34.655274 8659 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [sys.catalog]: This master's current role is: LEADER
I20260811 00:58:34.655519 8661 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9509e9d198ab43748599b0b69444812f. Latest consensus state: current_term: 1 leader_uuid: "9509e9d198ab43748599b0b69444812f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9509e9d198ab43748599b0b69444812f" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 39031 } } }
I20260811 00:58:34.655596 8661 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [sys.catalog]: This master's current role is: LEADER
W20260811 00:58:34.656606 8681 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260811 00:58:34.656674 8656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:34.642460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50302 (local address 127.15.70.62:39031)
0811 00:58:34.642708 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:34.642718 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:34.642756 (+ 38us) server_negotiation.cc:407] Connection header received
0811 00:58:34.643461 (+ 705us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:34.643470 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:34.643533 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:34.643698 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:34.644789 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:34.645925 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:34.646939 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:34.647645 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:34.647829 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:34.651071 (+ 3242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:34.651077 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:34.651077 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:34.651115 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:34.653710 (+ 2595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:34.654294 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:34.654298 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:34.654298 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:34.654510 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:34.654816 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:34.654817 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:34.654818 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:34.655272 (+ 454us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:34.656136 (+ 864us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:34.656220 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 00:58:34.656413 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":106,"threads_started":1}
W20260811 00:58:34.656679 8681 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 00:58:34.656867 8674 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:58:34.657078 8674 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:58:34.659062 8674 catalog_manager.cc:1347] Generated new cluster ID: 7a5218987da242da8ca6ae14f659992b
I20260811 00:58:34.659153 8674 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:58:34.673116 8674 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:58:34.673837 8674 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:58:34.683840 8674 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f: Generated new TSK 0
I20260811 00:58:34.684141 8674 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.70.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab.
Entry for principal kudu/127.15.70.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab.
I20260811 00:58:34.731494 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.1:0
--local_ip_for_outbound_sockets=127.15.70.1
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:39031
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:46229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:58:34.846024 8689 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:58:34.846508 8689 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:58:34.846572 8689 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:58:34.848614 8689 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:58:34.848686 8689 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:58:34.848738 8689 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.1
I20260811 00:58:34.850874 8689 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:46229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:39031
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8689
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.1
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:58:34.851236 8689 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:58:34.851562 8689 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:58:34.858173 8695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:34.858057 8699 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:34.858083 8697 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:58:34.858712 8689 server_base.cc:1034] running on GCE node
I20260811 00:58:34.858994 8689 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:58:34.859376 8689 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:58:34.860582 8689 hybrid_clock.cc:648] HybridClock initialized: now 1786409914860530 us; error 90 us; skew 500 ppm
Aug 11 00:58:34 dist-test-slave-h3ft krb5kdc[8530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409914, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:58:34.864012 8689 init.cc:377] Logged in from keytab as kudu/127.15.70.1@KRBTEST.COM (short username kudu)
I20260811 00:58:34.864693 8689 webserver.cc:460] Webserver started at http://127.15.70.1:42501/ using document root <none> and password file <none>
I20260811 00:58:34.864979 8689 fs_manager.cc:359] Metadata directory not provided
I20260811 00:58:34.865054 8689 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:58:34.865243 8689 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:58:34.866627 8689 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/data/instance:
uuid: "47d4770dac934e05955dc1b823da0885"
format_stamp: "Formatted at 2026-08-11 00:58:34 on dist-test-slave-h3ft"
server_key: "e6834b4f76604ce4444eca51a55ff822"
server_key_iv: "8cf7919b5a0cc0580ce4eea79aecdf6c"
server_key_version: "encryptionkey@0"
I20260811 00:58:34.867146 8689 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance:
uuid: "47d4770dac934e05955dc1b823da0885"
format_stamp: "Formatted at 2026-08-11 00:58:34 on dist-test-slave-h3ft"
server_key: "e6834b4f76604ce4444eca51a55ff822"
server_key_iv: "8cf7919b5a0cc0580ce4eea79aecdf6c"
server_key_version: "encryptionkey@0"
I20260811 00:58:34.869601 8689 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 00:58:34.870736 8711 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:34.871147 8689 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:58:34.871301 8689 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/wal
uuid: "47d4770dac934e05955dc1b823da0885"
format_stamp: "Formatted at 2026-08-11 00:58:34 on dist-test-slave-h3ft"
server_key: "e6834b4f76604ce4444eca51a55ff822"
server_key_iv: "8cf7919b5a0cc0580ce4eea79aecdf6c"
server_key_version: "encryptionkey@0"
I20260811 00:58:34.871438 8689 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:58:34.886432 8689 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:58:34.889200 8689 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:58:34.889406 8689 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:58:34.889734 8689 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:58:34.890146 8689 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:58:34.890206 8689 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:34.890254 8689 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:58:34.890303 8689 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:34.897850 8689 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.1:41193
I20260811 00:58:34.897907 8887 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.1:41193 every 8 connection(s)
I20260811 00:58:34.898313 8689 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
I20260811 00:58:34.901785 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 8689
I20260811 00:58:34.901916 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance
I20260811 00:58:34.902168 15640 external_mini_cluster.cc:1428] Setting key cca961655c4a66ce6e64e07b8f75d208
Aug 11 00:58:34 dist-test-slave-h3ft krb5kdc[8530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409914, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:58:34.910856 8656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:34.899289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:56543 (local address 127.15.70.62:39031)
0811 00:58:34.899389 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:34.899391 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:34.899657 (+ 266us) server_negotiation.cc:407] Connection header received
0811 00:58:34.900317 (+ 660us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:34.900318 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:34.900333 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:34.900403 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:34.901574 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:34.902315 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:34.903649 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:34.903888 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:34.903984 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:34.906902 (+ 2918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:34.906904 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:34.906905 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:34.906915 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:34.908868 (+ 1953us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:34.909403 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:34.909405 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:34.909405 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:34.909487 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:34.909792 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:34.909793 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:34.909793 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:34.910028 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:34.910127 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:34.910541 (+ 414us) server_negotiation.cc:299] Negotiation successful
0811 00:58:34.910689 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 00:58:34.910981 8890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:34.899275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.1:56543)
0811 00:58:34.899501 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:34.899551 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:34.900183 (+ 632us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:34.900492 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:34.900496 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:34.901192 (+ 696us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:58:34.901441 (+ 249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:34.901447 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:34.902432 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:34.902433 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:34.903551 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:34.903555 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:34.904004 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:34.904005 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:34.904158 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:34.904873 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:58:34.904883 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:58:34.906775 (+ 1892us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:58:34.908995 (+ 2220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:34.909006 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:34.909010 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:34.909313 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:34.909568 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:34.909568 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:34.909569 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:34.909713 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:34.910133 (+ 420us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:58:34.910142 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:58:34.910356 (+ 214us) client_negotiation.cc:769] Sending connection context
0811 00:58:34.910497 (+ 141us) client_negotiation.cc:240] Negotiation successful
0811 00:58:34.910683 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":122,"threads_started":1}
I20260811 00:58:34.911777 8888 heartbeater.cc:347] Connected to a master server at 127.15.70.62:39031
I20260811 00:58:34.911939 8888 heartbeater.cc:464] Registering TS with master...
I20260811 00:58:34.912206 8888 heartbeater.cc:511] Master 127.15.70.62:39031 requested a full tablet report, sending...
I20260811 00:58:34.912983 8601 ts_manager.cc:194] Registered new tserver with Master: 47d4770dac934e05955dc1b823da0885 (127.15.70.1:41193)
I20260811 00:58:34.913751 8601 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.1@KRBTEST.COM'} at 127.15.70.1:56543
WARNING: no policy specified for kudu/127.15.70.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab.
Entry for principal kudu/127.15.70.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab.
I20260811 00:58:34.942991 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.2:0
--local_ip_for_outbound_sockets=127.15.70.2
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:39031
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:46229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:58:35.045348 8894 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:58:35.045629 8894 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:58:35.045657 8894 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:58:35.046838 8894 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:58:35.046875 8894 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:58:35.046903 8894 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.2
I20260811 00:58:35.048556 8894 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:46229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:39031
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8894
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.2
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:58:35.048792 8894 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:58:35.049027 8894 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:58:35.055222 8903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:35.055222 8904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:35.055222 8909 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:58:35.055601 8894 server_base.cc:1034] running on GCE node
I20260811 00:58:35.055932 8894 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:58:35.056205 8894 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:58:35.057376 8894 hybrid_clock.cc:648] HybridClock initialized: now 1786409915057361 us; error 42 us; skew 500 ppm
Aug 11 00:58:35 dist-test-slave-h3ft krb5kdc[8530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409915, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:58:35.061045 8894 init.cc:377] Logged in from keytab as kudu/127.15.70.2@KRBTEST.COM (short username kudu)
I20260811 00:58:35.061712 8894 webserver.cc:460] Webserver started at http://127.15.70.2:33831/ using document root <none> and password file <none>
I20260811 00:58:35.062016 8894 fs_manager.cc:359] Metadata directory not provided
I20260811 00:58:35.062068 8894 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:58:35.062280 8894 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:58:35.063750 8894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/data/instance:
uuid: "57adc460061b47c8802f20d2e535033a"
format_stamp: "Formatted at 2026-08-11 00:58:35 on dist-test-slave-h3ft"
server_key: "a59ef882d87d6c4675657d577785e4fc"
server_key_iv: "f4fdcc9623c70d5e6efb1f1e88e8090c"
server_key_version: "encryptionkey@0"
I20260811 00:58:35.064205 8894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance:
uuid: "57adc460061b47c8802f20d2e535033a"
format_stamp: "Formatted at 2026-08-11 00:58:35 on dist-test-slave-h3ft"
server_key: "a59ef882d87d6c4675657d577785e4fc"
server_key_iv: "f4fdcc9623c70d5e6efb1f1e88e8090c"
server_key_version: "encryptionkey@0"
I20260811 00:58:35.066026 8894 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 00:58:35.067183 8921 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:35.067447 8894 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:58:35.067603 8894 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/wal
uuid: "57adc460061b47c8802f20d2e535033a"
format_stamp: "Formatted at 2026-08-11 00:58:35 on dist-test-slave-h3ft"
server_key: "a59ef882d87d6c4675657d577785e4fc"
server_key_iv: "f4fdcc9623c70d5e6efb1f1e88e8090c"
server_key_version: "encryptionkey@0"
I20260811 00:58:35.067718 8894 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:58:35.102663 8894 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:58:35.106036 8894 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:58:35.106287 8894 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:58:35.106632 8894 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:58:35.107141 8894 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:58:35.107205 8894 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:35.107257 8894 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:58:35.107285 8894 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:35.114759 8894 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.2:46601
I20260811 00:58:35.114809 9101 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.2:46601 every 8 connection(s)
I20260811 00:58:35.115293 8894 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
I20260811 00:58:35.122287 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 8894
I20260811 00:58:35.122406 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance
I20260811 00:58:35.122650 15640 external_mini_cluster.cc:1428] Setting key 8fb4d2a8f257466c5f4f577d5dafced6
Aug 11 00:58:35 dist-test-slave-h3ft krb5kdc[8530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409915, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:58:35.128705 8656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:35.116361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:32889 (local address 127.15.70.62:39031)
0811 00:58:35.116457 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:35.116460 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:35.116749 (+ 289us) server_negotiation.cc:407] Connection header received
0811 00:58:35.117383 (+ 634us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:35.117384 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:35.117397 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:35.117468 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:35.118650 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:35.119415 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:35.120561 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:35.120773 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:35.120841 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:35.123967 (+ 3126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:35.123968 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:35.123969 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:35.123979 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:35.126641 (+ 2662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:35.127251 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:35.127252 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:35.127253 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:35.127425 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:35.127779 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:35.127780 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:35.127780 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:35.127965 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:35.128053 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:35.128434 (+ 381us) server_negotiation.cc:299] Negotiation successful
0811 00:58:35.128549 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 00:58:35.128806 9105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:35.116328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.2:32889)
0811 00:58:35.116571 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:35.116618 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:35.117234 (+ 616us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:35.117564 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:35.117568 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:35.118269 (+ 701us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:58:35.118542 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:35.118548 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:35.119522 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:35.119524 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:35.120442 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:35.120445 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:35.120896 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:35.120898 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:35.121045 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:35.121804 (+ 759us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:58:35.121815 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:58:35.123857 (+ 2042us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:58:35.126750 (+ 2893us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:35.126760 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:35.126763 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:35.127170 (+ 407us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:35.127546 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:35.127547 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:35.127547 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:35.127693 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:35.128091 (+ 398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:58:35.128099 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:58:35.128273 (+ 174us) client_negotiation.cc:769] Sending connection context
0811 00:58:35.128379 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 00:58:35.128548 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":128,"threads_started":1}
I20260811 00:58:35.129487 9102 heartbeater.cc:347] Connected to a master server at 127.15.70.62:39031
I20260811 00:58:35.129665 9102 heartbeater.cc:464] Registering TS with master...
I20260811 00:58:35.129915 9102 heartbeater.cc:511] Master 127.15.70.62:39031 requested a full tablet report, sending...
I20260811 00:58:35.130505 8601 ts_manager.cc:194] Registered new tserver with Master: 57adc460061b47c8802f20d2e535033a (127.15.70.2:46601)
I20260811 00:58:35.131141 8601 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.2@KRBTEST.COM'} at 127.15.70.2:32889
WARNING: no policy specified for kudu/127.15.70.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab.
Entry for principal kudu/127.15.70.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab.
I20260811 00:58:35.164391 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.3:0
--local_ip_for_outbound_sockets=127.15.70.3
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:39031
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:46229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:58:35.264640 9110 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:58:35.264930 9110 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:58:35.264961 9110 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:58:35.266381 9110 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:58:35.266450 9110 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:58:35.266482 9110 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.3
I20260811 00:58:35.268285 9110 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:46229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:39031
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9110
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.3
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:58:35.268617 9110 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:58:35.268922 9110 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 00:58:35.275345 9110 server_base.cc:1034] running on GCE node
W20260811 00:58:35.275326 9118 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:35.275298 9117 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:35.275311 9121 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:58:35.275862 9110 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:58:35.276242 9110 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:58:35.277426 9110 hybrid_clock.cc:648] HybridClock initialized: now 1786409915277418 us; error 39 us; skew 500 ppm
Aug 11 00:58:35 dist-test-slave-h3ft krb5kdc[8530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409915, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:58:35.280732 9110 init.cc:377] Logged in from keytab as kudu/127.15.70.3@KRBTEST.COM (short username kudu)
I20260811 00:58:35.281344 9110 webserver.cc:460] Webserver started at http://127.15.70.3:41469/ using document root <none> and password file <none>
I20260811 00:58:35.281613 9110 fs_manager.cc:359] Metadata directory not provided
I20260811 00:58:35.281690 9110 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:58:35.281845 9110 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:58:35.283211 9110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/data/instance:
uuid: "b22dd4d3a91a4d9a94637ac6c5ca5a18"
format_stamp: "Formatted at 2026-08-11 00:58:35 on dist-test-slave-h3ft"
server_key: "a1fae95a444fad638ab36e48a47871f4"
server_key_iv: "9d9407e7f4b55815538d9b3db4cfe3c9"
server_key_version: "encryptionkey@0"
I20260811 00:58:35.283634 9110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance:
uuid: "b22dd4d3a91a4d9a94637ac6c5ca5a18"
format_stamp: "Formatted at 2026-08-11 00:58:35 on dist-test-slave-h3ft"
server_key: "a1fae95a444fad638ab36e48a47871f4"
server_key_iv: "9d9407e7f4b55815538d9b3db4cfe3c9"
server_key_version: "encryptionkey@0"
I20260811 00:58:35.285166 9110 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:58:35.285989 9130 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:35.286182 9110 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:58:35.286296 9110 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/wal
uuid: "b22dd4d3a91a4d9a94637ac6c5ca5a18"
format_stamp: "Formatted at 2026-08-11 00:58:35 on dist-test-slave-h3ft"
server_key: "a1fae95a444fad638ab36e48a47871f4"
server_key_iv: "9d9407e7f4b55815538d9b3db4cfe3c9"
server_key_version: "encryptionkey@0"
I20260811 00:58:35.286378 9110 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:58:35.298259 9110 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:58:35.301139 9110 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:58:35.301342 9110 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:58:35.301651 9110 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:58:35.302040 9110 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:58:35.302098 9110 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:35.302137 9110 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:58:35.302184 9110 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:35.309629 9110 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.3:34019
I20260811 00:58:35.309690 9297 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.3:34019 every 8 connection(s)
I20260811 00:58:35.310102 9110 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
I20260811 00:58:35.312688 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 9110
I20260811 00:58:35.312815 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance
I20260811 00:58:35.313107 15640 external_mini_cluster.cc:1428] Setting key 8bd0c3706e658749a09944628e525bde
Aug 11 00:58:35 dist-test-slave-h3ft krb5kdc[8530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409915, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:58:35.321456 8656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:35.311092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:45145 (local address 127.15.70.62:39031)
0811 00:58:35.311179 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:35.311182 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:35.311314 (+ 132us) server_negotiation.cc:407] Connection header received
0811 00:58:35.311989 (+ 675us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:35.311990 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:35.312002 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:35.312066 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:35.313670 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:35.314284 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:35.315442 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:35.315676 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:35.315750 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:35.318288 (+ 2538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:35.318290 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:35.318290 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:35.318297 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:35.319952 (+ 1655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:35.320449 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:35.320450 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:35.320451 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:35.320516 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:35.320775 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:35.320776 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:35.320777 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:35.320963 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:35.321028 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:35.321292 (+ 264us) server_negotiation.cc:299] Negotiation successful
0811 00:58:35.321375 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 00:58:35.321599 9301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:35.310946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.3:45145)
0811 00:58:35.311178 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:35.311223 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:35.311835 (+ 612us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:35.312153 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:35.312157 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:35.313099 (+ 942us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:58:35.313506 (+ 407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:35.313513 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:35.314385 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:35.314386 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:35.315338 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:35.315341 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:35.315763 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:35.315764 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:35.315877 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:35.316614 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:58:35.316624 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:58:35.318167 (+ 1543us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:58:35.320029 (+ 1862us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:35.320037 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:35.320040 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:35.320277 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:35.320587 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:35.320588 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:35.320588 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:35.320695 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:35.321027 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:58:35.321033 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:58:35.321164 (+ 131us) client_negotiation.cc:769] Sending connection context
0811 00:58:35.321253 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 00:58:35.321391 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":132,"threads_started":1}
I20260811 00:58:35.322219 9299 heartbeater.cc:347] Connected to a master server at 127.15.70.62:39031
I20260811 00:58:35.322329 9299 heartbeater.cc:464] Registering TS with master...
I20260811 00:58:35.322510 9299 heartbeater.cc:511] Master 127.15.70.62:39031 requested a full tablet report, sending...
I20260811 00:58:35.322934 8601 ts_manager.cc:194] Registered new tserver with Master: b22dd4d3a91a4d9a94637ac6c5ca5a18 (127.15.70.3:34019)
I20260811 00:58:35.323474 8601 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.3@KRBTEST.COM'} at 127.15.70.3:45145
I20260811 00:58:35.325951 15640 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 00:58:35.335160 8656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:35.327926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50312 (local address 127.15.70.62:39031)
0811 00:58:35.328051 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:35.328055 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:35.328187 (+ 132us) server_negotiation.cc:407] Connection header received
0811 00:58:35.328276 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:35.328277 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:35.328289 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:35.328336 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:35.329011 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:35.329543 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:35.330327 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:35.330545 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:35.330623 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:35.332153 (+ 1530us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:35.332155 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:35.332156 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:35.332164 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:35.333716 (+ 1552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:35.334127 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:35.334128 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:35.334129 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:35.334197 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:35.334461 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:35.334462 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:35.334463 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:35.334653 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:35.334780 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:35.334891 (+ 111us) server_negotiation.cc:299] Negotiation successful
0811 00:58:35.334995 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 00:58:35.337845 8601 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50312:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:58:35.340346 8601 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:58:35.348675 9318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:35.343834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:34019 (local address 127.0.0.1:44972)
0811 00:58:35.344298 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:35.344350 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:35.344453 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:35.344857 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:35.344861 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:35.344864 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:58:35.344980 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:35.344984 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:35.346021 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:35.346022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:35.347381 (+ 1359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:35.347384 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:35.348272 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:35.348273 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:35.348363 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:35.348380 (+ 17us) client_negotiation.cc:769] Sending connection context
0811 00:58:35.348497 (+ 117us) client_negotiation.cc:240] Negotiation successful
0811 00:58:35.348571 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":97,"threads_started":1}
I20260811 00:58:35.348690 9322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:35.344175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44972 (local address 127.15.70.3:34019)
0811 00:58:35.344412 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:35.344417 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:35.344430 (+ 13us) server_negotiation.cc:407] Connection header received
0811 00:58:35.344619 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:35.344622 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:35.344643 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:35.344726 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:58:35.345083 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:35.345902 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:35.347482 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:35.348156 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:35.348270 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:35.348356 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:35.348521 (+ 165us) server_negotiation.cc:299] Negotiation successful
0811 00:58:35.348577 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":95,"threads_started":1}
I20260811 00:58:35.348956 9321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:35.344053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35890 (local address 127.15.70.1:41193)
0811 00:58:35.344307 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:35.344316 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:35.344622 (+ 306us) server_negotiation.cc:407] Connection header received
0811 00:58:35.344759 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:35.344762 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:35.344780 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:35.344846 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:58:35.345128 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:35.346297 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:35.347638 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:35.348408 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:35.348483 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:35.348538 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:35.348777 (+ 239us) server_negotiation.cc:299] Negotiation successful
0811 00:58:35.348837 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":118,"threads_started":1}
I20260811 00:58:35.349129 9319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:35.343834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.2:46601 (local address 127.0.0.1:39388)
0811 00:58:35.344480 (+ 646us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:35.344490 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:35.344545 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:35.344880 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:35.344880 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:35.344882 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:58:35.344995 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:35.344997 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:35.346467 (+ 1470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:35.346468 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:35.347770 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:35.347773 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:35.348861 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:35.348862 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:35.348937 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:35.348940 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:58:35.348995 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 00:58:35.349045 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":626,"mutex_wait_us":191,"thread_start_us":170,"threads_started":1}
I20260811 00:58:35.349223 9320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:35.343840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:41193 (local address 127.0.0.1:35890)
0811 00:58:35.344544 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:35.344555 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:35.344655 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:35.344957 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:35.344957 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:35.344960 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:58:35.345054 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:35.345055 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:35.346471 (+ 1416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:35.346472 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:35.347540 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:35.347544 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:35.348578 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:35.348579 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:35.348668 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:35.348675 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 00:58:35.349103 (+ 428us) client_negotiation.cc:240] Negotiation successful
0811 00:58:35.349150 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":679,"mutex_wait_us":33,"thread_start_us":237,"threads_started":1}
I20260811 00:58:35.349399 9325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:35.344241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39388 (local address 127.15.70.2:46601)
0811 00:58:35.344438 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:35.344442 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:35.344612 (+ 170us) server_negotiation.cc:407] Connection header received
0811 00:58:35.344671 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:35.344674 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:35.344692 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:35.344768 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:58:35.345097 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:35.346312 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:35.347874 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:35.348701 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:35.348767 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:35.348825 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:35.349242 (+ 417us) server_negotiation.cc:299] Negotiation successful
0811 00:58:35.349308 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":133,"threads_started":1}
I20260811 00:58:35.350215 8790 tablet_service.cc:1467] Processing CreateTablet for tablet c886ab2d0cd342dd8278a1aed87c52c5 (DEFAULT_TABLE table=test-table [id=b17a8c6736ea482da26897904431b6c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:58:35.350222 8995 tablet_service.cc:1467] Processing CreateTablet for tablet c886ab2d0cd342dd8278a1aed87c52c5 (DEFAULT_TABLE table=test-table [id=b17a8c6736ea482da26897904431b6c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:58:35.350426 9195 tablet_service.cc:1467] Processing CreateTablet for tablet c886ab2d0cd342dd8278a1aed87c52c5 (DEFAULT_TABLE table=test-table [id=b17a8c6736ea482da26897904431b6c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:58:35.350704 8790 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c886ab2d0cd342dd8278a1aed87c52c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:58:35.350698 8995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c886ab2d0cd342dd8278a1aed87c52c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:58:35.350767 9195 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c886ab2d0cd342dd8278a1aed87c52c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:58:35.354439 9326 tablet_bootstrap.cc:492] T c886ab2d0cd342dd8278a1aed87c52c5 P 47d4770dac934e05955dc1b823da0885: Bootstrap starting.
I20260811 00:58:35.355031 9327 tablet_bootstrap.cc:492] T c886ab2d0cd342dd8278a1aed87c52c5 P b22dd4d3a91a4d9a94637ac6c5ca5a18: Bootstrap starting.
I20260811 00:58:35.355845 9326 tablet_bootstrap.cc:654] T c886ab2d0cd342dd8278a1aed87c52c5 P 47d4770dac934e05955dc1b823da0885: Neither blocks nor log segments found. Creating new log.
I20260811 00:58:35.355831 9327 tablet_bootstrap.cc:654] T c886ab2d0cd342dd8278a1aed87c52c5 P b22dd4d3a91a4d9a94637ac6c5ca5a18: Neither blocks nor log segments found. Creating new log.
I20260811 00:58:35.356598 9326 log.cc:824] T c886ab2d0cd342dd8278a1aed87c52c5 P 47d4770dac934e05955dc1b823da0885: Log is configured to *not* fsync() on all Append() calls
I20260811 00:58:35.356594 9327 log.cc:824] T c886ab2d0cd342dd8278a1aed87c52c5 P b22dd4d3a91a4d9a94637ac6c5ca5a18: Log is configured to *not* fsync() on all Append() calls
I20260811 00:58:35.357008 9333 tablet_bootstrap.cc:492] T c886ab2d0cd342dd8278a1aed87c52c5 P 57adc460061b47c8802f20d2e535033a: Bootstrap starting.
I20260811 00:58:35.357595 9327 tablet_bootstrap.cc:492] T c886ab2d0cd342dd8278a1aed87c52c5 P b22dd4d3a91a4d9a94637ac6c5ca5a18: No bootstrap required, opened a new log
I20260811 00:58:35.357694 9327 ts_tablet_manager.cc:1397] T c886ab2d0cd342dd8278a1aed87c52c5 P b22dd4d3a91a4d9a94637ac6c5ca5a18: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 00:58:35.357738 9333 tablet_bootstrap.cc:654] T c886ab2d0cd342dd8278a1aed87c52c5 P 57adc460061b47c8802f20d2e535033a: Neither blocks nor log segments found. Creating new log.
I20260811 00:58:35.357788 9326 tablet_bootstrap.cc:492] T c886ab2d0cd342dd8278a1aed87c52c5 P 47d4770dac934e05955dc1b823da0885: No bootstrap required, opened a new log
I20260811 00:58:35.357861 9326 ts_tablet_manager.cc:1397] T c886ab2d0cd342dd8278a1aed87c52c5 P 47d4770dac934e05955dc1b823da0885: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260811 00:58:35.358384 9333 log.cc:824] T c886ab2d0cd342dd8278a1aed87c52c5 P 57adc460061b47c8802f20d2e535033a: Log is configured to *not* fsync() on all Append() calls
I20260811 00:58:35.359306 9333 tablet_bootstrap.cc:492] T c886ab2d0cd342dd8278a1aed87c52c5 P 57adc460061b47c8802f20d2e535033a: No bootstrap required, opened a new log
I20260811 00:58:35.359395 9333 ts_tablet_manager.cc:1397] T c886ab2d0cd342dd8278a1aed87c52c5 P 57adc460061b47c8802f20d2e535033a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 00:58:35.359850 9327 raft_consensus.cc:348] T c886ab2d0cd342dd8278a1aed87c52c5 P b22dd4d3a91a4d9a94637ac6c5ca5a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b22dd4d3a91a4d9a94637ac6c5ca5a18" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34019 } } peers { permanent_uuid: "47d4770dac934e05955dc1b823da0885" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 41193 } } peers { permanent_uuid: "57adc460061b47c8802f20d2e535033a" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46601 } }
I20260811 00:58:35.360054 9327 raft_consensus.cc:374] T c886ab2d0cd342dd8278a1aed87c52c5 P b22dd4d3a91a4d9a94637ac6c5ca5a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:58:35.360102 9327 raft_consensus.cc:729] T c886ab2d0cd342dd8278a1aed87c52c5 P b22dd4d3a91a4d9a94637ac6c5ca5a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b22dd4d3a91a4d9a94637ac6c5ca5a18, State: Initialized, Role: FOLLOWER
I20260811 00:58:35.360284 9327 consensus_queue.cc:260] T c886ab2d0cd342dd8278a1aed87c52c5 P b22dd4d3a91a4d9a94637ac6c5ca5a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b22dd4d3a91a4d9a94637ac6c5ca5a18" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34019 } } peers { permanent_uuid: "47d4770dac934e05955dc1b823da0885" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 41193 } } peers { permanent_uuid: "57adc460061b47c8802f20d2e535033a" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46601 } }
I20260811 00:58:35.360285 9326 raft_consensus.cc:348] T c886ab2d0cd342dd8278a1aed87c52c5 P 47d4770dac934e05955dc1b823da0885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b22dd4d3a91a4d9a94637ac6c5ca5a18" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34019 } } peers { permanent_uuid: "47d4770dac934e05955dc1b823da0885" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 41193 } } peers { permanent_uuid: "57adc460061b47c8802f20d2e535033a" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46601 } }
I20260811 00:58:35.360476 9326 raft_consensus.cc:374] T c886ab2d0cd342dd8278a1aed87c52c5 P 47d4770dac934e05955dc1b823da0885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:58:35.360518 9326 raft_consensus.cc:729] T c886ab2d0cd342dd8278a1aed87c52c5 P 47d4770dac934e05955dc1b823da0885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47d4770dac934e05955dc1b823da0885, State: Initialized, Role: FOLLOWER
I20260811 00:58:35.360646 9327 ts_tablet_manager.cc:1428] T c886ab2d0cd342dd8278a1aed87c52c5 P b22dd4d3a91a4d9a94637ac6c5ca5a18: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 00:58:35.360652 9326 consensus_queue.cc:260] T c886ab2d0cd342dd8278a1aed87c52c5 P 47d4770dac934e05955dc1b823da0885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b22dd4d3a91a4d9a94637ac6c5ca5a18" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34019 } } peers { permanent_uuid: "47d4770dac934e05955dc1b823da0885" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 41193 } } peers { permanent_uuid: "57adc460061b47c8802f20d2e535033a" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46601 } }
I20260811 00:58:35.360805 9299 heartbeater.cc:503] Master 127.15.70.62:39031 was elected leader, sending a full tablet report...
I20260811 00:58:35.361340 9326 ts_tablet_manager.cc:1428] T c886ab2d0cd342dd8278a1aed87c52c5 P 47d4770dac934e05955dc1b823da0885: Time spent starting tablet: real 0.003s user 0.003s sys 0.001s
I20260811 00:58:35.361486 8888 heartbeater.cc:503] Master 127.15.70.62:39031 was elected leader, sending a full tablet report...
I20260811 00:58:35.361756 9333 raft_consensus.cc:348] T c886ab2d0cd342dd8278a1aed87c52c5 P 57adc460061b47c8802f20d2e535033a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b22dd4d3a91a4d9a94637ac6c5ca5a18" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34019 } } peers { permanent_uuid: "47d4770dac934e05955dc1b823da0885" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 41193 } } peers { permanent_uuid: "57adc460061b47c8802f20d2e535033a" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46601 } }
I20260811 00:58:35.361958 9333 raft_consensus.cc:374] T c886ab2d0cd342dd8278a1aed87c52c5 P 57adc460061b47c8802f20d2e535033a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:58:35.362002 9333 raft_consensus.cc:729] T c886ab2d0cd342dd8278a1aed87c52c5 P 57adc460061b47c8802f20d2e535033a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57adc460061b47c8802f20d2e535033a, State: Initialized, Role: FOLLOWER
I20260811 00:58:35.362120 9333 consensus_queue.cc:260] T c886ab2d0cd342dd8278a1aed87c52c5 P 57adc460061b47c8802f20d2e535033a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b22dd4d3a91a4d9a94637ac6c5ca5a18" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34019 } } peers { permanent_uuid: "47d4770dac934e05955dc1b823da0885" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 41193 } } peers { permanent_uuid: "57adc460061b47c8802f20d2e535033a" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46601 } }
I20260811 00:58:35.362428 9333 ts_tablet_manager.cc:1428] T c886ab2d0cd342dd8278a1aed87c52c5 P 57adc460061b47c8802f20d2e535033a: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 00:58:35.362571 9102 heartbeater.cc:503] Master 127.15.70.62:39031 was elected leader, sending a full tablet report...
W20260811 00:58:35.366045 9103 tablet.cc:2369] T c886ab2d0cd342dd8278a1aed87c52c5 P 57adc460061b47c8802f20d2e535033a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 00:58:35.399402 8889 tablet.cc:2369] T c886ab2d0cd342dd8278a1aed87c52c5 P 47d4770dac934e05955dc1b823da0885: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 00:58:35.501379 9337 raft_consensus.cc:482] T c886ab2d0cd342dd8278a1aed87c52c5 P b22dd4d3a91a4d9a94637ac6c5ca5a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:58:35.501574 9337 raft_consensus.cc:504] T c886ab2d0cd342dd8278a1aed87c52c5 P b22dd4d3a91a4d9a94637ac6c5ca5a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b22dd4d3a91a4d9a94637ac6c5ca5a18" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34019 } } peers { permanent_uuid: "47d4770dac934e05955dc1b823da0885" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 41193 } } peers { permanent_uuid: "57adc460061b47c8802f20d2e535033a" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46601 } }
I20260811 00:58:35.502120 9337 leader_election.cc:288] T c886ab2d0cd342dd8278a1aed87c52c5 P b22dd4d3a91a4d9a94637ac6c5ca5a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47d4770dac934e05955dc1b823da0885 (127.15.70.1:41193), 57adc460061b47c8802f20d2e535033a (127.15.70.2:46601)
I20260811 00:58:35.505446 9321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:35.502529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:43105 (local address 127.15.70.1:41193)
0811 00:58:35.502588 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:35.502591 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:35.502705 (+ 114us) server_negotiation.cc:407] Connection header received
0811 00:58:35.502784 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:35.502785 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:35.502809 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:35.502884 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:58:35.503088 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:35.503597 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:35.504630 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:35.505026 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:35.505120 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:35.505136 (+ 16us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:35.505297 (+ 161us) server_negotiation.cc:299] Negotiation successful
0811 00:58:35.505343 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 00:58:35.505470 9325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:35.502525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:48305 (local address 127.15.70.2:46601)
0811 00:58:35.502592 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:35.502594 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:35.502604 (+ 10us) server_negotiation.cc:407] Connection header received
0811 00:58:35.502643 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:35.502644 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:35.502657 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:35.502729 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:58:35.502922 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:35.503540 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:35.504618 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:35.505067 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:35.505163 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:35.505176 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:35.505342 (+ 166us) server_negotiation.cc:299] Negotiation successful
0811 00:58:35.505392 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 00:58:35.505476 9342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:35.502387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:41193 (local address 127.15.70.3:43105)
0811 00:58:35.502609 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:35.502620 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:35.502718 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:35.502889 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:35.502891 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:35.502893 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:58:35.502981 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:35.502983 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:35.503699 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:35.503700 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:35.504519 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:35.504522 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:35.505123 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:35.505124 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:35.505206 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:35.505210 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:58:35.505288 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 00:58:35.505339 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":142,"threads_started":1}
I20260811 00:58:35.505542 9301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:35.502351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.2:46601 (local address 127.15.70.3:48305)
0811 00:58:35.502413 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:35.502429 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:35.502490 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:35.502738 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:35.502739 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:35.502742 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:58:35.502841 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:35.502844 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:35.503648 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:35.503649 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:35.504506 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:35.504509 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:35.505164 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:35.505165 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:35.505260 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:35.505263 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:58:35.505334 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 00:58:35.505382 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":2}
I20260811 00:58:35.505946 9027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c886ab2d0cd342dd8278a1aed87c52c5" candidate_uuid: "b22dd4d3a91a4d9a94637ac6c5ca5a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57adc460061b47c8802f20d2e535033a" is_pre_election: true
I20260811 00:58:35.506146 8821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c886ab2d0cd342dd8278a1aed87c52c5" candidate_uuid: "b22dd4d3a91a4d9a94637ac6c5ca5a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47d4770dac934e05955dc1b823da0885" is_pre_election: true
I20260811 00:58:35.506211 9027 raft_consensus.cc:2454] T c886ab2d0cd342dd8278a1aed87c52c5 P 57adc460061b47c8802f20d2e535033a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b22dd4d3a91a4d9a94637ac6c5ca5a18 in term 0.
I20260811 00:58:35.506335 8821 raft_consensus.cc:2454] T c886ab2d0cd342dd8278a1aed87c52c5 P 47d4770dac934e05955dc1b823da0885 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b22dd4d3a91a4d9a94637ac6c5ca5a18 in term 0.
I20260811 00:58:35.506505 9133 leader_election.cc:302] T c886ab2d0cd342dd8278a1aed87c52c5 P b22dd4d3a91a4d9a94637ac6c5ca5a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57adc460061b47c8802f20d2e535033a, b22dd4d3a91a4d9a94637ac6c5ca5a18; no voters:
I20260811 00:58:35.506654 9337 raft_consensus.cc:2781] T c886ab2d0cd342dd8278a1aed87c52c5 P b22dd4d3a91a4d9a94637ac6c5ca5a18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:58:35.506709 9337 raft_consensus.cc:482] T c886ab2d0cd342dd8278a1aed87c52c5 P b22dd4d3a91a4d9a94637ac6c5ca5a18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:58:35.506742 9337 raft_consensus.cc:3037] T c886ab2d0cd342dd8278a1aed87c52c5 P b22dd4d3a91a4d9a94637ac6c5ca5a18 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:58:35.507804 9337 raft_consensus.cc:504] T c886ab2d0cd342dd8278a1aed87c52c5 P b22dd4d3a91a4d9a94637ac6c5ca5a18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b22dd4d3a91a4d9a94637ac6c5ca5a18" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34019 } } peers { permanent_uuid: "47d4770dac934e05955dc1b823da0885" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 41193 } } peers { permanent_uuid: "57adc460061b47c8802f20d2e535033a" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46601 } }
I20260811 00:58:35.508025 9337 leader_election.cc:288] T c886ab2d0cd342dd8278a1aed87c52c5 P b22dd4d3a91a4d9a94637ac6c5ca5a18 [CANDIDATE]: Term 1 election: Requested vote from peers 47d4770dac934e05955dc1b823da0885 (127.15.70.1:41193), 57adc460061b47c8802f20d2e535033a (127.15.70.2:46601)
I20260811 00:58:35.508229 8821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c886ab2d0cd342dd8278a1aed87c52c5" candidate_uuid: "b22dd4d3a91a4d9a94637ac6c5ca5a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47d4770dac934e05955dc1b823da0885"
I20260811 00:58:35.508335 8821 raft_consensus.cc:3037] T c886ab2d0cd342dd8278a1aed87c52c5 P 47d4770dac934e05955dc1b823da0885 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:58:35.508447 9027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c886ab2d0cd342dd8278a1aed87c52c5" candidate_uuid: "b22dd4d3a91a4d9a94637ac6c5ca5a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57adc460061b47c8802f20d2e535033a"
I20260811 00:58:35.508586 9027 raft_consensus.cc:3037] T c886ab2d0cd342dd8278a1aed87c52c5 P 57adc460061b47c8802f20d2e535033a [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:58:35.509207 8821 raft_consensus.cc:2454] T c886ab2d0cd342dd8278a1aed87c52c5 P 47d4770dac934e05955dc1b823da0885 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b22dd4d3a91a4d9a94637ac6c5ca5a18 in term 1.
I20260811 00:58:35.509416 9132 leader_election.cc:302] T c886ab2d0cd342dd8278a1aed87c52c5 P b22dd4d3a91a4d9a94637ac6c5ca5a18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47d4770dac934e05955dc1b823da0885, b22dd4d3a91a4d9a94637ac6c5ca5a18; no voters:
I20260811 00:58:35.509554 9337 raft_consensus.cc:2781] T c886ab2d0cd342dd8278a1aed87c52c5 P b22dd4d3a91a4d9a94637ac6c5ca5a18 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:58:35.509609 9027 raft_consensus.cc:2454] T c886ab2d0cd342dd8278a1aed87c52c5 P 57adc460061b47c8802f20d2e535033a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b22dd4d3a91a4d9a94637ac6c5ca5a18 in term 1.
I20260811 00:58:35.509795 9337 raft_consensus.cc:686] T c886ab2d0cd342dd8278a1aed87c52c5 P b22dd4d3a91a4d9a94637ac6c5ca5a18 [term 1 LEADER]: Becoming Leader. State: Replica: b22dd4d3a91a4d9a94637ac6c5ca5a18, State: Running, Role: LEADER
I20260811 00:58:35.509934 9337 consensus_queue.cc:237] T c886ab2d0cd342dd8278a1aed87c52c5 P b22dd4d3a91a4d9a94637ac6c5ca5a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b22dd4d3a91a4d9a94637ac6c5ca5a18" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34019 } } peers { permanent_uuid: "47d4770dac934e05955dc1b823da0885" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 41193 } } peers { permanent_uuid: "57adc460061b47c8802f20d2e535033a" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46601 } }
I20260811 00:58:35.511183 8601 catalog_manager.cc:5495] T c886ab2d0cd342dd8278a1aed87c52c5 P b22dd4d3a91a4d9a94637ac6c5ca5a18 reported cstate change: term changed from 0 to 1, leader changed from <none> to b22dd4d3a91a4d9a94637ac6c5ca5a18 (127.15.70.3). New cstate: current_term: 1 leader_uuid: "b22dd4d3a91a4d9a94637ac6c5ca5a18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b22dd4d3a91a4d9a94637ac6c5ca5a18" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47d4770dac934e05955dc1b823da0885" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 41193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57adc460061b47c8802f20d2e535033a" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46601 } health_report { overall_health: UNKNOWN } } }
I20260811 00:58:35.534569 9322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:35.531468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44980 (local address 127.15.70.3:34019)
0811 00:58:35.531551 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:35.531553 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:35.531571 (+ 18us) server_negotiation.cc:407] Connection header received
0811 00:58:35.531621 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:35.531622 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:35.531646 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:35.531717 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:58:35.531930 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:35.532470 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:35.533482 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:35.533700 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:35.533766 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:35.533998 (+ 232us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:58:35.534137 (+ 139us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:58:35.534213 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:35.534333 (+ 120us) server_negotiation.cc:299] Negotiation successful
0811 00:58:35.534363 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 00:58:35.537256 8821 raft_consensus.cc:1261] T c886ab2d0cd342dd8278a1aed87c52c5 P 47d4770dac934e05955dc1b823da0885 [term 1 FOLLOWER]: Refusing update from remote peer b22dd4d3a91a4d9a94637ac6c5ca5a18: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:58:35.537256 9027 raft_consensus.cc:1261] T c886ab2d0cd342dd8278a1aed87c52c5 P 57adc460061b47c8802f20d2e535033a [term 1 FOLLOWER]: Refusing update from remote peer b22dd4d3a91a4d9a94637ac6c5ca5a18: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:58:35.537778 9344 consensus_queue.cc:1035] T c886ab2d0cd342dd8278a1aed87c52c5 P b22dd4d3a91a4d9a94637ac6c5ca5a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57adc460061b47c8802f20d2e535033a" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:58:35.537948 9337 consensus_queue.cc:1035] T c886ab2d0cd342dd8278a1aed87c52c5 P b22dd4d3a91a4d9a94637ac6c5ca5a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47d4770dac934e05955dc1b823da0885" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 41193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:58:35.541917 9349 mvcc.cc:205] Tried to move back new op lower bound from 7317135014036754432 to 7317135013929762816. Current Snapshot: MvccSnapshot[applied={T|T < 7317135014036754432}]
I20260811 00:58:35.543375 8601 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50312:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:58:35.543488 8601 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50312:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:58:35.544384 8601 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f: Sending DeleteTablet for 3 replicas of tablet c886ab2d0cd342dd8278a1aed87c52c5
I20260811 00:58:35.544826 9195 tablet_service.cc:1514] Processing DeleteTablet for tablet c886ab2d0cd342dd8278a1aed87c52c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:58:35 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:44972
I20260811 00:58:35.544834 8790 tablet_service.cc:1514] Processing DeleteTablet for tablet c886ab2d0cd342dd8278a1aed87c52c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:58:35 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:35890
I20260811 00:58:35.545104 8995 tablet_service.cc:1514] Processing DeleteTablet for tablet c886ab2d0cd342dd8278a1aed87c52c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:58:35 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:39388
I20260811 00:58:35.545140 9362 tablet_replica.cc:330] T c886ab2d0cd342dd8278a1aed87c52c5 P b22dd4d3a91a4d9a94637ac6c5ca5a18: stopping tablet replica
I20260811 00:58:35.545264 9362 raft_consensus.cc:2229] T c886ab2d0cd342dd8278a1aed87c52c5 P b22dd4d3a91a4d9a94637ac6c5ca5a18 [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:58:35.545380 9362 raft_consensus.cc:2258] T c886ab2d0cd342dd8278a1aed87c52c5 P b22dd4d3a91a4d9a94637ac6c5ca5a18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:58:35.545475 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 8689
I20260811 00:58:35.545678 9365 tablet_replica.cc:330] T c886ab2d0cd342dd8278a1aed87c52c5 P 57adc460061b47c8802f20d2e535033a: stopping tablet replica
I20260811 00:58:35.545809 9365 raft_consensus.cc:2229] T c886ab2d0cd342dd8278a1aed87c52c5 P 57adc460061b47c8802f20d2e535033a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:58:35.545967 9365 raft_consensus.cc:2258] T c886ab2d0cd342dd8278a1aed87c52c5 P 57adc460061b47c8802f20d2e535033a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:58:35.553802 9362 ts_tablet_manager.cc:1905] T c886ab2d0cd342dd8278a1aed87c52c5 P b22dd4d3a91a4d9a94637ac6c5ca5a18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:58:35.556849 9365 ts_tablet_manager.cc:1905] T c886ab2d0cd342dd8278a1aed87c52c5 P 57adc460061b47c8802f20d2e535033a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:58:35.557294 9362 ts_tablet_manager.cc:1918] T c886ab2d0cd342dd8278a1aed87c52c5 P b22dd4d3a91a4d9a94637ac6c5ca5a18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:58:35.557402 9362 log.cc:1196] T c886ab2d0cd342dd8278a1aed87c52c5 P b22dd4d3a91a4d9a94637ac6c5ca5a18: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/wal/wals/c886ab2d0cd342dd8278a1aed87c52c5
I20260811 00:58:35.557757 9362 ts_tablet_manager.cc:1939] T c886ab2d0cd342dd8278a1aed87c52c5 P b22dd4d3a91a4d9a94637ac6c5ca5a18: Deleting consensus metadata
I20260811 00:58:35.558398 8582 catalog_manager.cc:4841] TS b22dd4d3a91a4d9a94637ac6c5ca5a18 (127.15.70.3:34019): tablet c886ab2d0cd342dd8278a1aed87c52c5 (table test-table [id=b17a8c6736ea482da26897904431b6c6]) successfully deleted
I20260811 00:58:35.559479 9365 ts_tablet_manager.cc:1918] T c886ab2d0cd342dd8278a1aed87c52c5 P 57adc460061b47c8802f20d2e535033a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:58:35.559607 9365 log.cc:1196] T c886ab2d0cd342dd8278a1aed87c52c5 P 57adc460061b47c8802f20d2e535033a: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/wal/wals/c886ab2d0cd342dd8278a1aed87c52c5
I20260811 00:58:35.559918 9365 ts_tablet_manager.cc:1939] T c886ab2d0cd342dd8278a1aed87c52c5 P 57adc460061b47c8802f20d2e535033a: Deleting consensus metadata
I20260811 00:58:35.560472 8581 catalog_manager.cc:4841] TS 57adc460061b47c8802f20d2e535033a (127.15.70.2:46601): tablet c886ab2d0cd342dd8278a1aed87c52c5 (table test-table [id=b17a8c6736ea482da26897904431b6c6]) successfully deleted
W20260811 00:58:35.587836 8578 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.70.1:41193 (error 108)
I20260811 00:58:35.588106 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 8894
I20260811 00:58:35.602205 9320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:35.601928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:41193 (local address 127.0.0.1:35892)
0811 00:58:35.602016 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:35.602122 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.1:41193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260811 00:58:35.610401 8578 catalog_manager.cc:4584] TS 47d4770dac934e05955dc1b823da0885 (127.15.70.1:41193): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c886ab2d0cd342dd8278a1aed87c52c5: Network error: Client connection negotiation failed: client connection to 127.15.70.1:41193: connect: Connection refused (error 111)
I20260811 00:58:35.619917 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 9110
I20260811 00:58:35.646831 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 8550
I20260811 00:58:55.674540 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:39031
--webserver_interface=127.15.70.62
--webserver_port=41265
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:46229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:39031
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:58:55.778914 9368 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:58:55.779241 9368 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:58:55.779270 9368 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:58:55.780774 9368 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 00:58:55.780838 9368 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 00:58:55.780853 9368 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 00:58:55.780865 9368 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:58:55.780879 9368 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:58:55.780894 9368 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:58:55.780912 9368 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:58:55.780961 9368 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:58:55.782819 9368 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:46229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:39031
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:39031
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=41265
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9368
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:58:55.783228 9368 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:58:55.783571 9368 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:58:55.797374 9376 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:55.797554 9375 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:55.797582 9379 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:58:55.798107 9368 server_base.cc:1034] running on GCE node
I20260811 00:58:55.798496 9368 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:58:55.798911 9368 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:58:55.800213 9368 hybrid_clock.cc:648] HybridClock initialized: now 1786409935800187 us; error 45 us; skew 500 ppm
Aug 11 00:58:55 dist-test-slave-h3ft krb5kdc[8530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409935, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:58:55.803736 9368 init.cc:377] Logged in from keytab as kudu/127.15.70.62@KRBTEST.COM (short username kudu)
I20260811 00:58:55.804435 9368 webserver.cc:460] Webserver started at http://127.15.70.62:41265/ using document root <none> and password file <none>
I20260811 00:58:55.804744 9368 fs_manager.cc:359] Metadata directory not provided
I20260811 00:58:55.804855 9368 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:58:55.806737 9368 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 00:58:55.807823 9390 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:55.808171 9368 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:58:55.808329 9368 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "9509e9d198ab43748599b0b69444812f"
format_stamp: "Formatted at 2026-08-11 00:58:34 on dist-test-slave-h3ft"
server_key: "7dc897b60d7cd2bd54e8c7e8bf7a34cf"
server_key_iv: "ab85e0805fc7a6e771aa91c973b6eea7"
server_key_version: "encryptionkey@0"
I20260811 00:58:55.808872 9368 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:58:55.820708 9368 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:58:55.823536 9368 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:58:55.823726 9368 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:58:55.829628 9368 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:39031
I20260811 00:58:55.829767 9473 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:39031 every 8 connection(s)
I20260811 00:58:55.830503 9368 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:58:55.832998 9476 sys_catalog.cc:263] Verifying existing consensus state
I20260811 00:58:55.833483 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 9368
I20260811 00:58:55.833884 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.1:41193
--local_ip_for_outbound_sockets=127.15.70.1
--tserver_master_addrs=127.15.70.62:39031
--webserver_port=42501
--webserver_interface=127.15.70.1
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:46229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 00:58:55.834246 9476 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f: Bootstrap starting.
I20260811 00:58:55.845389 9476 log.cc:824] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f: Log is configured to *not* fsync() on all Append() calls
I20260811 00:58:55.849174 9476 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 00:58:55.849606 9476 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f: Bootstrap complete.
I20260811 00:58:55.852324 9476 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9509e9d198ab43748599b0b69444812f" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 39031 } }
I20260811 00:58:55.852610 9476 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9509e9d198ab43748599b0b69444812f, State: Initialized, Role: FOLLOWER
I20260811 00:58:55.852841 9476 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9509e9d198ab43748599b0b69444812f" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 39031 } }
I20260811 00:58:55.852936 9476 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:58:55.852998 9476 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:58:55.853075 9476 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [term 1 FOLLOWER]: Advancing to term 2
I20260811 00:58:55.854297 9476 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9509e9d198ab43748599b0b69444812f" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 39031 } }
I20260811 00:58:55.854435 9476 leader_election.cc:302] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9509e9d198ab43748599b0b69444812f; no voters:
I20260811 00:58:55.854677 9476 leader_election.cc:288] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 00:58:55.854722 9487 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [term 2 FOLLOWER]: Leader election won for term 2
I20260811 00:58:55.854849 9487 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [term 2 LEADER]: Becoming Leader. State: Replica: 9509e9d198ab43748599b0b69444812f, State: Running, Role: LEADER
I20260811 00:58:55.854970 9487 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9509e9d198ab43748599b0b69444812f" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 39031 } }
I20260811 00:58:55.855041 9476 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:58:55.855347 9488 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "9509e9d198ab43748599b0b69444812f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9509e9d198ab43748599b0b69444812f" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 39031 } } }
I20260811 00:58:55.855460 9488 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [sys.catalog]: This master's current role is: LEADER
I20260811 00:58:55.855336 9487 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9509e9d198ab43748599b0b69444812f. Latest consensus state: current_term: 2 leader_uuid: "9509e9d198ab43748599b0b69444812f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9509e9d198ab43748599b0b69444812f" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 39031 } } }
I20260811 00:58:55.855688 9487 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [sys.catalog]: This master's current role is: LEADER
I20260811 00:58:55.856176 9496 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:58:55.857198 9496 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:58:55.857427 9496 catalog_manager.cc:1259] Loaded cluster ID: 7a5218987da242da8ca6ae14f659992b
I20260811 00:58:55.857632 9496 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:58:55.859126 9496 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:58:55.859370 9496 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f: Loaded TSK: 0
I20260811 00:58:55.873098 9496 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f: Generated new TSK 1
I20260811 00:58:55.873284 9496 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 00:58:55.941378 9482 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:58:55.941730 9482 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:58:55.941777 9482 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:58:55.943295 9482 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:58:55.943415 9482 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:58:55.943470 9482 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.1
I20260811 00:58:55.945305 9482 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:46229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.1:41193
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.70.1
--webserver_port=42501
--tserver_master_addrs=127.15.70.62:39031
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9482
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.1
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:58:55.945654 9482 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:58:55.945981 9482 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:58:55.952450 9520 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:55.952571 9524 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:55.952632 9519 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:58:55.953218 9482 server_base.cc:1034] running on GCE node
I20260811 00:58:55.953544 9482 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:58:55.953920 9482 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:58:55.955111 9482 hybrid_clock.cc:648] HybridClock initialized: now 1786409935955092 us; error 34 us; skew 500 ppm
Aug 11 00:58:55 dist-test-slave-h3ft krb5kdc[8530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409935, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:58:55.958950 9482 init.cc:377] Logged in from keytab as kudu/127.15.70.1@KRBTEST.COM (short username kudu)
I20260811 00:58:55.959594 9482 webserver.cc:460] Webserver started at http://127.15.70.1:42501/ using document root <none> and password file <none>
I20260811 00:58:55.959887 9482 fs_manager.cc:359] Metadata directory not provided
I20260811 00:58:55.959998 9482 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:58:55.961889 9482 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:58:55.962958 9532 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:55.963265 9482 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:58:55.963409 9482 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/wal
uuid: "47d4770dac934e05955dc1b823da0885"
format_stamp: "Formatted at 2026-08-11 00:58:34 on dist-test-slave-h3ft"
server_key: "e6834b4f76604ce4444eca51a55ff822"
server_key_iv: "8cf7919b5a0cc0580ce4eea79aecdf6c"
server_key_version: "encryptionkey@0"
I20260811 00:58:55.963879 9482 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:58:55.993346 9482 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:58:55.996404 9482 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:58:55.996645 9482 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:58:55.996996 9482 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:58:55.997653 9541 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 00:58:55.999548 9482 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 00:58:55.999617 9482 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 00:58:55.999653 9482 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 00:58:56.000511 9482 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 00:58:56.000568 9482 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 00:58:56.000617 9541 tablet_bootstrap.cc:492] T c886ab2d0cd342dd8278a1aed87c52c5 P 47d4770dac934e05955dc1b823da0885: Bootstrap starting.
I20260811 00:58:56.013265 9482 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.1:41193
I20260811 00:58:56.013327 9710 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.1:41193 every 8 connection(s)
I20260811 00:58:56.014048 9482 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
I20260811 00:58:56.016536 9541 log.cc:824] T c886ab2d0cd342dd8278a1aed87c52c5 P 47d4770dac934e05955dc1b823da0885: Log is configured to *not* fsync() on all Append() calls
I20260811 00:58:56.019439 9541 tablet_bootstrap.cc:492] T c886ab2d0cd342dd8278a1aed87c52c5 P 47d4770dac934e05955dc1b823da0885: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 00:58:56.019809 9541 tablet_bootstrap.cc:492] T c886ab2d0cd342dd8278a1aed87c52c5 P 47d4770dac934e05955dc1b823da0885: Bootstrap complete.
I20260811 00:58:56.021008 9541 ts_tablet_manager.cc:1397] T c886ab2d0cd342dd8278a1aed87c52c5 P 47d4770dac934e05955dc1b823da0885: Time spent bootstrapping tablet: real 0.020s user 0.007s sys 0.011s
I20260811 00:58:56.022277 9541 raft_consensus.cc:348] T c886ab2d0cd342dd8278a1aed87c52c5 P 47d4770dac934e05955dc1b823da0885 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b22dd4d3a91a4d9a94637ac6c5ca5a18" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34019 } } peers { permanent_uuid: "47d4770dac934e05955dc1b823da0885" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 41193 } } peers { permanent_uuid: "57adc460061b47c8802f20d2e535033a" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46601 } }
I20260811 00:58:56.022589 9541 raft_consensus.cc:729] T c886ab2d0cd342dd8278a1aed87c52c5 P 47d4770dac934e05955dc1b823da0885 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47d4770dac934e05955dc1b823da0885, State: Initialized, Role: FOLLOWER
I20260811 00:58:56.022785 9541 consensus_queue.cc:260] T c886ab2d0cd342dd8278a1aed87c52c5 P 47d4770dac934e05955dc1b823da0885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b22dd4d3a91a4d9a94637ac6c5ca5a18" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34019 } } peers { permanent_uuid: "47d4770dac934e05955dc1b823da0885" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 41193 } } peers { permanent_uuid: "57adc460061b47c8802f20d2e535033a" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46601 } }
I20260811 00:58:56.022886 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 9482
Aug 11 00:58:56 dist-test-slave-h3ft krb5kdc[8530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409935, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:58:56.023190 9541 ts_tablet_manager.cc:1428] T c886ab2d0cd342dd8278a1aed87c52c5 P 47d4770dac934e05955dc1b823da0885: Time spent starting tablet: real 0.002s user 0.001s sys 0.003s
I20260811 00:58:56.023303 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.2:46601
--local_ip_for_outbound_sockets=127.15.70.2
--tserver_master_addrs=127.15.70.62:39031
--webserver_port=33831
--webserver_interface=127.15.70.2
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:46229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 00:58:56.029021 9713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:56.015202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.1:42047)
0811 00:58:56.015529 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:56.015614 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:56.016529 (+ 915us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:56.017170 (+ 641us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:56.017176 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:56.017545 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:58:56.017811 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:56.017818 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:56.019062 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:56.019063 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:56.020182 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:56.020186 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:56.020879 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:56.020880 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:56.021033 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:56.021743 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:58:56.021752 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:58:56.023802 (+ 2050us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:58:56.026421 (+ 2619us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:56.026434 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:56.026437 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:56.026930 (+ 493us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:56.027406 (+ 476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:56.027407 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:56.027407 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:56.027580 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:56.028252 (+ 672us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:58:56.028263 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:58:56.028467 (+ 204us) client_negotiation.cc:769] Sending connection context
0811 00:58:56.028582 (+ 115us) client_negotiation.cc:240] Negotiation successful
0811 00:58:56.028792 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":167,"threads_started":1}
I20260811 00:58:56.029232 9714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:56.015423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:42047 (local address 127.15.70.62:39031)
0811 00:58:56.015626 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:56.015638 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:56.015836 (+ 198us) server_negotiation.cc:407] Connection header received
0811 00:58:56.016875 (+ 1039us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:56.016882 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:56.016940 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:56.017131 (+ 191us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:56.017945 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:56.018904 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:56.020288 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:56.020755 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:56.020908 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:56.023960 (+ 3052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:56.023965 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:56.023966 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:56.023982 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:56.026279 (+ 2297us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:56.027121 (+ 842us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:56.027126 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:56.027127 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:56.027299 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:56.027696 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:56.027697 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:56.027698 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:56.028128 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:56.028245 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:56.028717 (+ 472us) server_negotiation.cc:299] Negotiation successful
0811 00:58:56.028918 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":109,"threads_started":1}
I20260811 00:58:56.030164 9711 heartbeater.cc:347] Connected to a master server at 127.15.70.62:39031
I20260811 00:58:56.030319 9711 heartbeater.cc:464] Registering TS with master...
I20260811 00:58:56.030593 9711 heartbeater.cc:511] Master 127.15.70.62:39031 requested a full tablet report, sending...
I20260811 00:58:56.031755 9417 ts_manager.cc:194] Registered new tserver with Master: 47d4770dac934e05955dc1b823da0885 (127.15.70.1:41193)
I20260811 00:58:56.033465 9417 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.1@KRBTEST.COM'} at 127.15.70.1:42047
I20260811 00:58:56.035434 9711 heartbeater.cc:503] Master 127.15.70.62:39031 was elected leader, sending a full tablet report...
Aug 11 00:58:56 dist-test-slave-h3ft krb5kdc[8530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409935, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for kudu/127.15.70.1@KRBTEST.COM
I20260811 00:58:56.043746 9719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:56.032754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:41193 (local address 127.0.0.1:45798)
0811 00:58:56.033236 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:56.033281 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:56.033409 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:56.033736 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:56.033743 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:56.034191 (+ 448us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:58:56.034266 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:56.034269 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:56.035322 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:56.035324 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:56.036143 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:56.036147 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:56.036679 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:56.036680 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:56.036777 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:56.037561 (+ 784us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:58:56.037566 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:58:56.039726 (+ 2160us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:58:56.042106 (+ 2380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:56.042118 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:56.042122 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:56.042391 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:56.042690 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:56.042691 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:56.042691 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:56.042768 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:56.043238 (+ 470us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:58:56.043247 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:58:56.043322 (+ 75us) client_negotiation.cc:769] Sending connection context
0811 00:58:56.043441 (+ 119us) client_negotiation.cc:240] Negotiation successful
0811 00:58:56.043621 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":171,"threads_started":1}
I20260811 00:58:56.043747 9720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:56.032829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45798 (local address 127.15.70.1:41193)
0811 00:58:56.033164 (+ 335us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:56.033169 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:56.033375 (+ 206us) server_negotiation.cc:407] Connection header received
0811 00:58:56.033532 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:56.033540 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:56.033555 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:56.033650 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:56.034358 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:56.035226 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:56.036247 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:56.036578 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:56.036679 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:56.039836 (+ 3157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:56.039848 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:56.039848 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:56.039865 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:56.041981 (+ 2116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:56.042530 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:56.042538 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:56.042539 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:56.042608 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:56.042844 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:56.042845 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:56.042846 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:56.043149 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:56.043253 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:56.043489 (+ 236us) server_negotiation.cc:299] Negotiation successful
0811 00:58:56.043621 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":211,"threads_started":1}
I20260811 00:58:56.044395 9609 tablet_service.cc:1514] Processing DeleteTablet for tablet c886ab2d0cd342dd8278a1aed87c52c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:58:35 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:45798
I20260811 00:58:56.045298 9721 tablet_replica.cc:330] stopping tablet replica
I20260811 00:58:56.045501 9721 raft_consensus.cc:2229] T c886ab2d0cd342dd8278a1aed87c52c5 P 47d4770dac934e05955dc1b823da0885 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:58:56.045612 9721 raft_consensus.cc:2258] T c886ab2d0cd342dd8278a1aed87c52c5 P 47d4770dac934e05955dc1b823da0885 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:58:56.046088 9721 ts_tablet_manager.cc:1905] T c886ab2d0cd342dd8278a1aed87c52c5 P 47d4770dac934e05955dc1b823da0885: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:58:56.049181 9721 ts_tablet_manager.cc:1918] T c886ab2d0cd342dd8278a1aed87c52c5 P 47d4770dac934e05955dc1b823da0885: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:58:56.049302 9721 log.cc:1196] T c886ab2d0cd342dd8278a1aed87c52c5 P 47d4770dac934e05955dc1b823da0885: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/wal/wals/c886ab2d0cd342dd8278a1aed87c52c5
I20260811 00:58:56.049607 9721 ts_tablet_manager.cc:1939] T c886ab2d0cd342dd8278a1aed87c52c5 P 47d4770dac934e05955dc1b823da0885: Deleting consensus metadata
I20260811 00:58:56.050442 9393 catalog_manager.cc:4841] TS 47d4770dac934e05955dc1b823da0885 (127.15.70.1:41193): tablet c886ab2d0cd342dd8278a1aed87c52c5 (table test-table [id=b17a8c6736ea482da26897904431b6c6]) successfully deleted
W20260811 00:58:56.132655 9718 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:58:56.132939 9718 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:58:56.132970 9718 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:58:56.134347 9718 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:58:56.134408 9718 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:58:56.134439 9718 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.2
I20260811 00:58:56.136143 9718 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:46229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.2:46601
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.70.2
--webserver_port=33831
--tserver_master_addrs=127.15.70.62:39031
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9718
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.2
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:58:56.136452 9718 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:58:56.136775 9718 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:58:56.143406 9734 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:56.143426 9731 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:58:56.143610 9718 server_base.cc:1034] running on GCE node
W20260811 00:58:56.143535 9730 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:58:56.144081 9718 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:58:56.144472 9718 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:58:56.145692 9718 hybrid_clock.cc:648] HybridClock initialized: now 1786409936145671 us; error 59 us; skew 500 ppm
Aug 11 00:58:56 dist-test-slave-h3ft krb5kdc[8530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409936, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:58:56.149487 9718 init.cc:377] Logged in from keytab as kudu/127.15.70.2@KRBTEST.COM (short username kudu)
I20260811 00:58:56.150127 9718 webserver.cc:460] Webserver started at http://127.15.70.2:33831/ using document root <none> and password file <none>
I20260811 00:58:56.150447 9718 fs_manager.cc:359] Metadata directory not provided
I20260811 00:58:56.150559 9718 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:58:56.152535 9718 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:58:56.153550 9745 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:56.153991 9718 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:58:56.154186 9718 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/wal
uuid: "57adc460061b47c8802f20d2e535033a"
format_stamp: "Formatted at 2026-08-11 00:58:35 on dist-test-slave-h3ft"
server_key: "a59ef882d87d6c4675657d577785e4fc"
server_key_iv: "f4fdcc9623c70d5e6efb1f1e88e8090c"
server_key_version: "encryptionkey@0"
I20260811 00:58:56.154825 9718 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:58:56.170280 9718 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:58:56.173280 9718 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:58:56.173482 9718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:58:56.173801 9718 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:58:56.174222 9718 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:58:56.174295 9718 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:56.174348 9718 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:58:56.174378 9718 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:56.183101 9718 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.2:46601
I20260811 00:58:56.183231 9916 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.2:46601 every 8 connection(s)
I20260811 00:58:56.183688 9718 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
Aug 11 00:58:56 dist-test-slave-h3ft krb5kdc[8530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409936, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:58:56.193547 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 9718
I20260811 00:58:56.193981 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.3:34019
--local_ip_for_outbound_sockets=127.15.70.3
--tserver_master_addrs=127.15.70.62:39031
--webserver_port=41469
--webserver_interface=127.15.70.3
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:46229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 00:58:56.196436 9714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:56.184972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:46665 (local address 127.15.70.62:39031)
0811 00:58:56.185047 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:56.185050 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:56.185127 (+ 77us) server_negotiation.cc:407] Connection header received
0811 00:58:56.185850 (+ 723us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:56.185852 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:56.185866 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:56.185956 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:56.187321 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:56.187857 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:56.189184 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:56.189418 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:56.189502 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:56.192466 (+ 2964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:56.192469 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:56.192469 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:56.192482 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:56.194502 (+ 2020us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:56.195212 (+ 710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:56.195214 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:56.195214 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:56.195287 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:56.195607 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:56.195608 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:56.195608 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:56.195759 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:56.195850 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:56.196208 (+ 358us) server_negotiation.cc:299] Negotiation successful
0811 00:58:56.196319 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 00:58:56.196712 9920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:56.184604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.2:46665)
0811 00:58:56.184896 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:56.184961 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:56.185695 (+ 734us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:56.186055 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:56.186060 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:56.186868 (+ 808us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:58:56.187186 (+ 318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:56.187195 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:56.188010 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:56.188012 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:56.189033 (+ 1021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:56.189037 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:56.189532 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:56.189533 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:56.189673 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:56.190365 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:58:56.190376 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:58:56.192303 (+ 1927us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:58:56.194653 (+ 2350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:56.194672 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:56.194675 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:56.195092 (+ 417us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:56.195370 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:56.195371 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:56.195371 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:56.195518 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:56.195841 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:58:56.195849 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:58:56.196043 (+ 194us) client_negotiation.cc:769] Sending connection context
0811 00:58:56.196168 (+ 125us) client_negotiation.cc:240] Negotiation successful
0811 00:58:56.196394 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":115,"threads_started":1}
I20260811 00:58:56.197571 9917 heartbeater.cc:347] Connected to a master server at 127.15.70.62:39031
I20260811 00:58:56.197817 9917 heartbeater.cc:464] Registering TS with master...
I20260811 00:58:56.198099 9917 heartbeater.cc:511] Master 127.15.70.62:39031 requested a full tablet report, sending...
I20260811 00:58:56.198645 9417 ts_manager.cc:194] Registered new tserver with Master: 57adc460061b47c8802f20d2e535033a (127.15.70.2:46601)
I20260811 00:58:56.199189 9417 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.2@KRBTEST.COM'} at 127.15.70.2:46665
W20260811 00:58:56.297628 9921 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:58:56.297935 9921 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:58:56.297974 9921 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:58:56.299228 9921 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:58:56.299301 9921 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:58:56.299360 9921 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.3
I20260811 00:58:56.301014 9921 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:46229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.3:34019
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.70.3
--webserver_port=41469
--tserver_master_addrs=127.15.70.62:39031
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9921
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.3
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:58:56.301334 9921 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:58:56.301623 9921 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:58:56.308089 9927 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:56.308089 9930 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:58:56.308117 9932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:58:56.308434 9921 server_base.cc:1034] running on GCE node
I20260811 00:58:56.308723 9921 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:58:56.309006 9921 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:58:56.310220 9921 hybrid_clock.cc:648] HybridClock initialized: now 1786409936310205 us; error 38 us; skew 500 ppm
Aug 11 00:58:56 dist-test-slave-h3ft krb5kdc[8530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409936, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:58:56.313561 9921 init.cc:377] Logged in from keytab as kudu/127.15.70.3@KRBTEST.COM (short username kudu)
I20260811 00:58:56.314112 9921 webserver.cc:460] Webserver started at http://127.15.70.3:41469/ using document root <none> and password file <none>
I20260811 00:58:56.314397 9921 fs_manager.cc:359] Metadata directory not provided
I20260811 00:58:56.314465 9921 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:58:56.316190 9921 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:58:56.317086 9944 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:56.317381 9921 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:58:56.317546 9921 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/wal
uuid: "b22dd4d3a91a4d9a94637ac6c5ca5a18"
format_stamp: "Formatted at 2026-08-11 00:58:35 on dist-test-slave-h3ft"
server_key: "a1fae95a444fad638ab36e48a47871f4"
server_key_iv: "9d9407e7f4b55815538d9b3db4cfe3c9"
server_key_version: "encryptionkey@0"
I20260811 00:58:56.318089 9921 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:58:56.331733 9921 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:58:56.334348 9921 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:58:56.334514 9921 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:58:56.334781 9921 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:58:56.335248 9921 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:58:56.335304 9921 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:56.335331 9921 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:58:56.335366 9921 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:58:56.343152 9921 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.3:34019
I20260811 00:58:56.343295 10105 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.3:34019 every 8 connection(s)
I20260811 00:58:56.343680 9921 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
Aug 11 00:58:56 dist-test-slave-h3ft krb5kdc[8530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409936, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:58:56.353736 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 9921
I20260811 00:58:56.355634 9714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:56.344821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:53425 (local address 127.15.70.62:39031)
0811 00:58:56.344933 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:56.344936 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:56.345188 (+ 252us) server_negotiation.cc:407] Connection header received
0811 00:58:56.345778 (+ 590us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:56.345779 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:56.345793 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:56.345891 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:56.347128 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:56.347680 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:56.348792 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:56.349042 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:56.349112 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:56.351987 (+ 2875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:56.351990 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:56.351990 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:56.352001 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:56.353577 (+ 1576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:56.354160 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:56.354161 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:56.354162 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:56.354244 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:56.354653 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:56.354654 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:56.354655 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:56.354786 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:56.354861 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:56.355397 (+ 536us) server_negotiation.cc:299] Negotiation successful
0811 00:58:56.355545 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 00:58:56.356303 10111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:56.344726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.3:53425)
0811 00:58:56.345014 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:56.345065 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:56.345655 (+ 590us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:56.345981 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:56.345984 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:56.346745 (+ 761us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:58:56.346988 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:56.346994 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:56.347794 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:56.347794 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:56.348696 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:56.348699 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:56.349156 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:56.349158 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:56.349280 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:56.349925 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:58:56.349934 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:58:56.351758 (+ 1824us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:58:56.353691 (+ 1933us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:56.353699 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:56.353702 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:56.354066 (+ 364us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:56.354346 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:58:56.354347 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:58:56.354347 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:58:56.354566 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:58:56.354863 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:58:56.354872 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:58:56.355176 (+ 304us) client_negotiation.cc:769] Sending connection context
0811 00:58:56.355811 (+ 635us) client_negotiation.cc:240] Negotiation successful
0811 00:58:56.356028 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":122,"threads_started":1}
I20260811 00:58:56.356958 10107 heartbeater.cc:347] Connected to a master server at 127.15.70.62:39031
I20260811 00:58:56.357113 10107 heartbeater.cc:464] Registering TS with master...
I20260811 00:58:56.357366 10107 heartbeater.cc:511] Master 127.15.70.62:39031 requested a full tablet report, sending...
I20260811 00:58:56.357890 9417 ts_manager.cc:194] Registered new tserver with Master: b22dd4d3a91a4d9a94637ac6c5ca5a18 (127.15.70.3:34019)
I20260811 00:58:56.358314 9417 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.3@KRBTEST.COM'} at 127.15.70.3:53425
I20260811 00:58:56.362349 10114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:56.354312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57200 (local address 127.15.70.62:39031)
0811 00:58:56.354484 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:56.354486 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:56.354594 (+ 108us) server_negotiation.cc:407] Connection header received
0811 00:58:56.354705 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:56.354706 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:56.354720 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:56.354817 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:56.355613 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:56.356409 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:56.357609 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:56.357897 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:56.357978 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:56.359552 (+ 1574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:56.359553 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:56.359554 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:56.359561 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:56.361149 (+ 1588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:56.361620 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:56.361622 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:56.361622 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:56.361684 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:56.361871 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:56.361871 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:56.361872 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:56.361981 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:56.362131 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:56.362160 (+ 29us) server_negotiation.cc:299] Negotiation successful
0811 00:58:56.362235 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":93,"threads_started":1}
I20260811 00:58:56.363444 15640 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 00:58:56.366627 10114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:56.363883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57206 (local address 127.15.70.62:39031)
0811 00:58:56.363943 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:56.363945 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:56.364078 (+ 133us) server_negotiation.cc:407] Connection header received
0811 00:58:56.364142 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:56.364142 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:56.364184 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:56.364255 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:58:56.364392 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:56.364908 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:56.365700 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:56.365928 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:56.366000 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:56.366210 (+ 210us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:58:56.366271 (+ 61us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0811 00:58:56.366570 (+ 299us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:57206: token expired
Metrics: {"server-negotiator.queue_time_us":34}
W20260811 00:58:56.366684 10114 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:57206: token expired
W20260811 00:58:56.366879 9310 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.15.70.62:39031)
I20260811 00:58:56.373674 10114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:56.367273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57218 (local address 127.15.70.62:39031)
0811 00:58:56.367314 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:56.367315 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:56.367323 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:58:56.367345 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:56.367346 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:56.367355 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:56.367443 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:58:56.367911 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:56.368436 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:56.369112 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:56.369287 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:56.369343 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:56.370547 (+ 1204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:58:56.370548 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:58:56.370548 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:58:56.370554 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:58:56.372322 (+ 1768us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:56.372816 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:56.372817 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:56.372818 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:56.372890 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:58:56.373110 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:58:56.373111 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:58:56.373112 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:58:56.373238 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:58:56.373363 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:56.373466 (+ 103us) server_negotiation.cc:299] Negotiation successful
0811 00:58:56.373552 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 00:58:56.375223 9417 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57218:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:58:56.377537 9417 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:58:56.381033 9609 tablet_service.cc:1467] Processing CreateTablet for tablet b6632ea34cae4742a0c59f52ae39f65e (DEFAULT_TABLE table=test-table [id=f4781c4a84254db2a68c130944949733]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:58:56.381322 9609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6632ea34cae4742a0c59f52ae39f65e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:58:56.382951 9541 tablet_bootstrap.cc:492] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885: Bootstrap starting.
I20260811 00:58:56.383526 9541 tablet_bootstrap.cc:654] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885: Neither blocks nor log segments found. Creating new log.
I20260811 00:58:56.384217 9541 tablet_bootstrap.cc:492] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885: No bootstrap required, opened a new log
I20260811 00:58:56.384285 9541 ts_tablet_manager.cc:1397] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 00:58:56.384776 9541 raft_consensus.cc:348] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b22dd4d3a91a4d9a94637ac6c5ca5a18" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34019 } } peers { permanent_uuid: "57adc460061b47c8802f20d2e535033a" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46601 } } peers { permanent_uuid: "47d4770dac934e05955dc1b823da0885" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 41193 } }
I20260811 00:58:56.384902 9541 raft_consensus.cc:374] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:58:56.384970 9541 raft_consensus.cc:729] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47d4770dac934e05955dc1b823da0885, State: Initialized, Role: FOLLOWER
I20260811 00:58:56.385025 9541 consensus_queue.cc:260] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b22dd4d3a91a4d9a94637ac6c5ca5a18" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34019 } } peers { permanent_uuid: "57adc460061b47c8802f20d2e535033a" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46601 } } peers { permanent_uuid: "47d4770dac934e05955dc1b823da0885" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 41193 } }
I20260811 00:58:56.385131 9541 ts_tablet_manager.cc:1428] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 00:58:56.385437 9719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:56.380469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.2:46601 (local address 127.0.0.1:40650)
0811 00:58:56.380534 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:56.380547 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:56.380590 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:56.381495 (+ 905us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:56.381496 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:56.381498 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:58:56.381566 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:56.381568 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:56.382786 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:56.382787 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:56.384049 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:56.384053 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:56.385084 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:56.385086 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:56.385168 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:56.385202 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 00:58:56.385236 (+ 34us) client_negotiation.cc:240] Negotiation successful
0811 00:58:56.385309 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260811 00:58:56.385741 10123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:56.380469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:34019 (local address 127.0.0.1:35044)
0811 00:58:56.380837 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:56.380850 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:56.380924 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:56.381230 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:56.381232 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:56.381234 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:58:56.381300 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:56.381303 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:56.382673 (+ 1370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:56.382674 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:56.384255 (+ 1581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:56.384259 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:56.385467 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:56.385467 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:56.385545 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:56.385550 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 00:58:56.385600 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 00:58:56.385656 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":345,"mutex_wait_us":321,"thread_start_us":65,"threads_started":1}
I20260811 00:58:56.385756 10124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:56.380596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35044 (local address 127.15.70.3:34019)
0811 00:58:56.380851 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:56.380857 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:56.380922 (+ 65us) server_negotiation.cc:407] Connection header received
0811 00:58:56.381009 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:56.381011 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:56.381027 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:56.381131 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:58:56.381400 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:56.382566 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:56.384371 (+ 1805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:56.385199 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:56.385253 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:56.385318 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:56.385620 (+ 302us) server_negotiation.cc:299] Negotiation successful
0811 00:58:56.385665 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":217,"thread_start_us":132,"threads_started":1}
I20260811 00:58:56.386030 10126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:56.380792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40650 (local address 127.15.70.2:46601)
0811 00:58:56.381321 (+ 529us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:56.381325 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:56.381336 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:58:56.381381 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:56.381384 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:56.381398 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:56.381489 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:58:56.381660 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:56.382672 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:56.384157 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:56.384874 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:56.385712 (+ 838us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:56.385797 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:56.385829 (+ 32us) server_negotiation.cc:299] Negotiation successful
0811 00:58:56.385900 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":475,"thread_start_us":194,"threads_started":1}
I20260811 00:58:56.386811 10018 tablet_service.cc:1467] Processing CreateTablet for tablet b6632ea34cae4742a0c59f52ae39f65e (DEFAULT_TABLE table=test-table [id=f4781c4a84254db2a68c130944949733]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:58:56.387084 9812 tablet_service.cc:1467] Processing CreateTablet for tablet b6632ea34cae4742a0c59f52ae39f65e (DEFAULT_TABLE table=test-table [id=f4781c4a84254db2a68c130944949733]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:58:56.387243 10018 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6632ea34cae4742a0c59f52ae39f65e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:58:56.387497 9812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6632ea34cae4742a0c59f52ae39f65e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:58:56.390466 10128 tablet_bootstrap.cc:492] T b6632ea34cae4742a0c59f52ae39f65e P b22dd4d3a91a4d9a94637ac6c5ca5a18: Bootstrap starting.
I20260811 00:58:56.391091 10129 tablet_bootstrap.cc:492] T b6632ea34cae4742a0c59f52ae39f65e P 57adc460061b47c8802f20d2e535033a: Bootstrap starting.
I20260811 00:58:56.391940 10129 tablet_bootstrap.cc:654] T b6632ea34cae4742a0c59f52ae39f65e P 57adc460061b47c8802f20d2e535033a: Neither blocks nor log segments found. Creating new log.
I20260811 00:58:56.391938 10128 tablet_bootstrap.cc:654] T b6632ea34cae4742a0c59f52ae39f65e P b22dd4d3a91a4d9a94637ac6c5ca5a18: Neither blocks nor log segments found. Creating new log.
I20260811 00:58:56.392781 10129 log.cc:824] T b6632ea34cae4742a0c59f52ae39f65e P 57adc460061b47c8802f20d2e535033a: Log is configured to *not* fsync() on all Append() calls
I20260811 00:58:56.392781 10128 log.cc:824] T b6632ea34cae4742a0c59f52ae39f65e P b22dd4d3a91a4d9a94637ac6c5ca5a18: Log is configured to *not* fsync() on all Append() calls
I20260811 00:58:56.393651 10128 tablet_bootstrap.cc:492] T b6632ea34cae4742a0c59f52ae39f65e P b22dd4d3a91a4d9a94637ac6c5ca5a18: No bootstrap required, opened a new log
I20260811 00:58:56.393718 10128 ts_tablet_manager.cc:1397] T b6632ea34cae4742a0c59f52ae39f65e P b22dd4d3a91a4d9a94637ac6c5ca5a18: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 00:58:56.395372 10129 tablet_bootstrap.cc:492] T b6632ea34cae4742a0c59f52ae39f65e P 57adc460061b47c8802f20d2e535033a: No bootstrap required, opened a new log
I20260811 00:58:56.395464 10129 ts_tablet_manager.cc:1397] T b6632ea34cae4742a0c59f52ae39f65e P 57adc460061b47c8802f20d2e535033a: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260811 00:58:56.395839 10128 raft_consensus.cc:348] T b6632ea34cae4742a0c59f52ae39f65e P b22dd4d3a91a4d9a94637ac6c5ca5a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b22dd4d3a91a4d9a94637ac6c5ca5a18" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34019 } } peers { permanent_uuid: "57adc460061b47c8802f20d2e535033a" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46601 } } peers { permanent_uuid: "47d4770dac934e05955dc1b823da0885" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 41193 } }
I20260811 00:58:56.396073 10128 raft_consensus.cc:374] T b6632ea34cae4742a0c59f52ae39f65e P b22dd4d3a91a4d9a94637ac6c5ca5a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:58:56.396114 10128 raft_consensus.cc:729] T b6632ea34cae4742a0c59f52ae39f65e P b22dd4d3a91a4d9a94637ac6c5ca5a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b22dd4d3a91a4d9a94637ac6c5ca5a18, State: Initialized, Role: FOLLOWER
I20260811 00:58:56.396256 10128 consensus_queue.cc:260] T b6632ea34cae4742a0c59f52ae39f65e P b22dd4d3a91a4d9a94637ac6c5ca5a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b22dd4d3a91a4d9a94637ac6c5ca5a18" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34019 } } peers { permanent_uuid: "57adc460061b47c8802f20d2e535033a" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46601 } } peers { permanent_uuid: "47d4770dac934e05955dc1b823da0885" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 41193 } }
I20260811 00:58:56.396636 10128 ts_tablet_manager.cc:1428] T b6632ea34cae4742a0c59f52ae39f65e P b22dd4d3a91a4d9a94637ac6c5ca5a18: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 00:58:56.396698 10107 heartbeater.cc:503] Master 127.15.70.62:39031 was elected leader, sending a full tablet report...
I20260811 00:58:56.397709 10129 raft_consensus.cc:348] T b6632ea34cae4742a0c59f52ae39f65e P 57adc460061b47c8802f20d2e535033a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b22dd4d3a91a4d9a94637ac6c5ca5a18" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34019 } } peers { permanent_uuid: "57adc460061b47c8802f20d2e535033a" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46601 } } peers { permanent_uuid: "47d4770dac934e05955dc1b823da0885" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 41193 } }
I20260811 00:58:56.397907 10129 raft_consensus.cc:374] T b6632ea34cae4742a0c59f52ae39f65e P 57adc460061b47c8802f20d2e535033a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:58:56.397977 10129 raft_consensus.cc:729] T b6632ea34cae4742a0c59f52ae39f65e P 57adc460061b47c8802f20d2e535033a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57adc460061b47c8802f20d2e535033a, State: Initialized, Role: FOLLOWER
I20260811 00:58:56.398104 10129 consensus_queue.cc:260] T b6632ea34cae4742a0c59f52ae39f65e P 57adc460061b47c8802f20d2e535033a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b22dd4d3a91a4d9a94637ac6c5ca5a18" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34019 } } peers { permanent_uuid: "57adc460061b47c8802f20d2e535033a" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46601 } } peers { permanent_uuid: "47d4770dac934e05955dc1b823da0885" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 41193 } }
I20260811 00:58:56.398458 10129 ts_tablet_manager.cc:1428] T b6632ea34cae4742a0c59f52ae39f65e P 57adc460061b47c8802f20d2e535033a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 00:58:56.398535 9917 heartbeater.cc:503] Master 127.15.70.62:39031 was elected leader, sending a full tablet report...
W20260811 00:58:56.434466 9919 tablet.cc:2369] T b6632ea34cae4742a0c59f52ae39f65e P 57adc460061b47c8802f20d2e535033a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 00:58:56.502923 10134 raft_consensus.cc:482] T b6632ea34cae4742a0c59f52ae39f65e P b22dd4d3a91a4d9a94637ac6c5ca5a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:58:56.503135 10134 raft_consensus.cc:504] T b6632ea34cae4742a0c59f52ae39f65e P b22dd4d3a91a4d9a94637ac6c5ca5a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b22dd4d3a91a4d9a94637ac6c5ca5a18" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34019 } } peers { permanent_uuid: "57adc460061b47c8802f20d2e535033a" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46601 } } peers { permanent_uuid: "47d4770dac934e05955dc1b823da0885" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 41193 } }
I20260811 00:58:56.503602 10134 leader_election.cc:288] T b6632ea34cae4742a0c59f52ae39f65e P b22dd4d3a91a4d9a94637ac6c5ca5a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57adc460061b47c8802f20d2e535033a (127.15.70.2:46601), 47d4770dac934e05955dc1b823da0885 (127.15.70.1:41193)
I20260811 00:58:56.508191 9720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:56.503970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:48325 (local address 127.15.70.1:41193)
0811 00:58:56.504075 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:56.504077 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:56.504549 (+ 472us) server_negotiation.cc:407] Connection header received
0811 00:58:56.504591 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:56.504592 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:56.504631 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:56.504721 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:58:56.504879 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:56.505623 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:56.506976 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:56.507683 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:56.507750 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:56.507847 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:56.508067 (+ 220us) server_negotiation.cc:299] Negotiation successful
0811 00:58:56.508120 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 00:58:56.508189 10126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:56.504002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:34733 (local address 127.15.70.2:46601)
0811 00:58:56.504061 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:56.504063 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:56.504105 (+ 42us) server_negotiation.cc:407] Connection header received
0811 00:58:56.504208 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:56.504209 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:56.504225 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:56.504306 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:58:56.504589 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:56.505382 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:56.506976 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:56.507654 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:56.507749 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:56.507771 (+ 22us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:56.508050 (+ 279us) server_negotiation.cc:299] Negotiation successful
0811 00:58:56.508107 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 00:58:56.508168 10111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:56.503885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.2:46601 (local address 127.15.70.3:34733)
0811 00:58:56.504027 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:56.504043 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:56.504117 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:56.504348 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:56.504350 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:56.504353 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:58:56.504463 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:56.504466 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:56.505475 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:56.505476 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:56.506845 (+ 1369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:56.506847 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:56.507785 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:56.507786 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:56.507958 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:56.507969 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 00:58:56.508027 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 00:58:56.508070 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":85,"mutex_wait_us":2}
I20260811 00:58:56.508181 10136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:56.503890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:41193 (local address 127.15.70.3:48325)
0811 00:58:56.504384 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:56.504403 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 00:58:56.504485 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:58:56.504733 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:58:56.504734 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:58:56.504736 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:58:56.504797 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:56.504798 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:56.505706 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:56.505707 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:56.506844 (+ 1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:58:56.506847 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:58:56.507785 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:58:56.507786 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:58:56.507886 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:56.507893 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 00:58:56.507979 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 00:58:56.508045 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":472,"mutex_wait_us":199,"thread_start_us":145,"threads_started":1}
I20260811 00:58:56.508746 9844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6632ea34cae4742a0c59f52ae39f65e" candidate_uuid: "b22dd4d3a91a4d9a94637ac6c5ca5a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57adc460061b47c8802f20d2e535033a" is_pre_election: true
I20260811 00:58:56.509001 9844 raft_consensus.cc:2454] T b6632ea34cae4742a0c59f52ae39f65e P 57adc460061b47c8802f20d2e535033a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b22dd4d3a91a4d9a94637ac6c5ca5a18 in term 0.
I20260811 00:58:56.509004 9638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6632ea34cae4742a0c59f52ae39f65e" candidate_uuid: "b22dd4d3a91a4d9a94637ac6c5ca5a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47d4770dac934e05955dc1b823da0885" is_pre_election: true
I20260811 00:58:56.509203 9638 raft_consensus.cc:2454] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b22dd4d3a91a4d9a94637ac6c5ca5a18 in term 0.
I20260811 00:58:56.509321 9948 leader_election.cc:302] T b6632ea34cae4742a0c59f52ae39f65e P b22dd4d3a91a4d9a94637ac6c5ca5a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57adc460061b47c8802f20d2e535033a, b22dd4d3a91a4d9a94637ac6c5ca5a18; no voters:
I20260811 00:58:56.509509 10134 raft_consensus.cc:2781] T b6632ea34cae4742a0c59f52ae39f65e P b22dd4d3a91a4d9a94637ac6c5ca5a18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:58:56.509598 10134 raft_consensus.cc:482] T b6632ea34cae4742a0c59f52ae39f65e P b22dd4d3a91a4d9a94637ac6c5ca5a18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:58:56.509617 10134 raft_consensus.cc:3037] T b6632ea34cae4742a0c59f52ae39f65e P b22dd4d3a91a4d9a94637ac6c5ca5a18 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:58:56.510504 10134 raft_consensus.cc:504] T b6632ea34cae4742a0c59f52ae39f65e P b22dd4d3a91a4d9a94637ac6c5ca5a18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b22dd4d3a91a4d9a94637ac6c5ca5a18" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34019 } } peers { permanent_uuid: "57adc460061b47c8802f20d2e535033a" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46601 } } peers { permanent_uuid: "47d4770dac934e05955dc1b823da0885" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 41193 } }
I20260811 00:58:56.510682 10134 leader_election.cc:288] T b6632ea34cae4742a0c59f52ae39f65e P b22dd4d3a91a4d9a94637ac6c5ca5a18 [CANDIDATE]: Term 1 election: Requested vote from peers 57adc460061b47c8802f20d2e535033a (127.15.70.2:46601), 47d4770dac934e05955dc1b823da0885 (127.15.70.1:41193)
I20260811 00:58:56.510923 9844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6632ea34cae4742a0c59f52ae39f65e" candidate_uuid: "b22dd4d3a91a4d9a94637ac6c5ca5a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57adc460061b47c8802f20d2e535033a"
I20260811 00:58:56.510921 9638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6632ea34cae4742a0c59f52ae39f65e" candidate_uuid: "b22dd4d3a91a4d9a94637ac6c5ca5a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47d4770dac934e05955dc1b823da0885"
I20260811 00:58:56.511066 9638 raft_consensus.cc:3037] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:58:56.511056 9844 raft_consensus.cc:3037] T b6632ea34cae4742a0c59f52ae39f65e P 57adc460061b47c8802f20d2e535033a [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:58:56.511905 9638 raft_consensus.cc:2454] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b22dd4d3a91a4d9a94637ac6c5ca5a18 in term 1.
I20260811 00:58:56.512110 9947 leader_election.cc:302] T b6632ea34cae4742a0c59f52ae39f65e P b22dd4d3a91a4d9a94637ac6c5ca5a18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47d4770dac934e05955dc1b823da0885, b22dd4d3a91a4d9a94637ac6c5ca5a18; no voters:
I20260811 00:58:56.512251 10134 raft_consensus.cc:2781] T b6632ea34cae4742a0c59f52ae39f65e P b22dd4d3a91a4d9a94637ac6c5ca5a18 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:58:56.512264 9844 raft_consensus.cc:2454] T b6632ea34cae4742a0c59f52ae39f65e P 57adc460061b47c8802f20d2e535033a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b22dd4d3a91a4d9a94637ac6c5ca5a18 in term 1.
I20260811 00:58:56.512480 10134 raft_consensus.cc:686] T b6632ea34cae4742a0c59f52ae39f65e P b22dd4d3a91a4d9a94637ac6c5ca5a18 [term 1 LEADER]: Becoming Leader. State: Replica: b22dd4d3a91a4d9a94637ac6c5ca5a18, State: Running, Role: LEADER
I20260811 00:58:56.512629 10134 consensus_queue.cc:237] T b6632ea34cae4742a0c59f52ae39f65e P b22dd4d3a91a4d9a94637ac6c5ca5a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b22dd4d3a91a4d9a94637ac6c5ca5a18" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34019 } } peers { permanent_uuid: "57adc460061b47c8802f20d2e535033a" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46601 } } peers { permanent_uuid: "47d4770dac934e05955dc1b823da0885" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 41193 } }
I20260811 00:58:56.513698 9417 catalog_manager.cc:5495] T b6632ea34cae4742a0c59f52ae39f65e P b22dd4d3a91a4d9a94637ac6c5ca5a18 reported cstate change: term changed from 0 to 1, leader changed from <none> to b22dd4d3a91a4d9a94637ac6c5ca5a18 (127.15.70.3). New cstate: current_term: 1 leader_uuid: "b22dd4d3a91a4d9a94637ac6c5ca5a18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b22dd4d3a91a4d9a94637ac6c5ca5a18" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57adc460061b47c8802f20d2e535033a" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47d4770dac934e05955dc1b823da0885" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 41193 } health_report { overall_health: UNKNOWN } } }
W20260811 00:58:56.515039 9712 tablet.cc:2369] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 00:58:56.535630 10124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:56.532988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35048 (local address 127.15.70.3:34019)
0811 00:58:56.533072 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 00:58:56.533074 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:58:56.533084 (+ 10us) server_negotiation.cc:407] Connection header received
0811 00:58:56.533186 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:58:56.533187 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:58:56.533213 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:58:56.533281 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:58:56.533423 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:56.533930 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:56.534755 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:58:56.534960 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:58:56.535041 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:58:56.535243 (+ 202us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:58:56.535370 (+ 127us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:58:56.535444 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 00:58:56.535492 (+ 48us) server_negotiation.cc:299] Negotiation successful
0811 00:58:56.535516 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 00:58:56.537973 9844 raft_consensus.cc:1261] T b6632ea34cae4742a0c59f52ae39f65e P 57adc460061b47c8802f20d2e535033a [term 1 FOLLOWER]: Refusing update from remote peer b22dd4d3a91a4d9a94637ac6c5ca5a18: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:58:56.538017 9638 raft_consensus.cc:1261] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [term 1 FOLLOWER]: Refusing update from remote peer b22dd4d3a91a4d9a94637ac6c5ca5a18: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:58:56.538424 10134 consensus_queue.cc:1035] T b6632ea34cae4742a0c59f52ae39f65e P b22dd4d3a91a4d9a94637ac6c5ca5a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47d4770dac934e05955dc1b823da0885" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 41193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:58:56.538582 10138 consensus_queue.cc:1035] T b6632ea34cae4742a0c59f52ae39f65e P b22dd4d3a91a4d9a94637ac6c5ca5a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57adc460061b47c8802f20d2e535033a" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:58:56.541678 10144 mvcc.cc:205] Tried to move back new op lower bound from 7317135100056289280 to 7317135099956559872. Current Snapshot: MvccSnapshot[applied={T|T < 7317135100056289280}]
I20260811 00:58:56.544392 9417 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57218:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:58:56.544507 9417 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57218:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:58:56.545437 9417 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f: Sending DeleteTablet for 3 replicas of tablet b6632ea34cae4742a0c59f52ae39f65e
I20260811 00:58:56.545781 10018 tablet_service.cc:1514] Processing DeleteTablet for tablet b6632ea34cae4742a0c59f52ae39f65e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:58:56 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:35044
I20260811 00:58:56.545801 9812 tablet_service.cc:1514] Processing DeleteTablet for tablet b6632ea34cae4742a0c59f52ae39f65e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:58:56 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:40650
I20260811 00:58:56.546203 9609 tablet_service.cc:1514] Processing DeleteTablet for tablet b6632ea34cae4742a0c59f52ae39f65e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:58:56 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:45798
I20260811 00:58:56.546279 10155 tablet_replica.cc:330] T b6632ea34cae4742a0c59f52ae39f65e P b22dd4d3a91a4d9a94637ac6c5ca5a18: stopping tablet replica
I20260811 00:58:56.546321 9721 tablet_replica.cc:330] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885: stopping tablet replica
I20260811 00:58:56.546353 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 9482
I20260811 00:58:56.546382 9721 raft_consensus.cc:2229] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:58:56.546389 10155 raft_consensus.cc:2229] T b6632ea34cae4742a0c59f52ae39f65e P b22dd4d3a91a4d9a94637ac6c5ca5a18 [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:58:56.546438 9721 raft_consensus.cc:2258] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:58:56.546542 10155 raft_consensus.cc:2258] T b6632ea34cae4742a0c59f52ae39f65e P b22dd4d3a91a4d9a94637ac6c5ca5a18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:58:56.561389 10155 ts_tablet_manager.cc:1905] T b6632ea34cae4742a0c59f52ae39f65e P b22dd4d3a91a4d9a94637ac6c5ca5a18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:58:56.563239 10157 tablet_replica.cc:330] T b6632ea34cae4742a0c59f52ae39f65e P 57adc460061b47c8802f20d2e535033a: stopping tablet replica
I20260811 00:58:56.563444 10157 raft_consensus.cc:2229] T b6632ea34cae4742a0c59f52ae39f65e P 57adc460061b47c8802f20d2e535033a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:58:56.563654 10157 raft_consensus.cc:2258] T b6632ea34cae4742a0c59f52ae39f65e P 57adc460061b47c8802f20d2e535033a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:58:56.563699 10155 ts_tablet_manager.cc:1918] T b6632ea34cae4742a0c59f52ae39f65e P b22dd4d3a91a4d9a94637ac6c5ca5a18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:58:56.563827 10155 log.cc:1196] T b6632ea34cae4742a0c59f52ae39f65e P b22dd4d3a91a4d9a94637ac6c5ca5a18: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/wal/wals/b6632ea34cae4742a0c59f52ae39f65e
I20260811 00:58:56.564251 10155 ts_tablet_manager.cc:1939] T b6632ea34cae4742a0c59f52ae39f65e P b22dd4d3a91a4d9a94637ac6c5ca5a18: Deleting consensus metadata
I20260811 00:58:56.564849 10157 ts_tablet_manager.cc:1905] T b6632ea34cae4742a0c59f52ae39f65e P 57adc460061b47c8802f20d2e535033a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:58:56.565042 9395 catalog_manager.cc:4841] TS b22dd4d3a91a4d9a94637ac6c5ca5a18 (127.15.70.3:34019): tablet b6632ea34cae4742a0c59f52ae39f65e (table test-table [id=f4781c4a84254db2a68c130944949733]) successfully deleted
I20260811 00:58:56.566720 10157 ts_tablet_manager.cc:1918] T b6632ea34cae4742a0c59f52ae39f65e P 57adc460061b47c8802f20d2e535033a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:58:56.566799 10157 log.cc:1196] T b6632ea34cae4742a0c59f52ae39f65e P 57adc460061b47c8802f20d2e535033a: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/wal/wals/b6632ea34cae4742a0c59f52ae39f65e
I20260811 00:58:56.567148 10157 ts_tablet_manager.cc:1939] T b6632ea34cae4742a0c59f52ae39f65e P 57adc460061b47c8802f20d2e535033a: Deleting consensus metadata
I20260811 00:58:56.567763 9394 catalog_manager.cc:4841] TS 57adc460061b47c8802f20d2e535033a (127.15.70.2:46601): tablet b6632ea34cae4742a0c59f52ae39f65e (table test-table [id=f4781c4a84254db2a68c130944949733]) successfully deleted
W20260811 00:58:56.570734 9393 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.70.1:41193 (error 108)
I20260811 00:58:56.571461 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 9718
I20260811 00:58:56.571533 10123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:58:56.571345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:41193 (local address 127.0.0.1:45814)
0811 00:58:56.571432 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0811 00:58:56.571486 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.1:41193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260811 00:58:56.580703 9393 catalog_manager.cc:4584] TS 47d4770dac934e05955dc1b823da0885 (127.15.70.1:41193): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b6632ea34cae4742a0c59f52ae39f65e: Network error: Client connection negotiation failed: client connection to 127.15.70.1:41193: connect: Connection refused (error 111)
I20260811 00:58:56.589591 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 9921
I20260811 00:58:56.606839 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 9368
I20260811 00:59:16.622141 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:39031
--webserver_interface=127.15.70.62
--webserver_port=41265
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:46229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:39031
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:59:16.716455 10160 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:59:16.716704 10160 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:59:16.716727 10160 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:59:16.717931 10160 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 00:59:16.717983 10160 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 00:59:16.717998 10160 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 00:59:16.718008 10160 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:59:16.718022 10160 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:59:16.718035 10160 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:59:16.718098 10160 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:59:16.718116 10160 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:59:16.719745 10160 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:46229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:39031
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:39031
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=41265
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10160
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:59:16.720053 10160 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:59:16.720338 10160 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:59:16.726768 10175 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:16.726794 10171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:16.726795 10169 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:16.726887 10160 server_base.cc:1034] running on GCE node
I20260811 00:59:16.727543 10160 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:59:16.727953 10160 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:59:16.729139 10160 hybrid_clock.cc:648] HybridClock initialized: now 1786409956729122 us; error 42 us; skew 500 ppm
Aug 11 00:59:16 dist-test-slave-h3ft krb5kdc[8530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409956, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:59:16.732213 10160 init.cc:377] Logged in from keytab as kudu/127.15.70.62@KRBTEST.COM (short username kudu)
I20260811 00:59:16.732793 10160 webserver.cc:460] Webserver started at http://127.15.70.62:41265/ using document root <none> and password file <none>
I20260811 00:59:16.733081 10160 fs_manager.cc:359] Metadata directory not provided
I20260811 00:59:16.733160 10160 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:59:16.734732 10160 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:59:16.735770 10183 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:16.736088 10160 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:59:16.736218 10160 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "9509e9d198ab43748599b0b69444812f"
format_stamp: "Formatted at 2026-08-11 00:58:34 on dist-test-slave-h3ft"
server_key: "7dc897b60d7cd2bd54e8c7e8bf7a34cf"
server_key_iv: "ab85e0805fc7a6e771aa91c973b6eea7"
server_key_version: "encryptionkey@0"
I20260811 00:59:16.736631 10160 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:59:16.772543 10160 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:59:16.774901 10160 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:59:16.775116 10160 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:59:16.780042 10160 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:39031
I20260811 00:59:16.780179 10258 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:39031 every 8 connection(s)
I20260811 00:59:16.780579 10160 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:59:16.781527 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 10160
I20260811 00:59:16.781850 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.1:41193
--local_ip_for_outbound_sockets=127.15.70.1
--tserver_master_addrs=127.15.70.62:39031
--webserver_port=42501
--webserver_interface=127.15.70.1
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:46229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 00:59:16.782855 10259 sys_catalog.cc:263] Verifying existing consensus state
I20260811 00:59:16.783726 10259 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f: Bootstrap starting.
I20260811 00:59:16.795905 10259 log.cc:824] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f: Log is configured to *not* fsync() on all Append() calls
I20260811 00:59:16.798653 10259 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 00:59:16.799100 10259 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f: Bootstrap complete.
I20260811 00:59:16.801818 10259 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9509e9d198ab43748599b0b69444812f" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 39031 } }
I20260811 00:59:16.802127 10259 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9509e9d198ab43748599b0b69444812f, State: Initialized, Role: FOLLOWER
I20260811 00:59:16.802352 10259 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9509e9d198ab43748599b0b69444812f" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 39031 } }
I20260811 00:59:16.802445 10259 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:59:16.802510 10259 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:59:16.802553 10259 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [term 2 FOLLOWER]: Advancing to term 3
I20260811 00:59:16.803869 10259 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9509e9d198ab43748599b0b69444812f" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 39031 } }
I20260811 00:59:16.804044 10259 leader_election.cc:302] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9509e9d198ab43748599b0b69444812f; no voters:
I20260811 00:59:16.804303 10259 leader_election.cc:288] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 00:59:16.804350 10268 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [term 3 FOLLOWER]: Leader election won for term 3
I20260811 00:59:16.804524 10268 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [term 3 LEADER]: Becoming Leader. State: Replica: 9509e9d198ab43748599b0b69444812f, State: Running, Role: LEADER
I20260811 00:59:16.804639 10259 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:59:16.804625 10268 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9509e9d198ab43748599b0b69444812f" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 39031 } }
I20260811 00:59:16.805197 10271 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9509e9d198ab43748599b0b69444812f. Latest consensus state: current_term: 3 leader_uuid: "9509e9d198ab43748599b0b69444812f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9509e9d198ab43748599b0b69444812f" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 39031 } } }
I20260811 00:59:16.805466 10271 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [sys.catalog]: This master's current role is: LEADER
I20260811 00:59:16.805915 10270 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "9509e9d198ab43748599b0b69444812f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9509e9d198ab43748599b0b69444812f" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 39031 } } }
I20260811 00:59:16.806134 10270 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f [sys.catalog]: This master's current role is: LEADER
I20260811 00:59:16.805915 10285 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:59:16.807116 10285 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:59:16.807240 10285 catalog_manager.cc:1259] Loaded cluster ID: 7a5218987da242da8ca6ae14f659992b
I20260811 00:59:16.807278 10285 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:59:16.808445 10285 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:59:16.808650 10285 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f: Loaded TSK: 0
I20260811 00:59:16.808705 10285 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 9509e9d198ab43748599b0b69444812f: Loaded TSK: 1
F20260811 00:59:16.808941 10285 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fce7007d9ad google::LogMessage::Fail() at ??:0
@ 0x7fce7008088a google::LogMessage::SendToLog() at ??:0
@ 0x7fce7007d4de google::LogMessage::Flush() at ??:0
@ 0x7fce7007ea19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fce727ea104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fce727e7d41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7fce77fd71cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7fce77fd748e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7fce77fd7594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7fce77f9dc48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7fce77fa7ad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fce71f4b0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fce71f40954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fce72da46db start_thread at ??:0
@ 0x7fce6eb7b61f clone at ??:0
W20260811 00:59:16.920523 10263 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:59:16.920924 10263 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:59:16.920976 10263 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:59:16.923115 10263 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:59:16.923200 10263 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:59:16.923238 10263 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.1
I20260811 00:59:16.925144 10263 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:46229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.1:41193
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.70.1
--webserver_port=42501
--tserver_master_addrs=127.15.70.62:39031
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10263
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.1
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:59:16.925483 10263 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:59:16.925822 10263 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:59:16.932958 10328 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:16.932979 10322 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:16.932958 10324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:16.933560 10263 server_base.cc:1034] running on GCE node
I20260811 00:59:16.933817 10263 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:59:16.934113 10263 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:59:16.935307 10263 hybrid_clock.cc:648] HybridClock initialized: now 1786409956935289 us; error 37 us; skew 500 ppm
Aug 11 00:59:16 dist-test-slave-h3ft krb5kdc[8530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409956, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:59:16.938787 10263 init.cc:377] Logged in from keytab as kudu/127.15.70.1@KRBTEST.COM (short username kudu)
I20260811 00:59:16.939575 10263 webserver.cc:460] Webserver started at http://127.15.70.1:42501/ using document root <none> and password file <none>
I20260811 00:59:16.939872 10263 fs_manager.cc:359] Metadata directory not provided
I20260811 00:59:16.939957 10263 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:59:16.941787 10263 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 00:59:16.942770 10344 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:16.943038 10263 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 00:59:16.943166 10263 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/wal
uuid: "47d4770dac934e05955dc1b823da0885"
format_stamp: "Formatted at 2026-08-11 00:58:34 on dist-test-slave-h3ft"
server_key: "e6834b4f76604ce4444eca51a55ff822"
server_key_iv: "8cf7919b5a0cc0580ce4eea79aecdf6c"
server_key_version: "encryptionkey@0"
I20260811 00:59:16.943648 10263 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:59:16.962437 10263 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:59:16.965746 10263 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:59:16.965971 10263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:59:16.966337 10263 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:59:16.967101 10357 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 00:59:16.968961 10263 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 00:59:16.969043 10263 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 00:59:16.969090 10263 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 00:59:16.970211 10263 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 00:59:16.970263 10263 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 00:59:16.970369 10357 tablet_bootstrap.cc:492] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885: Bootstrap starting.
I20260811 00:59:16.980228 10263 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.1:41193
I20260811 00:59:16.980477 10516 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.1:41193 every 8 connection(s)
I20260811 00:59:16.980893 10263 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
I20260811 00:59:16.984191 10357 log.cc:824] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885: Log is configured to *not* fsync() on all Append() calls
I20260811 00:59:16.986811 10357 tablet_bootstrap.cc:492] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 00:59:16.987236 10357 tablet_bootstrap.cc:492] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885: Bootstrap complete.
I20260811 00:59:16.988322 10357 ts_tablet_manager.cc:1397] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.016s
I20260811 00:59:16.989549 10357 raft_consensus.cc:348] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b22dd4d3a91a4d9a94637ac6c5ca5a18" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34019 } } peers { permanent_uuid: "57adc460061b47c8802f20d2e535033a" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46601 } } peers { permanent_uuid: "47d4770dac934e05955dc1b823da0885" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 41193 } }
I20260811 00:59:16.989858 10357 raft_consensus.cc:729] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47d4770dac934e05955dc1b823da0885, State: Initialized, Role: FOLLOWER
I20260811 00:59:16.990090 10357 consensus_queue.cc:260] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b22dd4d3a91a4d9a94637ac6c5ca5a18" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34019 } } peers { permanent_uuid: "57adc460061b47c8802f20d2e535033a" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46601 } } peers { permanent_uuid: "47d4770dac934e05955dc1b823da0885" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 41193 } }
I20260811 00:59:16.990528 10357 ts_tablet_manager.cc:1428] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260811 00:59:16.991132 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 10263
I20260811 00:59:16.991457 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.2:46601
--local_ip_for_outbound_sockets=127.15.70.2
--tserver_master_addrs=127.15.70.62:39031
--webserver_port=33831
--webserver_interface=127.15.70.2
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:46229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:59:17.098670 10521 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:59:16.981924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.1:48345)
0811 00:59:16.982234 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:16.982298 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:16.983357 (+ 1059us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:17.098357 (+115000us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":126,"threads_started":1}
W20260811 00:59:17.099151 10519 heartbeater.cc:644] Failed to heartbeat to 127.15.70.62:39031 (0 consecutive failures): Network error: Failed to ping master at 127.15.70.62:39031: Client connection negotiation failed: client connection to 127.15.70.62:39031: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 00:59:17.099675 10521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:17.099508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.1:45563)
0811 00:59:17.099580 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:17.099642 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 00:59:17.100167 10521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:17.100051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.1:54505)
0811 00:59:17.100106 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:17.100140 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 00:59:17.100334 10519 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 00:59:17.100764 10525 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:59:17.100997 10525 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:59:17.101028 10525 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:59:17.102481 10525 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:59:17.102531 10525 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:59:17.102566 10525 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.2
I20260811 00:59:17.104444 10525 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:46229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.2:46601
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.70.2
--webserver_port=33831
--tserver_master_addrs=127.15.70.62:39031
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10525
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.2
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:59:17.104786 10525 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:59:17.105111 10525 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:59:17.111577 10535 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:17.111606 10525 server_base.cc:1034] running on GCE node
W20260811 00:59:17.111629 10534 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:17.111624 10537 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:17.112187 10525 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:59:17.112497 10525 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:59:17.113708 10525 hybrid_clock.cc:648] HybridClock initialized: now 1786409957113693 us; error 34 us; skew 500 ppm
Aug 11 00:59:17 dist-test-slave-h3ft krb5kdc[8530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409957, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:59:17.117269 10525 init.cc:377] Logged in from keytab as kudu/127.15.70.2@KRBTEST.COM (short username kudu)
I20260811 00:59:17.117874 10525 webserver.cc:460] Webserver started at http://127.15.70.2:33831/ using document root <none> and password file <none>
I20260811 00:59:17.118213 10525 fs_manager.cc:359] Metadata directory not provided
I20260811 00:59:17.118301 10525 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:59:17.120157 10525 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:59:17.121031 10546 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:17.121318 10525 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:59:17.121455 10525 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/wal
uuid: "57adc460061b47c8802f20d2e535033a"
format_stamp: "Formatted at 2026-08-11 00:58:35 on dist-test-slave-h3ft"
server_key: "a59ef882d87d6c4675657d577785e4fc"
server_key_iv: "f4fdcc9623c70d5e6efb1f1e88e8090c"
server_key_version: "encryptionkey@0"
I20260811 00:59:17.121889 10525 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:59:17.146538 10525 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:59:17.149900 10525 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:59:17.150202 10525 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:59:17.150506 10525 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:59:17.150955 10525 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:59:17.151055 10525 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:17.151131 10525 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:59:17.151160 10525 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:17.159705 10525 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.2:46601
I20260811 00:59:17.159823 10711 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.2:46601 every 8 connection(s)
I20260811 00:59:17.160313 10525 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
I20260811 00:59:17.161737 10716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:17.161257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.2:34883)
0811 00:59:17.161474 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:17.161561 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":101,"threads_started":1}
W20260811 00:59:17.162298 10714 heartbeater.cc:644] Failed to heartbeat to 127.15.70.62:39031 (0 consecutive failures): Network error: Failed to ping master at 127.15.70.62:39031: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
I20260811 00:59:17.162670 10716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:17.162544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.2:48145)
0811 00:59:17.162591 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:17.162638 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 00:59:17.163091 10716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:17.162974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.2:59965)
0811 00:59:17.163033 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:17.163064 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 00:59:17.163095 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 10525
W20260811 00:59:17.163292 10714 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 00:59:17.163465 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.3:34019
--local_ip_for_outbound_sockets=127.15.70.3
--tserver_master_addrs=127.15.70.62:39031
--webserver_port=41469
--webserver_interface=127.15.70.3
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:46229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:59:17.262707 10717 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:59:17.262984 10717 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:59:17.263036 10717 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:59:17.264376 10717 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:59:17.264434 10717 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:59:17.264465 10717 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.3
I20260811 00:59:17.266086 10717 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:46229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.3:34019
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.70.3
--webserver_port=41469
--tserver_master_addrs=127.15.70.62:39031
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10717
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.3
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:59:17.266381 10717 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:59:17.266680 10717 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:59:17.273291 10726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:17.273269 10728 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:17.273650 10717 server_base.cc:1034] running on GCE node
W20260811 00:59:17.273278 10725 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:17.273985 10717 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:59:17.274375 10717 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:59:17.275568 10717 hybrid_clock.cc:648] HybridClock initialized: now 1786409957275548 us; error 45 us; skew 500 ppm
Aug 11 00:59:17 dist-test-slave-h3ft krb5kdc[8530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409957, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:59:17.278842 10717 init.cc:377] Logged in from keytab as kudu/127.15.70.3@KRBTEST.COM (short username kudu)
I20260811 00:59:17.279420 10717 webserver.cc:460] Webserver started at http://127.15.70.3:41469/ using document root <none> and password file <none>
I20260811 00:59:17.279736 10717 fs_manager.cc:359] Metadata directory not provided
I20260811 00:59:17.279788 10717 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:59:17.281404 10717 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 00:59:17.282246 10739 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:17.282507 10717 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 00:59:17.282611 10717 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/wal
uuid: "b22dd4d3a91a4d9a94637ac6c5ca5a18"
format_stamp: "Formatted at 2026-08-11 00:58:35 on dist-test-slave-h3ft"
server_key: "a1fae95a444fad638ab36e48a47871f4"
server_key_iv: "9d9407e7f4b55815538d9b3db4cfe3c9"
server_key_version: "encryptionkey@0"
I20260811 00:59:17.283118 10717 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:59:17.291910 10717 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:59:17.294353 10717 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:59:17.294549 10717 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:59:17.294844 10717 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:59:17.295290 10717 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:59:17.295349 10717 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:17.295403 10717 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:59:17.295441 10717 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:17.302914 10717 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.3:34019
I20260811 00:59:17.302973 10917 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.3:34019 every 8 connection(s)
I20260811 00:59:17.303459 10717 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
I20260811 00:59:17.304896 10921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:17.304416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.3:50397)
0811 00:59:17.304621 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:17.304715 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":91,"threads_started":1}
W20260811 00:59:17.305394 10919 heartbeater.cc:644] Failed to heartbeat to 127.15.70.62:39031 (0 consecutive failures): Network error: Failed to ping master at 127.15.70.62:39031: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
I20260811 00:59:17.305727 10921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:17.305614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.3:59271)
0811 00:59:17.305668 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:17.305696 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 00:59:17.306020 10921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:17.305923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.3:35585)
0811 00:59:17.305974 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:17.305998 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 00:59:17.306138 10919 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 00:59:17.311647 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 10717
I20260811 00:59:18.101186 10924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:18.100840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.1:53783)
0811 00:59:18.101028 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:18.101077 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":126,"threads_started":1}
I20260811 00:59:18.164275 10928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:18.163860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.2:55943)
0811 00:59:18.164126 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:18.164199 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":170,"threads_started":1}
I20260811 00:59:18.307152 10929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:18.306590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.3:57997)
0811 00:59:18.306827 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:18.306901 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":98,"threads_started":1}
I20260811 00:59:18.510432 10931 raft_consensus.cc:482] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:59:18.510656 10931 raft_consensus.cc:504] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b22dd4d3a91a4d9a94637ac6c5ca5a18" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34019 } } peers { permanent_uuid: "57adc460061b47c8802f20d2e535033a" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46601 } } peers { permanent_uuid: "47d4770dac934e05955dc1b823da0885" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 41193 } }
I20260811 00:59:18.511129 10931 leader_election.cc:288] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b22dd4d3a91a4d9a94637ac6c5ca5a18 (127.15.70.3:34019), 57adc460061b47c8802f20d2e535033a (127.15.70.2:46601)
Aug 11 00:59:18 dist-test-slave-h3ft krb5kdc[8530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409956, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for kudu/127.15.70.2@KRBTEST.COM
Aug 11 00:59:18 dist-test-slave-h3ft krb5kdc[8530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409956, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for kudu/127.15.70.3@KRBTEST.COM
I20260811 00:59:18.524497 10936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:18.511633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:45191 (local address 127.15.70.2:46601)
0811 00:59:18.511954 (+ 321us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:18.511967 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:18.512008 (+ 41us) server_negotiation.cc:407] Connection header received
0811 00:59:18.512507 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:18.512509 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:18.512556 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:18.512710 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:18.513790 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:18.514891 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:18.516251 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:18.516680 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:18.516778 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:18.519687 (+ 2909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:18.519693 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:18.519693 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:59:18.519708 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:18.522337 (+ 2629us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:18.522992 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:18.522996 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:18.522997 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:18.523155 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:18.523437 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:18.523438 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:18.523438 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:18.523760 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:18.523872 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:18.524172 (+ 300us) server_negotiation.cc:299] Negotiation successful
0811 00:59:18.524338 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274,"thread_start_us":90,"threads_started":1}
I20260811 00:59:18.524477 10933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:18.511446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.2:46601 (local address 127.15.70.1:45191)
0811 00:59:18.511719 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:18.511734 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:18.511818 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:18.512893 (+ 1075us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:18.512896 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:18.513380 (+ 484us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:59:18.513602 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:18.513610 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:18.515064 (+ 1454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:18.515067 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:18.516117 (+ 1050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:18.516121 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:18.516791 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:18.516792 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:18.516927 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:18.517609 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:59:18.517620 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:59:18.519475 (+ 1855us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:59:18.522508 (+ 3033us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:59:18.522510 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:59:18.522510 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:59:18.522887 (+ 377us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:59:18.523238 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:59:18.523239 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:59:18.523240 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:59:18.523359 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:59:18.523845 (+ 486us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:59:18.523853 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:59:18.523990 (+ 137us) client_negotiation.cc:769] Sending connection context
0811 00:59:18.524112 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 00:59:18.524373 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"mutex_wait_us":117,"thread_start_us":145,"threads_started":1}
I20260811 00:59:18.524672 10937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:18.511631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:42443 (local address 127.15.70.3:34019)
0811 00:59:18.511894 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:18.511911 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:18.511965 (+ 54us) server_negotiation.cc:407] Connection header received
0811 00:59:18.512571 (+ 606us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:18.512574 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:18.512637 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:18.512867 (+ 230us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:18.513797 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:18.514978 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:18.516259 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:18.516753 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:18.516889 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:18.520017 (+ 3128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:18.520022 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:18.520022 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:59:18.520082 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:18.522336 (+ 2254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:18.523075 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:18.523080 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:18.523080 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:18.523240 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:18.523493 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:18.523494 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:18.523494 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:18.523857 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:18.523959 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:18.524256 (+ 297us) server_negotiation.cc:299] Negotiation successful
0811 00:59:18.524499 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":214,"thread_start_us":101,"threads_started":1}
I20260811 00:59:18.525252 10924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:18.511446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:34019 (local address 127.15.70.1:42443)
0811 00:59:18.511610 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:18.511628 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:18.511802 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:18.512866 (+ 1064us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:18.512875 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:18.513369 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:59:18.513601 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:18.513607 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:18.515155 (+ 1548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:18.515157 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:18.516118 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:18.516122 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:18.516860 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:18.516861 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:18.516928 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:18.517669 (+ 741us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:59:18.517674 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:59:18.519875 (+ 2201us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:59:18.522457 (+ 2582us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:59:18.522467 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:59:18.522470 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:59:18.522890 (+ 420us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:59:18.523334 (+ 444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:59:18.523335 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:59:18.523336 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:59:18.523413 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:59:18.523947 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:59:18.523949 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:59:18.524015 (+ 66us) client_negotiation.cc:769] Sending connection context
0811 00:59:18.524140 (+ 125us) client_negotiation.cc:240] Negotiation successful
0811 00:59:18.525122 (+ 982us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"mutex_wait_us":832}
W20260811 00:59:18.525573 10348 leader_election.cc:341] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 57adc460061b47c8802f20d2e535033a (127.15.70.2:46601): Not found: Tablet not found: b6632ea34cae4742a0c59f52ae39f65e
W20260811 00:59:18.526834 10352 leader_election.cc:341] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b22dd4d3a91a4d9a94637ac6c5ca5a18 (127.15.70.3:34019): Not found: Tablet not found: b6632ea34cae4742a0c59f52ae39f65e
I20260811 00:59:18.526896 10352 leader_election.cc:302] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47d4770dac934e05955dc1b823da0885; no voters: 57adc460061b47c8802f20d2e535033a, b22dd4d3a91a4d9a94637ac6c5ca5a18
I20260811 00:59:18.527050 10931 raft_consensus.cc:2726] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 00:59:19.102255 10940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:19.101917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.1:38737)
0811 00:59:19.102126 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:19.102182 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":105,"threads_started":1}
I20260811 00:59:19.165096 10941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:19.164794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.2:56953)
0811 00:59:19.164996 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:19.165034 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":97,"threads_started":1}
I20260811 00:59:19.308068 10942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:19.307786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.3:44707)
0811 00:59:19.307956 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:19.308005 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":88,"threads_started":1}
I20260811 00:59:20.103459 10943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:20.103107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.1:46255)
0811 00:59:20.103294 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:20.103366 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":91,"threads_started":1}
I20260811 00:59:20.166031 10944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:20.165686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.2:33021)
0811 00:59:20.165898 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:20.165964 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":92,"threads_started":1}
I20260811 00:59:20.206518 10948 raft_consensus.cc:482] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:59:20.206710 10948 raft_consensus.cc:504] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b22dd4d3a91a4d9a94637ac6c5ca5a18" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34019 } } peers { permanent_uuid: "57adc460061b47c8802f20d2e535033a" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46601 } } peers { permanent_uuid: "47d4770dac934e05955dc1b823da0885" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 41193 } }
I20260811 00:59:20.206961 10948 leader_election.cc:288] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b22dd4d3a91a4d9a94637ac6c5ca5a18 (127.15.70.3:34019), 57adc460061b47c8802f20d2e535033a (127.15.70.2:46601)
W20260811 00:59:20.207490 10348 leader_election.cc:341] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 57adc460061b47c8802f20d2e535033a (127.15.70.2:46601): Not found: Tablet not found: b6632ea34cae4742a0c59f52ae39f65e
W20260811 00:59:20.207613 10352 leader_election.cc:341] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b22dd4d3a91a4d9a94637ac6c5ca5a18 (127.15.70.3:34019): Not found: Tablet not found: b6632ea34cae4742a0c59f52ae39f65e
I20260811 00:59:20.207654 10348 leader_election.cc:302] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47d4770dac934e05955dc1b823da0885; no voters: 57adc460061b47c8802f20d2e535033a, b22dd4d3a91a4d9a94637ac6c5ca5a18
I20260811 00:59:20.207769 10948 raft_consensus.cc:2726] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 00:59:20.309041 10949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:20.308680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.3:33043)
0811 00:59:20.308901 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:20.308968 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":116,"threads_started":1}
I20260811 00:59:21.104628 10951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:21.104291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.1:57201)
0811 00:59:21.104503 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:21.104556 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":92,"threads_started":1}
I20260811 00:59:21.167042 10952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:21.166690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.2:57493)
0811 00:59:21.166893 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:21.166941 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":112,"threads_started":1}
I20260811 00:59:21.309945 10954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:21.309635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.3:60541)
0811 00:59:21.309808 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:21.309862 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":90,"threads_started":1}
I20260811 00:59:21.984915 10956 raft_consensus.cc:482] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:59:21.985039 10956 raft_consensus.cc:504] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b22dd4d3a91a4d9a94637ac6c5ca5a18" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34019 } } peers { permanent_uuid: "57adc460061b47c8802f20d2e535033a" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46601 } } peers { permanent_uuid: "47d4770dac934e05955dc1b823da0885" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 41193 } }
I20260811 00:59:21.985302 10956 leader_election.cc:288] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b22dd4d3a91a4d9a94637ac6c5ca5a18 (127.15.70.3:34019), 57adc460061b47c8802f20d2e535033a (127.15.70.2:46601)
W20260811 00:59:21.985819 10352 leader_election.cc:341] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b22dd4d3a91a4d9a94637ac6c5ca5a18 (127.15.70.3:34019): Not found: Tablet not found: b6632ea34cae4742a0c59f52ae39f65e
W20260811 00:59:21.985914 10348 leader_election.cc:341] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 57adc460061b47c8802f20d2e535033a (127.15.70.2:46601): Not found: Tablet not found: b6632ea34cae4742a0c59f52ae39f65e
I20260811 00:59:21.986002 10348 leader_election.cc:302] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47d4770dac934e05955dc1b823da0885; no voters: 57adc460061b47c8802f20d2e535033a, b22dd4d3a91a4d9a94637ac6c5ca5a18
I20260811 00:59:21.986135 10956 raft_consensus.cc:2726] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 00:59:22.105834 10957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:22.105476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.1:51081)
0811 00:59:22.105703 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:22.105760 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":110,"threads_started":1}
I20260811 00:59:22.167888 10960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:22.167606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.2:41415)
0811 00:59:22.167774 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:22.167822 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":85,"threads_started":1}
I20260811 00:59:22.310833 10961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:22.310568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.3:35031)
0811 00:59:22.310721 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:22.310771 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":87,"threads_started":1}
I20260811 00:59:23.106851 10962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:23.106482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.1:43397)
0811 00:59:23.106701 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:23.106776 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":104,"threads_started":1}
I20260811 00:59:23.168869 10964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:23.168515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.2:54371)
0811 00:59:23.168714 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:23.168783 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":88,"threads_started":1}
I20260811 00:59:23.311707 10965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:23.311379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.3:47707)
0811 00:59:23.311565 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:23.311632 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":83,"threads_started":1}
I20260811 00:59:23.528792 10968 raft_consensus.cc:482] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:59:23.528920 10968 raft_consensus.cc:504] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b22dd4d3a91a4d9a94637ac6c5ca5a18" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34019 } } peers { permanent_uuid: "57adc460061b47c8802f20d2e535033a" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46601 } } peers { permanent_uuid: "47d4770dac934e05955dc1b823da0885" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 41193 } }
I20260811 00:59:23.529121 10968 leader_election.cc:288] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b22dd4d3a91a4d9a94637ac6c5ca5a18 (127.15.70.3:34019), 57adc460061b47c8802f20d2e535033a (127.15.70.2:46601)
W20260811 00:59:23.529618 10348 leader_election.cc:341] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 57adc460061b47c8802f20d2e535033a (127.15.70.2:46601): Not found: Tablet not found: b6632ea34cae4742a0c59f52ae39f65e
W20260811 00:59:23.529757 10352 leader_election.cc:341] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b22dd4d3a91a4d9a94637ac6c5ca5a18 (127.15.70.3:34019): Not found: Tablet not found: b6632ea34cae4742a0c59f52ae39f65e
I20260811 00:59:23.529794 10348 leader_election.cc:302] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47d4770dac934e05955dc1b823da0885; no voters: 57adc460061b47c8802f20d2e535033a, b22dd4d3a91a4d9a94637ac6c5ca5a18
I20260811 00:59:23.529888 10968 raft_consensus.cc:2726] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 00:59:24.108103 10969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:24.107675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.1:34891)
0811 00:59:24.107940 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:24.108019 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":128,"threads_started":1}
I20260811 00:59:24.170032 10970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:24.169662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.2:37117)
0811 00:59:24.169900 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:24.169966 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":103,"threads_started":1}
I20260811 00:59:24.312858 10971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:24.312347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.3:56599)
0811 00:59:24.312711 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:24.312789 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":152,"threads_started":1}
I20260811 00:59:25.109201 10972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:25.108842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.1:41417)
0811 00:59:25.109075 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:25.109126 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":144,"threads_started":1}
I20260811 00:59:25.171092 10973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:25.170776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.2:57517)
0811 00:59:25.170938 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:25.170979 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":96,"threads_started":1}
I20260811 00:59:25.314106 10974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:25.313746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.3:38243)
0811 00:59:25.313975 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:25.314040 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":127,"threads_started":1}
I20260811 00:59:26.110350 10975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:26.110003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.1:44719)
0811 00:59:26.110203 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:26.110275 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":93,"threads_started":1}
I20260811 00:59:26.171963 10977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:26.171624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.2:36219)
0811 00:59:26.171837 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:26.171906 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":89,"threads_started":1}
I20260811 00:59:26.315317 10980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:26.314855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.3:52509)
0811 00:59:26.315191 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:26.315260 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":222,"threads_started":1}
I20260811 00:59:27.111680 10982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:27.111338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.1:35571)
0811 00:59:27.111542 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:27.111614 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":95,"threads_started":1}
I20260811 00:59:27.172994 10983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:27.172648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.2:43809)
0811 00:59:27.172851 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:27.172915 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":107,"threads_started":1}
I20260811 00:59:27.316358 10984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:27.315990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.3:40635)
0811 00:59:27.316202 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:27.316278 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":87,"threads_started":1}
I20260811 00:59:28.112713 10985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:28.112343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.1:35853)
0811 00:59:28.112561 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:28.112650 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":105,"threads_started":1}
I20260811 00:59:28.174166 10986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:28.173800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.2:34703)
0811 00:59:28.174010 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:28.174088 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":83,"threads_started":1}
I20260811 00:59:28.317351 10987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:28.317028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.3:36435)
0811 00:59:28.317224 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:28.317283 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":104,"threads_started":1}
I20260811 00:59:29.113829 10988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:29.113350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.1:56353)
0811 00:59:29.113705 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:29.113753 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":223,"threads_started":1}
I20260811 00:59:29.175331 10989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:29.174885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.2:45345)
0811 00:59:29.175184 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:29.175253 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":181,"threads_started":1}
I20260811 00:59:29.318387 10990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:29.318028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.3:50273)
0811 00:59:29.318249 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:29.318323 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":112,"threads_started":1}
I20260811 00:59:29.631572 10991 raft_consensus.cc:482] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:59:29.631716 10991 raft_consensus.cc:504] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b22dd4d3a91a4d9a94637ac6c5ca5a18" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 34019 } } peers { permanent_uuid: "57adc460061b47c8802f20d2e535033a" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 46601 } } peers { permanent_uuid: "47d4770dac934e05955dc1b823da0885" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 41193 } }
I20260811 00:59:29.631984 10991 leader_election.cc:288] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b22dd4d3a91a4d9a94637ac6c5ca5a18 (127.15.70.3:34019), 57adc460061b47c8802f20d2e535033a (127.15.70.2:46601)
W20260811 00:59:29.632596 10352 leader_election.cc:341] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b22dd4d3a91a4d9a94637ac6c5ca5a18 (127.15.70.3:34019): Not found: Tablet not found: b6632ea34cae4742a0c59f52ae39f65e
W20260811 00:59:29.632746 10348 leader_election.cc:341] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 57adc460061b47c8802f20d2e535033a (127.15.70.2:46601): Not found: Tablet not found: b6632ea34cae4742a0c59f52ae39f65e
I20260811 00:59:29.632815 10348 leader_election.cc:302] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47d4770dac934e05955dc1b823da0885; no voters: 57adc460061b47c8802f20d2e535033a, b22dd4d3a91a4d9a94637ac6c5ca5a18
I20260811 00:59:29.632927 10991 raft_consensus.cc:2726] T b6632ea34cae4742a0c59f52ae39f65e P 47d4770dac934e05955dc1b823da0885 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 00:59:30.115149 10993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:30.114618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.1:60427)
0811 00:59:30.114825 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:30.114958 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":96,"threads_started":1}
I20260811 00:59:30.176349 10996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:30.175963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.2:46669)
0811 00:59:30.176214 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:30.176285 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":117,"threads_started":1}
I20260811 00:59:30.319638 10998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:30.319256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.3:45095)
0811 00:59:30.319515 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:30.319563 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":145,"threads_started":1}
I20260811 00:59:31.116246 10999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:31.115903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.1:48323)
0811 00:59:31.116134 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:31.116184 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":133,"threads_started":1}
I20260811 00:59:31.177451 11000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:31.177092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.2:49503)
0811 00:59:31.177319 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:31.177389 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":117,"threads_started":1}
I20260811 00:59:31.320519 11001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:31.320182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.3:51201)
0811 00:59:31.320408 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:31.320460 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":130,"threads_started":1}
I20260811 00:59:32.117431 11002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:32.117020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.1:44907)
0811 00:59:32.117232 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:32.117313 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":73,"threads_started":1}
I20260811 00:59:32.178529 11003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:32.178201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.2:49803)
0811 00:59:32.178413 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:32.178468 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":120,"threads_started":1}
I20260811 00:59:32.321756 11004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:32.321338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:39031 (local address 127.15.70.3:40155)
0811 00:59:32.321601 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:32.321677 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.62:39031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":128,"threads_started":1}
I20260811 00:59:32.321907 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 10263
I20260811 00:59:32.339716 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 10525
I20260811 00:59:32.351630 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 10717
2026-08-11T00:59:32Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59388 ms)
[----------] 30 tests from SecurityITest (267752 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:59:32 dist-test-slave-h3ft krb5kdc[11008](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:59:32 dist-test-slave-h3ft krb5kdc[11008](info): set up 2 sockets
Aug 11 00:59:32 dist-test-slave-h3ft krb5kdc[11008](info): commencing operation
krb5kdc: starting...
W20260811 00:59:33.742465 15640 mini_kdc.cc:121] Time spent starting KDC: real 1.361s user 0.000s sys 0.010s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Aug 11 00:59:33 dist-test-slave-h3ft krb5kdc[11008](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409973, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:59:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:59:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.70.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
I20260811 00:59:33.895536 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:32797
--webserver_interface=127.15.70.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:37551
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:32797
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:59:33.994865 11031 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:59:33.995239 11031 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:59:33.995268 11031 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:59:33.996558 11031 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:59:33.996606 11031 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:59:33.996621 11031 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:59:33.996634 11031 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:59:33.996687 11031 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:59:33.998492 11031 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:37551
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:32797
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:32797
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11031
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:59:33.998805 11031 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:59:33.999127 11031 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:59:34.004827 11045 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:34.004979 11042 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:34.004823 11041 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:34.005334 11031 server_base.cc:1034] running on GCE node
I20260811 00:59:34.005637 11031 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:59:34.005944 11031 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:59:34.007077 11031 hybrid_clock.cc:648] HybridClock initialized: now 1786409974007042 us; error 58 us; skew 500 ppm
Aug 11 00:59:34 dist-test-slave-h3ft krb5kdc[11008](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409974, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:59:34.010186 11031 init.cc:377] Logged in from keytab as kudu/127.15.70.62@KRBTEST.COM (short username kudu)
I20260811 00:59:34.010772 11031 webserver.cc:460] Webserver started at http://127.15.70.62:42635/ using document root <none> and password file <none>
I20260811 00:59:34.011132 11031 fs_manager.cc:359] Metadata directory not provided
I20260811 00:59:34.011209 11031 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:59:34.011389 11031 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:59:34.012722 11031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "118dd958422e410db3e52226f95e4558"
format_stamp: "Formatted at 2026-08-11 00:59:34 on dist-test-slave-h3ft"
server_key: "db3d540690621609392db3f150f511e8"
server_key_iv: "5734fc4cb9fd236c846114e83709120f"
server_key_version: "encryptionkey@0"
I20260811 00:59:34.013145 11031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "118dd958422e410db3e52226f95e4558"
format_stamp: "Formatted at 2026-08-11 00:59:34 on dist-test-slave-h3ft"
server_key: "db3d540690621609392db3f150f511e8"
server_key_iv: "5734fc4cb9fd236c846114e83709120f"
server_key_version: "encryptionkey@0"
I20260811 00:59:34.014657 11031 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 00:59:34.015616 11054 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:34.015800 11031 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 00:59:34.015924 11031 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "118dd958422e410db3e52226f95e4558"
format_stamp: "Formatted at 2026-08-11 00:59:34 on dist-test-slave-h3ft"
server_key: "db3d540690621609392db3f150f511e8"
server_key_iv: "5734fc4cb9fd236c846114e83709120f"
server_key_version: "encryptionkey@0"
I20260811 00:59:34.016014 11031 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:59:34.034642 11031 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:59:34.037385 11031 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:59:34.037582 11031 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:59:34.042868 11031 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:32797
I20260811 00:59:34.042902 11128 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:32797 every 8 connection(s)
I20260811 00:59:34.043419 11031 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:59:34.044555 11129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:59:34.047555 11129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 118dd958422e410db3e52226f95e4558: Bootstrap starting.
I20260811 00:59:34.048368 11129 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 118dd958422e410db3e52226f95e4558: Neither blocks nor log segments found. Creating new log.
I20260811 00:59:34.048753 11129 log.cc:824] T 00000000000000000000000000000000 P 118dd958422e410db3e52226f95e4558: Log is configured to *not* fsync() on all Append() calls
I20260811 00:59:34.049711 11129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 118dd958422e410db3e52226f95e4558: No bootstrap required, opened a new log
I20260811 00:59:34.051739 11129 raft_consensus.cc:348] T 00000000000000000000000000000000 P 118dd958422e410db3e52226f95e4558 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118dd958422e410db3e52226f95e4558" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 32797 } }
I20260811 00:59:34.051919 11129 raft_consensus.cc:374] T 00000000000000000000000000000000 P 118dd958422e410db3e52226f95e4558 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:59:34.051945 11129 raft_consensus.cc:729] T 00000000000000000000000000000000 P 118dd958422e410db3e52226f95e4558 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 118dd958422e410db3e52226f95e4558, State: Initialized, Role: FOLLOWER
I20260811 00:59:34.052155 11129 consensus_queue.cc:260] T 00000000000000000000000000000000 P 118dd958422e410db3e52226f95e4558 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118dd958422e410db3e52226f95e4558" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 32797 } }
I20260811 00:59:34.052233 11129 raft_consensus.cc:388] T 00000000000000000000000000000000 P 118dd958422e410db3e52226f95e4558 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:59:34.052258 11129 raft_consensus.cc:482] T 00000000000000000000000000000000 P 118dd958422e410db3e52226f95e4558 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:59:34.052292 11129 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 118dd958422e410db3e52226f95e4558 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:59:34.053068 11129 raft_consensus.cc:504] T 00000000000000000000000000000000 P 118dd958422e410db3e52226f95e4558 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118dd958422e410db3e52226f95e4558" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 32797 } }
I20260811 00:59:34.053177 11129 leader_election.cc:302] T 00000000000000000000000000000000 P 118dd958422e410db3e52226f95e4558 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 118dd958422e410db3e52226f95e4558; no voters:
I20260811 00:59:34.053437 11129 leader_election.cc:288] T 00000000000000000000000000000000 P 118dd958422e410db3e52226f95e4558 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:59:34.053454 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 11031
I20260811 00:59:34.053586 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 00:59:34.053516 11136 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 118dd958422e410db3e52226f95e4558 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:59:34.053757 11136 raft_consensus.cc:686] T 00000000000000000000000000000000 P 118dd958422e410db3e52226f95e4558 [term 1 LEADER]: Becoming Leader. State: Replica: 118dd958422e410db3e52226f95e4558, State: Running, Role: LEADER
I20260811 00:59:34.053822 11129 sys_catalog.cc:564] T 00000000000000000000000000000000 P 118dd958422e410db3e52226f95e4558 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:59:34.053874 15640 external_mini_cluster.cc:1428] Setting key f1177e2cba483c23130799db7adf3bc2
I20260811 00:59:34.053890 11136 consensus_queue.cc:237] T 00000000000000000000000000000000 P 118dd958422e410db3e52226f95e4558 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118dd958422e410db3e52226f95e4558" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 32797 } }
I20260811 00:59:34.054356 11136 sys_catalog.cc:455] T 00000000000000000000000000000000 P 118dd958422e410db3e52226f95e4558 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 118dd958422e410db3e52226f95e4558. Latest consensus state: current_term: 1 leader_uuid: "118dd958422e410db3e52226f95e4558" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118dd958422e410db3e52226f95e4558" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 32797 } } }
I20260811 00:59:34.054448 11136 sys_catalog.cc:458] T 00000000000000000000000000000000 P 118dd958422e410db3e52226f95e4558 [sys.catalog]: This master's current role is: LEADER
I20260811 00:59:34.054555 11137 sys_catalog.cc:455] T 00000000000000000000000000000000 P 118dd958422e410db3e52226f95e4558 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "118dd958422e410db3e52226f95e4558" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118dd958422e410db3e52226f95e4558" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 32797 } } }
I20260811 00:59:34.054623 11137 sys_catalog.cc:458] T 00000000000000000000000000000000 P 118dd958422e410db3e52226f95e4558 [sys.catalog]: This master's current role is: LEADER
I20260811 00:59:34.054813 11152 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:59:34.055548 11152 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:59:34.057469 11152 catalog_manager.cc:1347] Generated new cluster ID: ed2c811d88e64b6799500152efd54d80
I20260811 00:59:34.057533 11152 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:59:34.061450 11152 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:59:34.062182 11152 catalog_manager.cc:1504] Loading token signing keys...
Aug 11 00:59:34 dist-test-slave-h3ft krb5kdc[11008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409973, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:59:34.071318 11160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:34.054986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37590 (local address 127.15.70.62:32797)
0811 00:59:34.055580 (+ 594us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:34.055593 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:34.055630 (+ 37us) server_negotiation.cc:407] Connection header received
0811 00:59:34.055784 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:34.055793 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:34.055859 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:34.057120 (+ 1261us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:34.057264 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:34.060616 (+ 3352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:34.061890 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:34.063198 (+ 1308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:34.063322 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:34.066830 (+ 3508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:34.066839 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:34.066839 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:59:34.066856 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:34.069187 (+ 2331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:34.069699 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:34.069704 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:34.069704 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:34.069848 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:34.070088 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:34.070089 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:34.070090 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:34.070466 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:34.070641 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:34.070761 (+ 120us) server_negotiation.cc:299] Negotiation successful
0811 00:59:34.070951 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":501,"thread_start_us":122,"threads_started":1}
I20260811 00:59:34.075068 11152 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 118dd958422e410db3e52226f95e4558: Generated new TSK 0
I20260811 00:59:34.075314 11152 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.70.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab.
Entry for principal kudu/127.15.70.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab.
I20260811 00:59:34.114634 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.1:0
--local_ip_for_outbound_sockets=127.15.70.1
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:32797
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:37551
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:59:34.213471 11176 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:59:34.213752 11176 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:59:34.213778 11176 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:59:34.215093 11176 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:59:34.215144 11176 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:59:34.215206 11176 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.1
I20260811 00:59:34.216858 11176 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:37551
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:32797
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11176
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.1
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:59:34.217165 11176 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:59:34.217465 11176 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:59:34.223662 11186 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:34.223652 11187 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:34.223699 11176 server_base.cc:1034] running on GCE node
W20260811 00:59:34.223652 11190 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:34.224141 11176 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:59:34.224452 11176 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:59:34.225613 11176 hybrid_clock.cc:648] HybridClock initialized: now 1786409974225587 us; error 39 us; skew 500 ppm
Aug 11 00:59:34 dist-test-slave-h3ft krb5kdc[11008](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409974, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:59:34.228848 11176 init.cc:377] Logged in from keytab as kudu/127.15.70.1@KRBTEST.COM (short username kudu)
I20260811 00:59:34.229424 11176 webserver.cc:460] Webserver started at http://127.15.70.1:43567/ using document root <none> and password file <none>
I20260811 00:59:34.229707 11176 fs_manager.cc:359] Metadata directory not provided
I20260811 00:59:34.229780 11176 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:59:34.229938 11176 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:59:34.231261 11176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-0/data/instance:
uuid: "bab30f7aa4ef4f9b8bb8f650baff0bef"
format_stamp: "Formatted at 2026-08-11 00:59:34 on dist-test-slave-h3ft"
server_key: "fdf1538b1d3e2785307fe0ead2bcddd6"
server_key_iv: "09ccbe5326f139b1e20b06c2c4edb163"
server_key_version: "encryptionkey@0"
I20260811 00:59:34.231675 11176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance:
uuid: "bab30f7aa4ef4f9b8bb8f650baff0bef"
format_stamp: "Formatted at 2026-08-11 00:59:34 on dist-test-slave-h3ft"
server_key: "fdf1538b1d3e2785307fe0ead2bcddd6"
server_key_iv: "09ccbe5326f139b1e20b06c2c4edb163"
server_key_version: "encryptionkey@0"
I20260811 00:59:34.233240 11176 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:59:34.234057 11200 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:34.234246 11176 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:59:34.234359 11176 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-0/wal
uuid: "bab30f7aa4ef4f9b8bb8f650baff0bef"
format_stamp: "Formatted at 2026-08-11 00:59:34 on dist-test-slave-h3ft"
server_key: "fdf1538b1d3e2785307fe0ead2bcddd6"
server_key_iv: "09ccbe5326f139b1e20b06c2c4edb163"
server_key_version: "encryptionkey@0"
I20260811 00:59:34.234437 11176 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:59:34.251529 11176 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:59:34.254336 11176 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:59:34.254545 11176 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:59:34.254930 11176 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:59:34.255371 11176 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:59:34.255430 11176 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:34.255478 11176 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:59:34.255509 11176 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:34.262979 11176 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.1:40339
I20260811 00:59:34.263065 11388 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.1:40339 every 8 connection(s)
I20260811 00:59:34.263473 11176 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
Aug 11 00:59:34 dist-test-slave-h3ft krb5kdc[11008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409974, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:59:34.272990 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 11176
I20260811 00:59:34.273145 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance
I20260811 00:59:34.273408 15640 external_mini_cluster.cc:1428] Setting key d7db79a137140daf1a55cac0f896f7fc
I20260811 00:59:34.274849 11160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:34.264394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:48233 (local address 127.15.70.62:32797)
0811 00:59:34.264477 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:34.264479 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:34.264741 (+ 262us) server_negotiation.cc:407] Connection header received
0811 00:59:34.265342 (+ 601us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:34.265343 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:34.265355 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:34.265417 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:34.266565 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:34.267231 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:34.268342 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:34.268624 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:34.268691 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:34.271362 (+ 2671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:34.271364 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:34.271364 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:59:34.271374 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:34.273198 (+ 1824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:34.273713 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:34.273715 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:34.273716 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:34.273786 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:34.274076 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:34.274077 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:34.274077 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:34.274222 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:34.274298 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:34.274638 (+ 340us) server_negotiation.cc:299] Negotiation successful
0811 00:59:34.274745 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 00:59:34.275146 11391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:34.264371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:32797 (local address 127.15.70.1:48233)
0811 00:59:34.264580 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:34.264633 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:34.265229 (+ 596us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:34.265490 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:34.265494 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:34.266203 (+ 709us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:59:34.266450 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:34.266455 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:34.267327 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:34.267327 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:34.268243 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:34.268246 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:34.268741 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:34.268742 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:34.268892 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:34.269515 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:59:34.269526 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:59:34.271260 (+ 1734us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:59:34.273289 (+ 2029us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:59:34.273296 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:59:34.273298 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:59:34.273621 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:59:34.273863 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:59:34.273864 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:59:34.273865 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:59:34.273997 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:59:34.274297 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:59:34.274308 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:59:34.274476 (+ 168us) client_negotiation.cc:769] Sending connection context
0811 00:59:34.274602 (+ 126us) client_negotiation.cc:240] Negotiation successful
0811 00:59:34.274805 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":108,"threads_started":1}
I20260811 00:59:34.275820 11389 heartbeater.cc:347] Connected to a master server at 127.15.70.62:32797
I20260811 00:59:34.275926 11389 heartbeater.cc:464] Registering TS with master...
I20260811 00:59:34.276163 11389 heartbeater.cc:511] Master 127.15.70.62:32797 requested a full tablet report, sending...
I20260811 00:59:34.276913 11076 ts_manager.cc:194] Registered new tserver with Master: bab30f7aa4ef4f9b8bb8f650baff0bef (127.15.70.1:40339)
I20260811 00:59:34.277632 11076 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.1@KRBTEST.COM'} at 127.15.70.1:48233
WARNING: no policy specified for kudu/127.15.70.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab.
Entry for principal kudu/127.15.70.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab.
I20260811 00:59:34.310988 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.2:0
--local_ip_for_outbound_sockets=127.15.70.2
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:32797
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:37551
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:59:34.406821 11397 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:59:34.407222 11397 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:59:34.407272 11397 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:59:34.408630 11397 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:59:34.408710 11397 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:59:34.408761 11397 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.2
I20260811 00:59:34.410485 11397 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:37551
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:32797
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11397
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.2
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:59:34.410815 11397 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:59:34.411165 11397 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:59:34.417415 11412 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:34.417428 11414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:34.417604 11397 server_base.cc:1034] running on GCE node
W20260811 00:59:34.417428 11420 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:34.417898 11397 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:59:34.418200 11397 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:59:34.419369 11397 hybrid_clock.cc:648] HybridClock initialized: now 1786409974419338 us; error 59 us; skew 500 ppm
Aug 11 00:59:34 dist-test-slave-h3ft krb5kdc[11008](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409974, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:59:34.422504 11397 init.cc:377] Logged in from keytab as kudu/127.15.70.2@KRBTEST.COM (short username kudu)
I20260811 00:59:34.423115 11397 webserver.cc:460] Webserver started at http://127.15.70.2:36709/ using document root <none> and password file <none>
I20260811 00:59:34.423382 11397 fs_manager.cc:359] Metadata directory not provided
I20260811 00:59:34.423432 11397 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:59:34.423626 11397 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:59:34.424909 11397 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-1/data/instance:
uuid: "3301698c773c4d0a9dbd0dc22331d1d9"
format_stamp: "Formatted at 2026-08-11 00:59:34 on dist-test-slave-h3ft"
server_key: "2f82a2f7dd1fac0af36c43531fe4ee68"
server_key_iv: "067a3872364debd51b3adf4f48421b17"
server_key_version: "encryptionkey@0"
I20260811 00:59:34.425341 11397 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance:
uuid: "3301698c773c4d0a9dbd0dc22331d1d9"
format_stamp: "Formatted at 2026-08-11 00:59:34 on dist-test-slave-h3ft"
server_key: "2f82a2f7dd1fac0af36c43531fe4ee68"
server_key_iv: "067a3872364debd51b3adf4f48421b17"
server_key_version: "encryptionkey@0"
I20260811 00:59:34.426889 11397 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260811 00:59:34.427796 11430 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:34.427990 11397 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 00:59:34.428145 11397 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-1/wal
uuid: "3301698c773c4d0a9dbd0dc22331d1d9"
format_stamp: "Formatted at 2026-08-11 00:59:34 on dist-test-slave-h3ft"
server_key: "2f82a2f7dd1fac0af36c43531fe4ee68"
server_key_iv: "067a3872364debd51b3adf4f48421b17"
server_key_version: "encryptionkey@0"
I20260811 00:59:34.428231 11397 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:59:34.450094 11397 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:59:34.453114 11397 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:59:34.453372 11397 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:59:34.453692 11397 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:59:34.454082 11397 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:59:34.454140 11397 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:34.454205 11397 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:59:34.454265 11397 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:34.461472 11397 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.2:45587
I20260811 00:59:34.461560 11609 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.2:45587 every 8 connection(s)
I20260811 00:59:34.461961 11397 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
I20260811 00:59:34.469319 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 11397
I20260811 00:59:34.469475 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance
Aug 11 00:59:34 dist-test-slave-h3ft krb5kdc[11008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409974, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:59:34.469733 15640 external_mini_cluster.cc:1428] Setting key 05a888ddf7358620d946697935cec442
I20260811 00:59:34.473841 11160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:34.462933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:48311 (local address 127.15.70.62:32797)
0811 00:59:34.463027 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:34.463029 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:34.463304 (+ 275us) server_negotiation.cc:407] Connection header received
0811 00:59:34.463948 (+ 644us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:34.463950 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:34.463967 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:34.464027 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:34.465213 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:34.465800 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:34.466927 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:34.467196 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:34.467275 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:34.470321 (+ 3046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:34.470323 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:34.470323 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:59:34.470332 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:34.471987 (+ 1655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:34.472565 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:34.472565 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:34.472566 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:34.472635 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:34.472966 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:34.472967 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:34.472967 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:34.473088 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:34.473164 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:34.473585 (+ 421us) server_negotiation.cc:299] Negotiation successful
0811 00:59:34.473697 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 00:59:34.473927 11613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:34.462894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:32797 (local address 127.15.70.2:48311)
0811 00:59:34.463149 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:34.463193 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:34.463818 (+ 625us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:34.464140 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:34.464144 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:34.464832 (+ 688us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:59:34.465090 (+ 258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:34.465095 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:34.465926 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:34.465927 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:34.466819 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:34.466821 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:34.467299 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:34.467300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:34.467450 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:34.468204 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:59:34.468214 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:59:34.470215 (+ 2001us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:59:34.472089 (+ 1874us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:59:34.472100 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:59:34.472103 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:59:34.472473 (+ 370us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:59:34.472706 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:59:34.472707 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:59:34.472707 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:59:34.472900 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:59:34.473167 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:59:34.473176 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:59:34.473411 (+ 235us) client_negotiation.cc:769] Sending connection context
0811 00:59:34.473532 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 00:59:34.473692 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":157,"threads_started":1}
I20260811 00:59:34.474637 11611 heartbeater.cc:347] Connected to a master server at 127.15.70.62:32797
I20260811 00:59:34.474771 11611 heartbeater.cc:464] Registering TS with master...
I20260811 00:59:34.475047 11611 heartbeater.cc:511] Master 127.15.70.62:32797 requested a full tablet report, sending...
I20260811 00:59:34.475541 11076 ts_manager.cc:194] Registered new tserver with Master: 3301698c773c4d0a9dbd0dc22331d1d9 (127.15.70.2:45587)
I20260811 00:59:34.475987 11076 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.2@KRBTEST.COM'} at 127.15.70.2:48311
WARNING: no policy specified for kudu/127.15.70.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab.
Entry for principal kudu/127.15.70.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab.
I20260811 00:59:34.503551 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.3:0
--local_ip_for_outbound_sockets=127.15.70.3
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:32797
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:37551
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:59:34.621598 11616 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:59:34.621920 11616 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:59:34.621982 11616 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:59:34.623627 11616 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:59:34.623713 11616 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:59:34.623771 11616 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.3
I20260811 00:59:34.625633 11616 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:37551
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:32797
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11616
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.3
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:59:34.625984 11616 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:59:34.626307 11616 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:59:34.633265 11625 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:34.633291 11623 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:34.633246 11622 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:34.633631 11616 server_base.cc:1034] running on GCE node
I20260811 00:59:34.633850 11616 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:59:34.634117 11616 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:59:34.635314 11616 hybrid_clock.cc:648] HybridClock initialized: now 1786409974635285 us; error 41 us; skew 500 ppm
Aug 11 00:59:34 dist-test-slave-h3ft krb5kdc[11008](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409974, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:59:34.638698 11616 init.cc:377] Logged in from keytab as kudu/127.15.70.3@KRBTEST.COM (short username kudu)
I20260811 00:59:34.639361 11616 webserver.cc:460] Webserver started at http://127.15.70.3:33975/ using document root <none> and password file <none>
I20260811 00:59:34.639662 11616 fs_manager.cc:359] Metadata directory not provided
I20260811 00:59:34.639744 11616 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:59:34.639925 11616 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:59:34.641284 11616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-2/data/instance:
uuid: "eea48d1be6e148939d342fc0f9b3353f"
format_stamp: "Formatted at 2026-08-11 00:59:34 on dist-test-slave-h3ft"
server_key: "f6df3115fc188e6f0a5f556af96eb629"
server_key_iv: "9c79cb0884246c479d0415869599e780"
server_key_version: "encryptionkey@0"
I20260811 00:59:34.641754 11616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance:
uuid: "eea48d1be6e148939d342fc0f9b3353f"
format_stamp: "Formatted at 2026-08-11 00:59:34 on dist-test-slave-h3ft"
server_key: "f6df3115fc188e6f0a5f556af96eb629"
server_key_iv: "9c79cb0884246c479d0415869599e780"
server_key_version: "encryptionkey@0"
I20260811 00:59:34.643476 11616 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260811 00:59:34.644413 11637 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:34.644634 11616 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:59:34.644764 11616 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-2/wal
uuid: "eea48d1be6e148939d342fc0f9b3353f"
format_stamp: "Formatted at 2026-08-11 00:59:34 on dist-test-slave-h3ft"
server_key: "f6df3115fc188e6f0a5f556af96eb629"
server_key_iv: "9c79cb0884246c479d0415869599e780"
server_key_version: "encryptionkey@0"
I20260811 00:59:34.644853 11616 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:59:34.657599 11616 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:59:34.660360 11616 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:59:34.660583 11616 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:59:34.660912 11616 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:59:34.661319 11616 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:59:34.661388 11616 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:34.661438 11616 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:59:34.661504 11616 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:34.669503 11616 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.3:36561
I20260811 00:59:34.669559 11809 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.3:36561 every 8 connection(s)
I20260811 00:59:34.669996 11616 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
I20260811 00:59:34.671193 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 11616
I20260811 00:59:34.671346 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance
I20260811 00:59:34.671573 15640 external_mini_cluster.cc:1428] Setting key dcf51b3fd632a44520757f40d3449c03
Aug 11 00:59:34 dist-test-slave-h3ft krb5kdc[11008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409974, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:59:34.681658 11160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:34.670939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:54147 (local address 127.15.70.62:32797)
0811 00:59:34.671087 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:34.671090 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:34.671410 (+ 320us) server_negotiation.cc:407] Connection header received
0811 00:59:34.672235 (+ 825us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:34.672237 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:34.672253 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:34.672348 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:34.673793 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:34.674347 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:34.675653 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:34.675858 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:34.675918 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:34.678560 (+ 2642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:34.678562 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:34.678563 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:59:34.678571 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:34.680153 (+ 1582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:34.680585 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:34.680585 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:34.680586 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:34.680644 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:34.680954 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:34.680955 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:34.680956 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:34.681110 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:34.681190 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:34.681475 (+ 285us) server_negotiation.cc:299] Negotiation successful
0811 00:59:34.681565 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 00:59:34.681846 11813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:34.670918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:32797 (local address 127.15.70.3:54147)
0811 00:59:34.671163 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:34.671220 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:34.672095 (+ 875us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:34.672527 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:34.672532 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:34.673417 (+ 885us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:59:34.673691 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:34.673696 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:34.674439 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:34.674440 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:34.675563 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:34.675567 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:34.675944 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:34.675945 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:34.676092 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:34.676703 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:59:34.676714 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:59:34.678460 (+ 1746us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:59:34.680248 (+ 1788us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:59:34.680256 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:59:34.680259 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:59:34.680511 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:59:34.680704 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:59:34.680704 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:59:34.680705 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:59:34.680819 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:59:34.681183 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:59:34.681189 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:59:34.681332 (+ 143us) client_negotiation.cc:769] Sending connection context
0811 00:59:34.681425 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 00:59:34.681573 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":144,"threads_started":1}
I20260811 00:59:34.682516 11811 heartbeater.cc:347] Connected to a master server at 127.15.70.62:32797
I20260811 00:59:34.682672 11811 heartbeater.cc:464] Registering TS with master...
I20260811 00:59:34.682947 11811 heartbeater.cc:511] Master 127.15.70.62:32797 requested a full tablet report, sending...
I20260811 00:59:34.683624 11076 ts_manager.cc:194] Registered new tserver with Master: eea48d1be6e148939d342fc0f9b3353f (127.15.70.3:36561)
I20260811 00:59:34.684211 11076 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.3@KRBTEST.COM'} at 127.15.70.3:54147
I20260811 00:59:34.684237 15640 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 00:59:34.693305 11160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:34.686189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37600 (local address 127.15.70.62:32797)
0811 00:59:34.686305 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:34.686307 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:34.686431 (+ 124us) server_negotiation.cc:407] Connection header received
0811 00:59:34.686538 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:34.686539 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:34.686551 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:34.686600 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:34.687356 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:34.687883 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:34.688704 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:34.688943 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:34.689026 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:34.690484 (+ 1458us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:34.690486 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:34.690486 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:59:34.690495 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:34.691968 (+ 1473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:34.692343 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:34.692344 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:34.692345 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:34.692417 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:34.692634 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:34.692635 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:34.692636 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:34.692827 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:34.692950 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:34.693075 (+ 125us) server_negotiation.cc:299] Negotiation successful
0811 00:59:34.693173 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 00:59:34.695250 11076 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37600:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:59:34.697362 11076 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:59:34.705884 11829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:34.700615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:40339 (local address 127.0.0.1:33714)
0811 00:59:34.701038 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:34.701090 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:34.701181 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:34.701609 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:34.701612 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:34.701615 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:59:34.701717 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:34.701719 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:34.703185 (+ 1466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:34.703186 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:34.704615 (+ 1429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:34.704619 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:34.705471 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:34.705472 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:34.705577 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:34.705594 (+ 17us) client_negotiation.cc:769] Sending connection context
0811 00:59:34.705699 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 00:59:34.705774 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":382,"mutex_wait_us":39,"thread_start_us":93,"threads_started":1}
I20260811 00:59:34.705897 11832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:34.701068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33714 (local address 127.15.70.1:40339)
0811 00:59:34.701375 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:34.701381 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:34.701394 (+ 13us) server_negotiation.cc:407] Connection header received
0811 00:59:34.701451 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:34.701454 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:34.701473 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:34.701572 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:59:34.701793 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:34.703052 (+ 1259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:34.704737 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:34.705341 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:34.705471 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:34.705542 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:34.705718 (+ 176us) server_negotiation.cc:299] Negotiation successful
0811 00:59:34.705770 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":247,"thread_start_us":103,"threads_started":1}
I20260811 00:59:34.706290 11830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:34.700780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51482 (local address 127.15.70.2:45587)
0811 00:59:34.701001 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:34.701008 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:34.702056 (+ 1048us) server_negotiation.cc:407] Connection header received
0811 00:59:34.702118 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:34.702121 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:34.702141 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:34.702231 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:59:34.702384 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:34.703479 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:34.704871 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:34.705717 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:34.705789 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:34.705856 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:34.706111 (+ 255us) server_negotiation.cc:299] Negotiation successful
0811 00:59:34.706183 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":120,"threads_started":1}
I20260811 00:59:34.706367 11831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:34.700966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37028 (local address 127.15.70.3:36561)
0811 00:59:34.701188 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:34.701194 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:34.701827 (+ 633us) server_negotiation.cc:407] Connection header received
0811 00:59:34.701926 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:34.701930 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:34.701950 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:34.702046 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:59:34.702350 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:34.703254 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:34.704563 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:34.705359 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:34.705443 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:34.705532 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:34.706200 (+ 668us) server_negotiation.cc:299] Negotiation successful
0811 00:59:34.706255 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":120,"threads_started":1}
I20260811 00:59:34.706645 11826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:34.700615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:36561 (local address 127.0.0.1:37028)
0811 00:59:34.701725 (+ 1110us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:34.701745 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:34.701832 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:34.702159 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:34.702160 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:34.702162 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:59:34.702253 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:34.702255 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:34.703403 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:34.703405 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:34.704441 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:34.704445 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:34.705576 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:34.705577 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:34.705666 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:34.705670 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:59:34.705732 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 00:59:34.706538 (+ 806us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1091,"mutex_wait_us":3,"thread_start_us":122,"threads_started":1}
I20260811 00:59:34.706645 11828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:34.700617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.2:45587 (local address 127.0.0.1:51482)
0811 00:59:34.701939 (+ 1322us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:34.701959 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:34.702026 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:34.702248 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:34.702248 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:34.702250 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:59:34.702309 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:34.702311 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:34.703614 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:34.703615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:34.704772 (+ 1157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:34.704775 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:34.705898 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:34.705899 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:34.705980 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:34.705985 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 00:59:34.706481 (+ 496us) client_negotiation.cc:240] Negotiation successful
0811 00:59:34.706537 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1295,"mutex_wait_us":25,"thread_start_us":129,"threads_started":1}
I20260811 00:59:34.707219 11281 tablet_service.cc:1467] Processing CreateTablet for tablet 61ad325e0aa64495bbcec092f7607d11 (DEFAULT_TABLE table=test-table [id=83b46a3ded60450b97a394dcf54afdcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:59:34.707530 11706 tablet_service.cc:1467] Processing CreateTablet for tablet 61ad325e0aa64495bbcec092f7607d11 (DEFAULT_TABLE table=test-table [id=83b46a3ded60450b97a394dcf54afdcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:59:34.707770 11281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61ad325e0aa64495bbcec092f7607d11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:59:34.707816 11503 tablet_service.cc:1467] Processing CreateTablet for tablet 61ad325e0aa64495bbcec092f7607d11 (DEFAULT_TABLE table=test-table [id=83b46a3ded60450b97a394dcf54afdcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:59:34.707930 11706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61ad325e0aa64495bbcec092f7607d11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:59:34.708214 11503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61ad325e0aa64495bbcec092f7607d11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:59:34.711612 11833 tablet_bootstrap.cc:492] T 61ad325e0aa64495bbcec092f7607d11 P bab30f7aa4ef4f9b8bb8f650baff0bef: Bootstrap starting.
I20260811 00:59:34.712170 11836 tablet_bootstrap.cc:492] T 61ad325e0aa64495bbcec092f7607d11 P eea48d1be6e148939d342fc0f9b3353f: Bootstrap starting.
I20260811 00:59:34.712540 11833 tablet_bootstrap.cc:654] T 61ad325e0aa64495bbcec092f7607d11 P bab30f7aa4ef4f9b8bb8f650baff0bef: Neither blocks nor log segments found. Creating new log.
I20260811 00:59:34.712531 11837 tablet_bootstrap.cc:492] T 61ad325e0aa64495bbcec092f7607d11 P 3301698c773c4d0a9dbd0dc22331d1d9: Bootstrap starting.
I20260811 00:59:34.713161 11836 tablet_bootstrap.cc:654] T 61ad325e0aa64495bbcec092f7607d11 P eea48d1be6e148939d342fc0f9b3353f: Neither blocks nor log segments found. Creating new log.
I20260811 00:59:34.713286 11837 tablet_bootstrap.cc:654] T 61ad325e0aa64495bbcec092f7607d11 P 3301698c773c4d0a9dbd0dc22331d1d9: Neither blocks nor log segments found. Creating new log.
I20260811 00:59:34.713339 11833 log.cc:824] T 61ad325e0aa64495bbcec092f7607d11 P bab30f7aa4ef4f9b8bb8f650baff0bef: Log is configured to *not* fsync() on all Append() calls
I20260811 00:59:34.713850 11836 log.cc:824] T 61ad325e0aa64495bbcec092f7607d11 P eea48d1be6e148939d342fc0f9b3353f: Log is configured to *not* fsync() on all Append() calls
I20260811 00:59:34.714032 11837 log.cc:824] T 61ad325e0aa64495bbcec092f7607d11 P 3301698c773c4d0a9dbd0dc22331d1d9: Log is configured to *not* fsync() on all Append() calls
I20260811 00:59:34.714727 11833 tablet_bootstrap.cc:492] T 61ad325e0aa64495bbcec092f7607d11 P bab30f7aa4ef4f9b8bb8f650baff0bef: No bootstrap required, opened a new log
I20260811 00:59:34.714808 11833 ts_tablet_manager.cc:1397] T 61ad325e0aa64495bbcec092f7607d11 P bab30f7aa4ef4f9b8bb8f650baff0bef: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 00:59:34.714859 11836 tablet_bootstrap.cc:492] T 61ad325e0aa64495bbcec092f7607d11 P eea48d1be6e148939d342fc0f9b3353f: No bootstrap required, opened a new log
I20260811 00:59:34.714931 11837 tablet_bootstrap.cc:492] T 61ad325e0aa64495bbcec092f7607d11 P 3301698c773c4d0a9dbd0dc22331d1d9: No bootstrap required, opened a new log
I20260811 00:59:34.714946 11836 ts_tablet_manager.cc:1397] T 61ad325e0aa64495bbcec092f7607d11 P eea48d1be6e148939d342fc0f9b3353f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 00:59:34.715042 11837 ts_tablet_manager.cc:1397] T 61ad325e0aa64495bbcec092f7607d11 P 3301698c773c4d0a9dbd0dc22331d1d9: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 00:59:34.716571 11833 raft_consensus.cc:348] T 61ad325e0aa64495bbcec092f7607d11 P bab30f7aa4ef4f9b8bb8f650baff0bef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bab30f7aa4ef4f9b8bb8f650baff0bef" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 40339 } } peers { permanent_uuid: "3301698c773c4d0a9dbd0dc22331d1d9" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 45587 } } peers { permanent_uuid: "eea48d1be6e148939d342fc0f9b3353f" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36561 } }
I20260811 00:59:34.716784 11833 raft_consensus.cc:374] T 61ad325e0aa64495bbcec092f7607d11 P bab30f7aa4ef4f9b8bb8f650baff0bef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:59:34.716835 11833 raft_consensus.cc:729] T 61ad325e0aa64495bbcec092f7607d11 P bab30f7aa4ef4f9b8bb8f650baff0bef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bab30f7aa4ef4f9b8bb8f650baff0bef, State: Initialized, Role: FOLLOWER
I20260811 00:59:34.717005 11833 consensus_queue.cc:260] T 61ad325e0aa64495bbcec092f7607d11 P bab30f7aa4ef4f9b8bb8f650baff0bef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bab30f7aa4ef4f9b8bb8f650baff0bef" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 40339 } } peers { permanent_uuid: "3301698c773c4d0a9dbd0dc22331d1d9" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 45587 } } peers { permanent_uuid: "eea48d1be6e148939d342fc0f9b3353f" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36561 } }
I20260811 00:59:34.717373 11389 heartbeater.cc:503] Master 127.15.70.62:32797 was elected leader, sending a full tablet report...
I20260811 00:59:34.717374 11833 ts_tablet_manager.cc:1428] T 61ad325e0aa64495bbcec092f7607d11 P bab30f7aa4ef4f9b8bb8f650baff0bef: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 00:59:34.717443 11836 raft_consensus.cc:348] T 61ad325e0aa64495bbcec092f7607d11 P eea48d1be6e148939d342fc0f9b3353f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bab30f7aa4ef4f9b8bb8f650baff0bef" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 40339 } } peers { permanent_uuid: "3301698c773c4d0a9dbd0dc22331d1d9" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 45587 } } peers { permanent_uuid: "eea48d1be6e148939d342fc0f9b3353f" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36561 } }
I20260811 00:59:34.717443 11837 raft_consensus.cc:348] T 61ad325e0aa64495bbcec092f7607d11 P 3301698c773c4d0a9dbd0dc22331d1d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bab30f7aa4ef4f9b8bb8f650baff0bef" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 40339 } } peers { permanent_uuid: "3301698c773c4d0a9dbd0dc22331d1d9" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 45587 } } peers { permanent_uuid: "eea48d1be6e148939d342fc0f9b3353f" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36561 } }
I20260811 00:59:34.717636 11836 raft_consensus.cc:374] T 61ad325e0aa64495bbcec092f7607d11 P eea48d1be6e148939d342fc0f9b3353f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:59:34.717636 11837 raft_consensus.cc:374] T 61ad325e0aa64495bbcec092f7607d11 P 3301698c773c4d0a9dbd0dc22331d1d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:59:34.717675 11836 raft_consensus.cc:729] T 61ad325e0aa64495bbcec092f7607d11 P eea48d1be6e148939d342fc0f9b3353f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eea48d1be6e148939d342fc0f9b3353f, State: Initialized, Role: FOLLOWER
I20260811 00:59:34.717675 11837 raft_consensus.cc:729] T 61ad325e0aa64495bbcec092f7607d11 P 3301698c773c4d0a9dbd0dc22331d1d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3301698c773c4d0a9dbd0dc22331d1d9, State: Initialized, Role: FOLLOWER
I20260811 00:59:34.717798 11837 consensus_queue.cc:260] T 61ad325e0aa64495bbcec092f7607d11 P 3301698c773c4d0a9dbd0dc22331d1d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bab30f7aa4ef4f9b8bb8f650baff0bef" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 40339 } } peers { permanent_uuid: "3301698c773c4d0a9dbd0dc22331d1d9" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 45587 } } peers { permanent_uuid: "eea48d1be6e148939d342fc0f9b3353f" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36561 } }
I20260811 00:59:34.717844 11836 consensus_queue.cc:260] T 61ad325e0aa64495bbcec092f7607d11 P eea48d1be6e148939d342fc0f9b3353f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bab30f7aa4ef4f9b8bb8f650baff0bef" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 40339 } } peers { permanent_uuid: "3301698c773c4d0a9dbd0dc22331d1d9" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 45587 } } peers { permanent_uuid: "eea48d1be6e148939d342fc0f9b3353f" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36561 } }
I20260811 00:59:34.718149 11837 ts_tablet_manager.cc:1428] T 61ad325e0aa64495bbcec092f7607d11 P 3301698c773c4d0a9dbd0dc22331d1d9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 00:59:34.718178 11836 ts_tablet_manager.cc:1428] T 61ad325e0aa64495bbcec092f7607d11 P eea48d1be6e148939d342fc0f9b3353f: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 00:59:34.718302 11811 heartbeater.cc:503] Master 127.15.70.62:32797 was elected leader, sending a full tablet report...
I20260811 00:59:34.718436 11611 heartbeater.cc:503] Master 127.15.70.62:32797 was elected leader, sending a full tablet report...
I20260811 00:59:34.757565 11842 raft_consensus.cc:482] T 61ad325e0aa64495bbcec092f7607d11 P bab30f7aa4ef4f9b8bb8f650baff0bef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:59:34.757761 11842 raft_consensus.cc:504] T 61ad325e0aa64495bbcec092f7607d11 P bab30f7aa4ef4f9b8bb8f650baff0bef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bab30f7aa4ef4f9b8bb8f650baff0bef" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 40339 } } peers { permanent_uuid: "3301698c773c4d0a9dbd0dc22331d1d9" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 45587 } } peers { permanent_uuid: "eea48d1be6e148939d342fc0f9b3353f" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36561 } }
I20260811 00:59:34.758319 11842 leader_election.cc:288] T 61ad325e0aa64495bbcec092f7607d11 P bab30f7aa4ef4f9b8bb8f650baff0bef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3301698c773c4d0a9dbd0dc22331d1d9 (127.15.70.2:45587), eea48d1be6e148939d342fc0f9b3353f (127.15.70.3:36561)
I20260811 00:59:34.761615 11831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:34.758777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:36563 (local address 127.15.70.3:36561)
0811 00:59:34.758875 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:34.758877 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:34.758886 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:59:34.758918 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:34.758920 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:34.758934 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:34.759003 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:59:34.759253 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:34.759779 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:34.760799 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:34.761206 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:34.761294 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:34.761309 (+ 15us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:34.761477 (+ 168us) server_negotiation.cc:299] Negotiation successful
0811 00:59:34.761530 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 00:59:34.761634 11391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:34.758557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:36561 (local address 127.15.70.1:36563)
0811 00:59:34.758639 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:34.758654 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:34.758712 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:34.759039 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:34.759041 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:34.759042 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:59:34.759141 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:34.759143 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:34.759867 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:34.759868 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:34.760688 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:34.760690 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:34.761292 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:34.761293 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:34.761384 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:34.761388 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:59:34.761468 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 00:59:34.761518 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260811 00:59:34.761644 11830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:34.758631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:51045 (local address 127.15.70.2:45587)
0811 00:59:34.758701 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:34.758704 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:34.758948 (+ 244us) server_negotiation.cc:407] Connection header received
0811 00:59:34.759030 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:34.759031 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:34.759047 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:34.759136 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:59:34.759320 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:34.759810 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:34.760795 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:34.761244 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:34.761332 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:34.761345 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:34.761507 (+ 162us) server_negotiation.cc:299] Negotiation successful
0811 00:59:34.761568 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 00:59:34.761636 11845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:34.758558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.2:45587 (local address 127.15.70.1:51045)
0811 00:59:34.758826 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:34.758837 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:34.758945 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:34.759141 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:34.759142 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:34.759144 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:59:34.759242 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:34.759243 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:34.759906 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:34.759908 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:34.760694 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:34.760696 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:34.761333 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:34.761334 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:34.761411 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:34.761415 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:59:34.761487 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 00:59:34.761537 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"mutex_wait_us":64,"thread_start_us":132,"threads_started":1}
I20260811 00:59:34.762130 11732 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61ad325e0aa64495bbcec092f7607d11" candidate_uuid: "bab30f7aa4ef4f9b8bb8f650baff0bef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eea48d1be6e148939d342fc0f9b3353f" is_pre_election: true
I20260811 00:59:34.762133 11530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61ad325e0aa64495bbcec092f7607d11" candidate_uuid: "bab30f7aa4ef4f9b8bb8f650baff0bef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3301698c773c4d0a9dbd0dc22331d1d9" is_pre_election: true
I20260811 00:59:34.762329 11530 raft_consensus.cc:2454] T 61ad325e0aa64495bbcec092f7607d11 P 3301698c773c4d0a9dbd0dc22331d1d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bab30f7aa4ef4f9b8bb8f650baff0bef in term 0.
I20260811 00:59:34.762327 11732 raft_consensus.cc:2454] T 61ad325e0aa64495bbcec092f7607d11 P eea48d1be6e148939d342fc0f9b3353f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bab30f7aa4ef4f9b8bb8f650baff0bef in term 0.
I20260811 00:59:34.762634 11202 leader_election.cc:302] T 61ad325e0aa64495bbcec092f7607d11 P bab30f7aa4ef4f9b8bb8f650baff0bef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bab30f7aa4ef4f9b8bb8f650baff0bef, eea48d1be6e148939d342fc0f9b3353f; no voters:
I20260811 00:59:34.762830 11842 raft_consensus.cc:2781] T 61ad325e0aa64495bbcec092f7607d11 P bab30f7aa4ef4f9b8bb8f650baff0bef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:59:34.762907 11842 raft_consensus.cc:482] T 61ad325e0aa64495bbcec092f7607d11 P bab30f7aa4ef4f9b8bb8f650baff0bef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:59:34.762934 11842 raft_consensus.cc:3037] T 61ad325e0aa64495bbcec092f7607d11 P bab30f7aa4ef4f9b8bb8f650baff0bef [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:59:34.763887 11842 raft_consensus.cc:504] T 61ad325e0aa64495bbcec092f7607d11 P bab30f7aa4ef4f9b8bb8f650baff0bef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bab30f7aa4ef4f9b8bb8f650baff0bef" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 40339 } } peers { permanent_uuid: "3301698c773c4d0a9dbd0dc22331d1d9" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 45587 } } peers { permanent_uuid: "eea48d1be6e148939d342fc0f9b3353f" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36561 } }
I20260811 00:59:34.764053 11842 leader_election.cc:288] T 61ad325e0aa64495bbcec092f7607d11 P bab30f7aa4ef4f9b8bb8f650baff0bef [CANDIDATE]: Term 1 election: Requested vote from peers 3301698c773c4d0a9dbd0dc22331d1d9 (127.15.70.2:45587), eea48d1be6e148939d342fc0f9b3353f (127.15.70.3:36561)
I20260811 00:59:34.764256 11530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61ad325e0aa64495bbcec092f7607d11" candidate_uuid: "bab30f7aa4ef4f9b8bb8f650baff0bef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3301698c773c4d0a9dbd0dc22331d1d9"
I20260811 00:59:34.764274 11732 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61ad325e0aa64495bbcec092f7607d11" candidate_uuid: "bab30f7aa4ef4f9b8bb8f650baff0bef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eea48d1be6e148939d342fc0f9b3353f"
W20260811 00:59:34.764289 11390 tablet.cc:2369] T 61ad325e0aa64495bbcec092f7607d11 P bab30f7aa4ef4f9b8bb8f650baff0bef: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 00:59:34.764353 11530 raft_consensus.cc:3037] T 61ad325e0aa64495bbcec092f7607d11 P 3301698c773c4d0a9dbd0dc22331d1d9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:59:34.764362 11732 raft_consensus.cc:3037] T 61ad325e0aa64495bbcec092f7607d11 P eea48d1be6e148939d342fc0f9b3353f [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:59:34.765509 11530 raft_consensus.cc:2454] T 61ad325e0aa64495bbcec092f7607d11 P 3301698c773c4d0a9dbd0dc22331d1d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bab30f7aa4ef4f9b8bb8f650baff0bef in term 1.
I20260811 00:59:34.765509 11732 raft_consensus.cc:2454] T 61ad325e0aa64495bbcec092f7607d11 P eea48d1be6e148939d342fc0f9b3353f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bab30f7aa4ef4f9b8bb8f650baff0bef in term 1.
I20260811 00:59:34.765736 11204 leader_election.cc:302] T 61ad325e0aa64495bbcec092f7607d11 P bab30f7aa4ef4f9b8bb8f650baff0bef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3301698c773c4d0a9dbd0dc22331d1d9, bab30f7aa4ef4f9b8bb8f650baff0bef; no voters:
I20260811 00:59:34.765851 11842 raft_consensus.cc:2781] T 61ad325e0aa64495bbcec092f7607d11 P bab30f7aa4ef4f9b8bb8f650baff0bef [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:59:34.766085 11842 raft_consensus.cc:686] T 61ad325e0aa64495bbcec092f7607d11 P bab30f7aa4ef4f9b8bb8f650baff0bef [term 1 LEADER]: Becoming Leader. State: Replica: bab30f7aa4ef4f9b8bb8f650baff0bef, State: Running, Role: LEADER
I20260811 00:59:34.766213 11842 consensus_queue.cc:237] T 61ad325e0aa64495bbcec092f7607d11 P bab30f7aa4ef4f9b8bb8f650baff0bef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bab30f7aa4ef4f9b8bb8f650baff0bef" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 40339 } } peers { permanent_uuid: "3301698c773c4d0a9dbd0dc22331d1d9" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 45587 } } peers { permanent_uuid: "eea48d1be6e148939d342fc0f9b3353f" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36561 } }
I20260811 00:59:34.767271 11075 catalog_manager.cc:5495] T 61ad325e0aa64495bbcec092f7607d11 P bab30f7aa4ef4f9b8bb8f650baff0bef reported cstate change: term changed from 0 to 1, leader changed from <none> to bab30f7aa4ef4f9b8bb8f650baff0bef (127.15.70.1). New cstate: current_term: 1 leader_uuid: "bab30f7aa4ef4f9b8bb8f650baff0bef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bab30f7aa4ef4f9b8bb8f650baff0bef" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3301698c773c4d0a9dbd0dc22331d1d9" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 45587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eea48d1be6e148939d342fc0f9b3353f" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36561 } health_report { overall_health: UNKNOWN } } }
I20260811 00:59:34.783164 11832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:34.780561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33728 (local address 127.15.70.1:40339)
0811 00:59:34.780630 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:34.780633 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:34.780650 (+ 17us) server_negotiation.cc:407] Connection header received
0811 00:59:34.780699 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:34.780699 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:34.780726 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:34.780795 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:59:34.780944 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:34.781515 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:34.782295 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:34.782511 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:34.782572 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:34.782722 (+ 150us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:59:34.782850 (+ 128us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:59:34.782921 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:34.782953 (+ 32us) server_negotiation.cc:299] Negotiation successful
0811 00:59:34.782976 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 00:59:34.785892 11732 raft_consensus.cc:1261] T 61ad325e0aa64495bbcec092f7607d11 P eea48d1be6e148939d342fc0f9b3353f [term 1 FOLLOWER]: Refusing update from remote peer bab30f7aa4ef4f9b8bb8f650baff0bef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:59:34.785892 11530 raft_consensus.cc:1261] T 61ad325e0aa64495bbcec092f7607d11 P 3301698c773c4d0a9dbd0dc22331d1d9 [term 1 FOLLOWER]: Refusing update from remote peer bab30f7aa4ef4f9b8bb8f650baff0bef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:59:34.786355 11842 consensus_queue.cc:1035] T 61ad325e0aa64495bbcec092f7607d11 P bab30f7aa4ef4f9b8bb8f650baff0bef [LEADER]: Connected to new peer: Peer: permanent_uuid: "3301698c773c4d0a9dbd0dc22331d1d9" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 45587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:59:34.786563 11846 consensus_queue.cc:1035] T 61ad325e0aa64495bbcec092f7607d11 P bab30f7aa4ef4f9b8bb8f650baff0bef [LEADER]: Connected to new peer: Peer: permanent_uuid: "eea48d1be6e148939d342fc0f9b3353f" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 36561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:59:34.793110 11076 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37600:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:59:34.793241 11076 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37600:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:59:34.794176 11076 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 118dd958422e410db3e52226f95e4558: Sending DeleteTablet for 3 replicas of tablet 61ad325e0aa64495bbcec092f7607d11
I20260811 00:59:34.794552 11281 tablet_service.cc:1514] Processing DeleteTablet for tablet 61ad325e0aa64495bbcec092f7607d11 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:59:34 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:33714
I20260811 00:59:34.794627 11706 tablet_service.cc:1514] Processing DeleteTablet for tablet 61ad325e0aa64495bbcec092f7607d11 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:59:34 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:37028
I20260811 00:59:34.794637 11503 tablet_service.cc:1514] Processing DeleteTablet for tablet 61ad325e0aa64495bbcec092f7607d11 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:59:34 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:51482
I20260811 00:59:34.794905 11862 tablet_replica.cc:330] T 61ad325e0aa64495bbcec092f7607d11 P bab30f7aa4ef4f9b8bb8f650baff0bef: stopping tablet replica
I20260811 00:59:34.794920 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 11176
I20260811 00:59:34.795060 11862 raft_consensus.cc:2229] T 61ad325e0aa64495bbcec092f7607d11 P bab30f7aa4ef4f9b8bb8f650baff0bef [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:59:34.795297 11862 raft_consensus.cc:2258] T 61ad325e0aa64495bbcec092f7607d11 P bab30f7aa4ef4f9b8bb8f650baff0bef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:59:34.802974 11866 tablet_replica.cc:330] T 61ad325e0aa64495bbcec092f7607d11 P eea48d1be6e148939d342fc0f9b3353f: stopping tablet replica
I20260811 00:59:34.803297 11866 raft_consensus.cc:2229] T 61ad325e0aa64495bbcec092f7607d11 P eea48d1be6e148939d342fc0f9b3353f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:59:34.803498 11866 raft_consensus.cc:2258] T 61ad325e0aa64495bbcec092f7607d11 P eea48d1be6e148939d342fc0f9b3353f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:59:34.805547 11864 tablet_replica.cc:330] T 61ad325e0aa64495bbcec092f7607d11 P 3301698c773c4d0a9dbd0dc22331d1d9: stopping tablet replica
I20260811 00:59:34.805737 11864 raft_consensus.cc:2229] T 61ad325e0aa64495bbcec092f7607d11 P 3301698c773c4d0a9dbd0dc22331d1d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:59:34.805904 11864 raft_consensus.cc:2258] T 61ad325e0aa64495bbcec092f7607d11 P 3301698c773c4d0a9dbd0dc22331d1d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:59:34.806526 11864 ts_tablet_manager.cc:1905] T 61ad325e0aa64495bbcec092f7607d11 P 3301698c773c4d0a9dbd0dc22331d1d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:59:34.808909 11864 ts_tablet_manager.cc:1918] T 61ad325e0aa64495bbcec092f7607d11 P 3301698c773c4d0a9dbd0dc22331d1d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:59:34.809114 11864 log.cc:1196] T 61ad325e0aa64495bbcec092f7607d11 P 3301698c773c4d0a9dbd0dc22331d1d9: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-1/wal/wals/61ad325e0aa64495bbcec092f7607d11
I20260811 00:59:34.809569 11864 ts_tablet_manager.cc:1939] T 61ad325e0aa64495bbcec092f7607d11 P 3301698c773c4d0a9dbd0dc22331d1d9: Deleting consensus metadata
I20260811 00:59:34.811439 11059 catalog_manager.cc:4841] TS 3301698c773c4d0a9dbd0dc22331d1d9 (127.15.70.2:45587): tablet 61ad325e0aa64495bbcec092f7607d11 (table test-table [id=83b46a3ded60450b97a394dcf54afdcf]) successfully deleted
I20260811 00:59:34.813146 11866 ts_tablet_manager.cc:1905] T 61ad325e0aa64495bbcec092f7607d11 P eea48d1be6e148939d342fc0f9b3353f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:59:34.815303 11866 ts_tablet_manager.cc:1918] T 61ad325e0aa64495bbcec092f7607d11 P eea48d1be6e148939d342fc0f9b3353f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:59:34.815392 11866 log.cc:1196] T 61ad325e0aa64495bbcec092f7607d11 P eea48d1be6e148939d342fc0f9b3353f: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409704606556-15640-0/minicluster-data/ts-2/wal/wals/61ad325e0aa64495bbcec092f7607d11
I20260811 00:59:34.815718 11866 ts_tablet_manager.cc:1939] T 61ad325e0aa64495bbcec092f7607d11 P eea48d1be6e148939d342fc0f9b3353f: Deleting consensus metadata
I20260811 00:59:34.816334 11057 catalog_manager.cc:4841] TS eea48d1be6e148939d342fc0f9b3353f (127.15.70.3:36561): tablet 61ad325e0aa64495bbcec092f7607d11 (table test-table [id=83b46a3ded60450b97a394dcf54afdcf]) successfully deleted
W20260811 00:59:34.820297 11060 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.70.1:40339 (error 108)
I20260811 00:59:34.820566 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 11397
I20260811 00:59:34.821005 11826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:34.820842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:40339 (local address 127.0.0.1:33738)
0811 00:59:34.820909 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:34.820951 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.1:40339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 00:59:34.824186 11060 catalog_manager.cc:4584] TS bab30f7aa4ef4f9b8bb8f650baff0bef (127.15.70.1:40339): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 61ad325e0aa64495bbcec092f7607d11: Network error: Client connection negotiation failed: client connection to 127.15.70.1:40339: connect: Connection refused (error 111)
I20260811 00:59:34.834822 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 11616
I20260811 00:59:34.854077 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 11031
2026-08-11T00:59:34Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2505 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-11T00:59:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:59:34Z Disabled control of system clock
I20260811 00:59:34.896971 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:46131
--webserver_interface=127.15.70.62
--webserver_port=0
--builtin_ntp_servers=127.15.70.20:36157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:46131
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 00:59:34.993232 11873 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:59:34.993551 11873 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:59:34.993574 11873 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:59:34.994827 11873 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:59:34.994867 11873 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:59:34.994881 11873 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:59:34.994894 11873 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:59:34.994906 11873 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:59:34.996450 11873 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:36157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:46131
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:46131
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11873
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:59:34.996716 11873 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:59:34.997033 11873 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:59:35.003146 11884 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:35.003094 11883 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:35.003098 11886 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:35.003311 11873 server_base.cc:1034] running on GCE node
I20260811 00:59:35.003890 11873 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:59:35.004289 11873 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:59:35.005476 11873 hybrid_clock.cc:648] HybridClock initialized: now 1786409975005454 us; error 46 us; skew 500 ppm
I20260811 00:59:35.007282 11873 webserver.cc:460] Webserver started at http://127.15.70.62:34317/ using document root <none> and password file <none>
I20260811 00:59:35.007596 11873 fs_manager.cc:359] Metadata directory not provided
I20260811 00:59:35.007681 11873 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:59:35.007861 11873 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:59:35.009238 11873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "f4cd13f813fb4618a498e7498ef87a33"
format_stamp: "Formatted at 2026-08-11 00:59:35 on dist-test-slave-h3ft"
server_key: "a1b0cd04b026238bb63700142321a35b"
server_key_iv: "efbe1deb7dddef49e4d2ae7245e87120"
server_key_version: "encryptionkey@0"
I20260811 00:59:35.009713 11873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "f4cd13f813fb4618a498e7498ef87a33"
format_stamp: "Formatted at 2026-08-11 00:59:35 on dist-test-slave-h3ft"
server_key: "a1b0cd04b026238bb63700142321a35b"
server_key_iv: "efbe1deb7dddef49e4d2ae7245e87120"
server_key_version: "encryptionkey@0"
I20260811 00:59:35.011440 11873 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260811 00:59:35.012488 11896 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:35.012728 11873 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:59:35.012862 11873 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "f4cd13f813fb4618a498e7498ef87a33"
format_stamp: "Formatted at 2026-08-11 00:59:35 on dist-test-slave-h3ft"
server_key: "a1b0cd04b026238bb63700142321a35b"
server_key_iv: "efbe1deb7dddef49e4d2ae7245e87120"
server_key_version: "encryptionkey@0"
I20260811 00:59:35.012959 11873 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:59:35.033675 11873 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:59:35.034145 11873 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:59:35.034328 11873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:59:35.039326 11873 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:46131
I20260811 00:59:35.039506 11973 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:46131 every 8 connection(s)
I20260811 00:59:35.039839 11873 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:59:35.041138 11974 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:59:35.043169 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 11873
I20260811 00:59:35.043304 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 00:59:35.043515 15640 external_mini_cluster.cc:1428] Setting key 8b9ae72e9a0c09a19c1d2a3e090b8971
I20260811 00:59:35.044668 11974 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4cd13f813fb4618a498e7498ef87a33: Bootstrap starting.
I20260811 00:59:35.045615 11974 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f4cd13f813fb4618a498e7498ef87a33: Neither blocks nor log segments found. Creating new log.
I20260811 00:59:35.046080 11974 log.cc:824] T 00000000000000000000000000000000 P f4cd13f813fb4618a498e7498ef87a33: Log is configured to *not* fsync() on all Append() calls
I20260811 00:59:35.047044 11974 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4cd13f813fb4618a498e7498ef87a33: No bootstrap required, opened a new log
I20260811 00:59:35.049882 11974 raft_consensus.cc:348] T 00000000000000000000000000000000 P f4cd13f813fb4618a498e7498ef87a33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4cd13f813fb4618a498e7498ef87a33" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 46131 } }
I20260811 00:59:35.050153 11974 raft_consensus.cc:374] T 00000000000000000000000000000000 P f4cd13f813fb4618a498e7498ef87a33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:59:35.050209 11974 raft_consensus.cc:729] T 00000000000000000000000000000000 P f4cd13f813fb4618a498e7498ef87a33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4cd13f813fb4618a498e7498ef87a33, State: Initialized, Role: FOLLOWER
I20260811 00:59:35.050393 11974 consensus_queue.cc:260] T 00000000000000000000000000000000 P f4cd13f813fb4618a498e7498ef87a33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4cd13f813fb4618a498e7498ef87a33" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 46131 } }
I20260811 00:59:35.050513 11974 raft_consensus.cc:388] T 00000000000000000000000000000000 P f4cd13f813fb4618a498e7498ef87a33 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:59:35.050608 11974 raft_consensus.cc:482] T 00000000000000000000000000000000 P f4cd13f813fb4618a498e7498ef87a33 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:59:35.050678 11974 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f4cd13f813fb4618a498e7498ef87a33 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:59:35.051193 11977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:35.044240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36754 (local address 127.15.70.62:46131)
0811 00:59:35.044527 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:35.044539 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:35.044579 (+ 40us) server_negotiation.cc:407] Connection header received
0811 00:59:35.045334 (+ 755us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:35.045346 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:35.045443 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:35.045624 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:35.045932 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:35.047519 (+ 1587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:35.048375 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:35.049112 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:35.049284 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:35.050084 (+ 800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:35.050089 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:35.050089 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:59:35.050378 (+ 289us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:35.050436 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:59:35.050455 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:35.050539 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:35.050639 (+ 100us) server_negotiation.cc:299] Negotiation successful
0811 00:59:35.050887 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":115,"threads_started":1}
I20260811 00:59:35.051739 11974 raft_consensus.cc:504] T 00000000000000000000000000000000 P f4cd13f813fb4618a498e7498ef87a33 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4cd13f813fb4618a498e7498ef87a33" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 46131 } }
I20260811 00:59:35.051887 11974 leader_election.cc:302] T 00000000000000000000000000000000 P f4cd13f813fb4618a498e7498ef87a33 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f4cd13f813fb4618a498e7498ef87a33; no voters:
I20260811 00:59:35.052116 11974 leader_election.cc:288] T 00000000000000000000000000000000 P f4cd13f813fb4618a498e7498ef87a33 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:59:35.052175 11979 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f4cd13f813fb4618a498e7498ef87a33 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:59:35.052361 11979 raft_consensus.cc:686] T 00000000000000000000000000000000 P f4cd13f813fb4618a498e7498ef87a33 [term 1 LEADER]: Becoming Leader. State: Replica: f4cd13f813fb4618a498e7498ef87a33, State: Running, Role: LEADER
I20260811 00:59:35.052459 11974 sys_catalog.cc:564] T 00000000000000000000000000000000 P f4cd13f813fb4618a498e7498ef87a33 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:59:35.052502 11979 consensus_queue.cc:237] T 00000000000000000000000000000000 P f4cd13f813fb4618a498e7498ef87a33 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4cd13f813fb4618a498e7498ef87a33" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 46131 } }
I20260811 00:59:35.052991 11983 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4cd13f813fb4618a498e7498ef87a33 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f4cd13f813fb4618a498e7498ef87a33. Latest consensus state: current_term: 1 leader_uuid: "f4cd13f813fb4618a498e7498ef87a33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4cd13f813fb4618a498e7498ef87a33" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 46131 } } }
I20260811 00:59:35.052966 11981 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4cd13f813fb4618a498e7498ef87a33 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f4cd13f813fb4618a498e7498ef87a33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4cd13f813fb4618a498e7498ef87a33" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 46131 } } }
I20260811 00:59:35.053112 11983 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4cd13f813fb4618a498e7498ef87a33 [sys.catalog]: This master's current role is: LEADER
I20260811 00:59:35.053117 11981 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4cd13f813fb4618a498e7498ef87a33 [sys.catalog]: This master's current role is: LEADER
I20260811 00:59:35.053946 11991 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:59:35.054600 11991 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:59:35.056540 11991 catalog_manager.cc:1347] Generated new cluster ID: 93a37b33a0e24c7baad66e11d3cc67cd
I20260811 00:59:35.056600 11991 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:59:35.071585 11991 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:59:35.072237 11991 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:59:35.080901 11991 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f4cd13f813fb4618a498e7498ef87a33: Generated new TSK 0
I20260811 00:59:35.081197 11991 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:59:35.083600 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.1:0
--local_ip_for_outbound_sockets=127.15.70.1
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:46131
--builtin_ntp_servers=127.15.70.20:36157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 00:59:35.183102 12011 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:59:35.183355 12011 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:59:35.183380 12011 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:59:35.184659 12011 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:59:35.184705 12011 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:59:35.184732 12011 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.1
I20260811 00:59:35.186213 12011 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:36157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:46131
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12011
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.1
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:59:35.186532 12011 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:59:35.186923 12011 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:59:35.193946 12019 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:35.193980 12022 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:35.193946 12018 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:35.194422 12011 server_base.cc:1034] running on GCE node
I20260811 00:59:35.194653 12011 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:59:35.194933 12011 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:59:35.196111 12011 hybrid_clock.cc:648] HybridClock initialized: now 1786409975196087 us; error 41 us; skew 500 ppm
I20260811 00:59:35.197750 12011 webserver.cc:460] Webserver started at http://127.15.70.1:43659/ using document root <none> and password file <none>
I20260811 00:59:35.198071 12011 fs_manager.cc:359] Metadata directory not provided
I20260811 00:59:35.198145 12011 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:59:35.198311 12011 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:59:35.199728 12011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-0/data/instance:
uuid: "805ce7cdd28f4e27bcb57f846fa47f04"
format_stamp: "Formatted at 2026-08-11 00:59:35 on dist-test-slave-h3ft"
server_key: "56959831f24da4fcba10ff124882ed7b"
server_key_iv: "c208b0ee5ab5dff1471dbd7d9fc35e62"
server_key_version: "encryptionkey@0"
I20260811 00:59:35.200135 12011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance:
uuid: "805ce7cdd28f4e27bcb57f846fa47f04"
format_stamp: "Formatted at 2026-08-11 00:59:35 on dist-test-slave-h3ft"
server_key: "56959831f24da4fcba10ff124882ed7b"
server_key_iv: "c208b0ee5ab5dff1471dbd7d9fc35e62"
server_key_version: "encryptionkey@0"
I20260811 00:59:35.201728 12011 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:59:35.202659 12029 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:35.202850 12011 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:59:35.202970 12011 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-0/wal
uuid: "805ce7cdd28f4e27bcb57f846fa47f04"
format_stamp: "Formatted at 2026-08-11 00:59:35 on dist-test-slave-h3ft"
server_key: "56959831f24da4fcba10ff124882ed7b"
server_key_iv: "c208b0ee5ab5dff1471dbd7d9fc35e62"
server_key_version: "encryptionkey@0"
I20260811 00:59:35.203104 12011 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:59:35.236388 12011 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:59:35.236861 12011 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:59:35.237051 12011 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:59:35.237380 12011 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:59:35.237830 12011 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:59:35.237891 12011 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:35.237939 12011 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:59:35.237987 12011 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:35.245093 12011 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.1:39927
I20260811 00:59:35.245196 12201 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.1:39927 every 8 connection(s)
I20260811 00:59:35.245645 12011 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
I20260811 00:59:35.252069 11977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:35.246615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:53375 (local address 127.15.70.62:46131)
0811 00:59:35.246699 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:35.246701 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:35.246944 (+ 243us) server_negotiation.cc:407] Connection header received
0811 00:59:35.247683 (+ 739us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:35.247684 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:35.247710 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:35.247768 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:35.248598 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:35.249215 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:35.250322 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:35.250547 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:35.250631 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:35.251682 (+ 1051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:35.251684 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:35.251685 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:59:35.251690 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:35.251717 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:59:35.251722 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:35.251787 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:35.251893 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 00:59:35.251930 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 00:59:35.252089 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 12011
I20260811 00:59:35.252229 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance
I20260811 00:59:35.252370 12204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:35.246565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46131 (local address 127.15.70.1:53375)
0811 00:59:35.246788 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:35.246831 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:35.247536 (+ 705us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:35.247851 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:35.247856 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:35.247873 (+ 17us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:59:35.248477 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:35.248481 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:35.249325 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:35.249327 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:35.250213 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:35.250215 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:35.250643 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:35.250644 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:35.250800 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:35.251491 (+ 691us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:59:35.251491 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:59:35.251541 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:59:35.251571 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:59:35.251789 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:59:35.251797 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:59:35.251801 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:59:35.251895 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 00:59:35.252020 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":92,"threads_started":1}
I20260811 00:59:35.252502 15640 external_mini_cluster.cc:1428] Setting key 7cbfb21bd8678ed6903ad53862a8c751
I20260811 00:59:35.253068 12202 heartbeater.cc:347] Connected to a master server at 127.15.70.62:46131
I20260811 00:59:35.253206 12202 heartbeater.cc:464] Registering TS with master...
I20260811 00:59:35.253532 12202 heartbeater.cc:511] Master 127.15.70.62:46131 requested a full tablet report, sending...
I20260811 00:59:35.253696 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.2:0
--local_ip_for_outbound_sockets=127.15.70.2
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:46131
--builtin_ntp_servers=127.15.70.20:36157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 00:59:35.254153 11925 ts_manager.cc:194] Registered new tserver with Master: 805ce7cdd28f4e27bcb57f846fa47f04 (127.15.70.1:39927)
I20260811 00:59:35.254951 11925 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.70.1:53375
W20260811 00:59:35.349949 12205 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:59:35.350229 12205 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:59:35.350256 12205 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:59:35.351634 12205 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:59:35.351679 12205 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:59:35.351707 12205 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.2
I20260811 00:59:35.353331 12205 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:36157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:46131
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12205
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.2
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:59:35.353644 12205 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:59:35.354029 12205 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:59:35.359890 12214 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:35.359908 12213 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:35.359874 12216 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:35.360142 12205 server_base.cc:1034] running on GCE node
I20260811 00:59:35.360414 12205 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:59:35.360733 12205 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:59:35.361892 12205 hybrid_clock.cc:648] HybridClock initialized: now 1786409975361872 us; error 39 us; skew 500 ppm
I20260811 00:59:35.363446 12205 webserver.cc:460] Webserver started at http://127.15.70.2:40621/ using document root <none> and password file <none>
I20260811 00:59:35.363727 12205 fs_manager.cc:359] Metadata directory not provided
I20260811 00:59:35.363780 12205 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:59:35.363966 12205 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:59:35.365260 12205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-1/data/instance:
uuid: "164745c127a4457db471a8d2489080fe"
format_stamp: "Formatted at 2026-08-11 00:59:35 on dist-test-slave-h3ft"
server_key: "da69395fcaa2604962f5a10ee82120dc"
server_key_iv: "35408b3200755a7ad8c70e01451ed6b8"
server_key_version: "encryptionkey@0"
I20260811 00:59:35.365756 12205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance:
uuid: "164745c127a4457db471a8d2489080fe"
format_stamp: "Formatted at 2026-08-11 00:59:35 on dist-test-slave-h3ft"
server_key: "da69395fcaa2604962f5a10ee82120dc"
server_key_iv: "35408b3200755a7ad8c70e01451ed6b8"
server_key_version: "encryptionkey@0"
I20260811 00:59:35.367376 12205 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.003s
I20260811 00:59:35.368284 12224 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:35.368541 12205 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:59:35.368645 12205 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-1/wal
uuid: "164745c127a4457db471a8d2489080fe"
format_stamp: "Formatted at 2026-08-11 00:59:35 on dist-test-slave-h3ft"
server_key: "da69395fcaa2604962f5a10ee82120dc"
server_key_iv: "35408b3200755a7ad8c70e01451ed6b8"
server_key_version: "encryptionkey@0"
I20260811 00:59:35.368731 12205 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:59:35.395032 12205 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:59:35.395484 12205 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:59:35.395663 12205 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:59:35.395954 12205 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:59:35.396376 12205 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:59:35.396412 12205 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:35.396471 12205 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:59:35.396497 12205 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:35.403671 12205 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.2:45917
I20260811 00:59:35.403756 12400 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.2:45917 every 8 connection(s)
I20260811 00:59:35.404184 12205 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
I20260811 00:59:35.411127 11977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:35.405157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:53697 (local address 127.15.70.62:46131)
0811 00:59:35.405297 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:35.405300 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:35.405530 (+ 230us) server_negotiation.cc:407] Connection header received
0811 00:59:35.406107 (+ 577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:35.406108 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:35.406121 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:35.406206 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:35.407176 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:35.407983 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:35.409277 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:35.409494 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:35.409568 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:35.410749 (+ 1181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:35.410751 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:35.410752 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:59:35.410763 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:35.410784 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:59:35.410788 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:35.410840 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:35.410937 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 00:59:35.410970 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260811 00:59:35.411293 12403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:35.405121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46131 (local address 127.15.70.2:53697)
0811 00:59:35.405366 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:35.405420 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:35.406009 (+ 589us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:35.406331 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:35.406336 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:35.406346 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:59:35.406970 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:35.406976 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:35.408120 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:35.408122 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:35.409156 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:35.409160 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:35.409603 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:35.409604 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:35.409743 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:35.410581 (+ 838us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:59:35.410581 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:59:35.410617 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:59:35.410648 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:59:35.410839 (+ 191us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:59:35.410842 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:59:35.410845 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:59:35.410897 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 00:59:35.410995 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":108,"threads_started":1}
I20260811 00:59:35.411636 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 12205
I20260811 00:59:35.411759 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance
I20260811 00:59:35.411964 12401 heartbeater.cc:347] Connected to a master server at 127.15.70.62:46131
I20260811 00:59:35.412007 15640 external_mini_cluster.cc:1428] Setting key f0431375e0884a6348df8b24c20b0af6
I20260811 00:59:35.412107 12401 heartbeater.cc:464] Registering TS with master...
I20260811 00:59:35.412365 12401 heartbeater.cc:511] Master 127.15.70.62:46131 requested a full tablet report, sending...
I20260811 00:59:35.412803 11925 ts_manager.cc:194] Registered new tserver with Master: 164745c127a4457db471a8d2489080fe (127.15.70.2:45917)
I20260811 00:59:35.413209 11925 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.70.2:53697
I20260811 00:59:35.413312 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.3:0
--local_ip_for_outbound_sockets=127.15.70.3
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:46131
--builtin_ntp_servers=127.15.70.20:36157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 00:59:35.509473 12405 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:59:35.509764 12405 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:59:35.509788 12405 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:59:35.511053 12405 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:59:35.511099 12405 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:59:35.511126 12405 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.3
I20260811 00:59:35.512493 12405 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:36157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:46131
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12405
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.3
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:59:35.512758 12405 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:59:35.513085 12405 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:59:35.519078 12417 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:35.519078 12414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:35.519078 12413 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:35.519428 12405 server_base.cc:1034] running on GCE node
I20260811 00:59:35.519763 12405 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:59:35.520078 12405 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:59:35.521255 12405 hybrid_clock.cc:648] HybridClock initialized: now 1786409975521234 us; error 36 us; skew 500 ppm
I20260811 00:59:35.522722 12405 webserver.cc:460] Webserver started at http://127.15.70.3:38303/ using document root <none> and password file <none>
I20260811 00:59:35.523056 12405 fs_manager.cc:359] Metadata directory not provided
I20260811 00:59:35.523136 12405 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:59:35.523300 12405 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:59:35.524619 12405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-2/data/instance:
uuid: "5fc2224268624617b5c9589ea85430e5"
format_stamp: "Formatted at 2026-08-11 00:59:35 on dist-test-slave-h3ft"
server_key: "65c54373850dd5025b220cf032dc09c0"
server_key_iv: "ff9cc6b485bb1eba672e4a2350fe8c81"
server_key_version: "encryptionkey@0"
I20260811 00:59:35.525056 12405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance:
uuid: "5fc2224268624617b5c9589ea85430e5"
format_stamp: "Formatted at 2026-08-11 00:59:35 on dist-test-slave-h3ft"
server_key: "65c54373850dd5025b220cf032dc09c0"
server_key_iv: "ff9cc6b485bb1eba672e4a2350fe8c81"
server_key_version: "encryptionkey@0"
I20260811 00:59:35.526636 12405 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 00:59:35.527580 12426 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:35.527776 12405 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 00:59:35.527892 12405 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-2/wal
uuid: "5fc2224268624617b5c9589ea85430e5"
format_stamp: "Formatted at 2026-08-11 00:59:35 on dist-test-slave-h3ft"
server_key: "65c54373850dd5025b220cf032dc09c0"
server_key_iv: "ff9cc6b485bb1eba672e4a2350fe8c81"
server_key_version: "encryptionkey@0"
I20260811 00:59:35.527976 12405 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:59:35.546221 12405 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:59:35.546662 12405 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:59:35.546837 12405 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:59:35.547164 12405 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:59:35.547618 12405 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:59:35.547676 12405 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:35.547722 12405 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:59:35.547746 12405 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:35.555090 12405 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.3:33113
I20260811 00:59:35.555171 12591 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.3:33113 every 8 connection(s)
I20260811 00:59:35.555584 12405 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
I20260811 00:59:35.560868 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 12405
I20260811 00:59:35.560956 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance
I20260811 00:59:35.561162 15640 external_mini_cluster.cc:1428] Setting key 4fef6959af27ff28710826da18f623ea
I20260811 00:59:35.561393 11977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:35.556456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:40759 (local address 127.15.70.62:46131)
0811 00:59:35.556525 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:35.556527 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:35.556827 (+ 300us) server_negotiation.cc:407] Connection header received
0811 00:59:35.557369 (+ 542us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:35.557370 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:35.557384 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:35.557457 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:35.558187 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:35.558720 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:35.559826 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:35.560046 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:35.560105 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:35.561058 (+ 953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:35.561059 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:35.561060 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:59:35.561067 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:35.561086 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:59:35.561090 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:35.561151 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:35.561268 (+ 117us) server_negotiation.cc:299] Negotiation successful
0811 00:59:35.561299 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 00:59:35.561645 12594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:35.556435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:46131 (local address 127.15.70.3:40759)
0811 00:59:35.556644 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:35.556693 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:35.557280 (+ 587us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:35.557518 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:35.557521 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:35.557531 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:59:35.558107 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:35.558111 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:35.558803 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:35.558804 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:35.559747 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:35.559751 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:35.560124 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:35.560125 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:35.560243 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:35.560889 (+ 646us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:59:35.560889 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:59:35.560939 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:59:35.560973 (+ 34us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:59:35.561151 (+ 178us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:59:35.561158 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:59:35.561162 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:59:35.561267 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 00:59:35.561380 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":111,"threads_started":1}
I20260811 00:59:35.562084 12592 heartbeater.cc:347] Connected to a master server at 127.15.70.62:46131
I20260811 00:59:35.562197 12592 heartbeater.cc:464] Registering TS with master...
I20260811 00:59:35.562398 12592 heartbeater.cc:511] Master 127.15.70.62:46131 requested a full tablet report, sending...
I20260811 00:59:35.562836 11925 ts_manager.cc:194] Registered new tserver with Master: 5fc2224268624617b5c9589ea85430e5 (127.15.70.3:33113)
I20260811 00:59:35.563293 11925 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.70.3:40759
I20260811 00:59:35.573310 15640 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 00:59:35.578637 11977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:35.575179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36760 (local address 127.15.70.62:46131)
0811 00:59:35.575249 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:35.575251 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:35.575418 (+ 167us) server_negotiation.cc:407] Connection header received
0811 00:59:35.575528 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:35.575529 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:35.575542 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:35.575592 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:35.575780 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:35.576347 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:35.577160 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:35.577379 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:35.577472 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:35.578324 (+ 852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:35.578326 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:35.578327 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:59:35.578333 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:35.578352 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:59:35.578356 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:35.578425 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:35.578488 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 00:59:35.578520 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 00:59:35.580787 11925 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36760:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:59:35.583099 11925 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:59:35.591190 12613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:35.586356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.2:45917 (local address 127.0.0.1:53062)
0811 00:59:35.586526 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:35.586537 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:35.586593 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:35.587300 (+ 707us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:35.587301 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:35.587304 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:59:35.587356 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:35.587357 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:35.588626 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:35.588627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:35.589646 (+ 1019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:35.589648 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:35.590731 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:35.590733 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:35.590842 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:35.590863 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 00:59:35.590956 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 00:59:35.591054 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"mutex_wait_us":3,"thread_start_us":107,"threads_started":1}
I20260811 00:59:35.591477 12609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:35.586047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:33113 (local address 127.0.0.1:49504)
0811 00:59:35.586217 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:35.586232 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:35.586288 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:35.586841 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:35.586845 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:35.586848 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:59:35.586958 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:35.586960 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:35.588500 (+ 1540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:35.588501 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:35.589766 (+ 1265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:35.589769 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:35.590733 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:35.590734 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:35.590842 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:35.590863 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 00:59:35.590956 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 00:59:35.591055 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"mutex_wait_us":12,"thread_start_us":131,"threads_started":1}
I20260811 00:59:35.591511 12620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:35.586800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53062 (local address 127.15.70.2:45917)
0811 00:59:35.587109 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:35.587114 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:35.587125 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:59:35.587171 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:35.587173 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:35.587188 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:35.587428 (+ 240us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:59:35.587491 (+ 63us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:35.588544 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:35.589746 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:35.590581 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:35.590677 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:35.590796 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:35.590983 (+ 187us) server_negotiation.cc:299] Negotiation successful
0811 00:59:35.591407 (+ 424us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":250,"thread_start_us":109,"threads_started":1}
I20260811 00:59:35.591776 12615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:35.586330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49504 (local address 127.15.70.3:33113)
0811 00:59:35.586597 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:35.586603 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:35.586615 (+ 12us) server_negotiation.cc:407] Connection header received
0811 00:59:35.586666 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:35.586668 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:35.586687 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:35.587089 (+ 402us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:59:35.587173 (+ 84us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:35.588403 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:35.589876 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:35.590609 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:35.590678 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:35.590796 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:35.591136 (+ 340us) server_negotiation.cc:299] Negotiation successful
0811 00:59:35.591187 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":124,"threads_started":1}
I20260811 00:59:35.592154 12606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:35.586004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:39927 (local address 127.0.0.1:35734)
0811 00:59:35.586145 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:35.586196 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:35.586288 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:35.587246 (+ 958us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:35.587248 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:35.587251 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:59:35.587312 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:35.587315 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:35.588277 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:35.588279 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:35.589774 (+ 1495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:35.589776 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:35.591838 (+ 2062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:35.591839 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:35.591928 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:35.591933 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 00:59:35.592011 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 00:59:35.592068 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"mutex_wait_us":73,"thread_start_us":87,"threads_started":1}
I20260811 00:59:35.592166 12618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:35.586587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35734 (local address 127.15.70.1:39927)
0811 00:59:35.586956 (+ 369us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:35.586961 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:35.586975 (+ 14us) server_negotiation.cc:407] Connection header received
0811 00:59:35.587067 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:35.587069 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:35.587088 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:35.587250 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:59:35.587413 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:35.588174 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:35.590843 (+ 2669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:35.591747 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:35.591819 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:35.591921 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:35.592024 (+ 103us) server_negotiation.cc:299] Negotiation successful
0811 00:59:35.592071 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":132,"threads_started":1}
I20260811 00:59:35.592427 12302 tablet_service.cc:1467] Processing CreateTablet for tablet f1b4e168e52a4d688a542fcdf39312a4 (DEFAULT_TABLE table=test-table [id=b67ab438c8554a38b95b4bf5a4416c38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:59:35.592568 12496 tablet_service.cc:1467] Processing CreateTablet for tablet f1b4e168e52a4d688a542fcdf39312a4 (DEFAULT_TABLE table=test-table [id=b67ab438c8554a38b95b4bf5a4416c38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:59:35.592940 12496 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1b4e168e52a4d688a542fcdf39312a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:59:35.592947 12302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1b4e168e52a4d688a542fcdf39312a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:59:35.592927 12094 tablet_service.cc:1467] Processing CreateTablet for tablet f1b4e168e52a4d688a542fcdf39312a4 (DEFAULT_TABLE table=test-table [id=b67ab438c8554a38b95b4bf5a4416c38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:59:35.593282 12094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1b4e168e52a4d688a542fcdf39312a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:59:35.596345 12621 tablet_bootstrap.cc:492] T f1b4e168e52a4d688a542fcdf39312a4 P 5fc2224268624617b5c9589ea85430e5: Bootstrap starting.
I20260811 00:59:35.596875 12622 tablet_bootstrap.cc:492] T f1b4e168e52a4d688a542fcdf39312a4 P 164745c127a4457db471a8d2489080fe: Bootstrap starting.
I20260811 00:59:35.597009 12625 tablet_bootstrap.cc:492] T f1b4e168e52a4d688a542fcdf39312a4 P 805ce7cdd28f4e27bcb57f846fa47f04: Bootstrap starting.
I20260811 00:59:35.597358 12621 tablet_bootstrap.cc:654] T f1b4e168e52a4d688a542fcdf39312a4 P 5fc2224268624617b5c9589ea85430e5: Neither blocks nor log segments found. Creating new log.
I20260811 00:59:35.597656 12622 tablet_bootstrap.cc:654] T f1b4e168e52a4d688a542fcdf39312a4 P 164745c127a4457db471a8d2489080fe: Neither blocks nor log segments found. Creating new log.
I20260811 00:59:35.597740 12625 tablet_bootstrap.cc:654] T f1b4e168e52a4d688a542fcdf39312a4 P 805ce7cdd28f4e27bcb57f846fa47f04: Neither blocks nor log segments found. Creating new log.
I20260811 00:59:35.597800 12621 log.cc:824] T f1b4e168e52a4d688a542fcdf39312a4 P 5fc2224268624617b5c9589ea85430e5: Log is configured to *not* fsync() on all Append() calls
I20260811 00:59:35.598028 12622 log.cc:824] T f1b4e168e52a4d688a542fcdf39312a4 P 164745c127a4457db471a8d2489080fe: Log is configured to *not* fsync() on all Append() calls
I20260811 00:59:35.598125 12625 log.cc:824] T f1b4e168e52a4d688a542fcdf39312a4 P 805ce7cdd28f4e27bcb57f846fa47f04: Log is configured to *not* fsync() on all Append() calls
I20260811 00:59:35.598887 12622 tablet_bootstrap.cc:492] T f1b4e168e52a4d688a542fcdf39312a4 P 164745c127a4457db471a8d2489080fe: No bootstrap required, opened a new log
I20260811 00:59:35.598889 12621 tablet_bootstrap.cc:492] T f1b4e168e52a4d688a542fcdf39312a4 P 5fc2224268624617b5c9589ea85430e5: No bootstrap required, opened a new log
I20260811 00:59:35.599028 12622 ts_tablet_manager.cc:1397] T f1b4e168e52a4d688a542fcdf39312a4 P 164745c127a4457db471a8d2489080fe: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 00:59:35.599042 12621 ts_tablet_manager.cc:1397] T f1b4e168e52a4d688a542fcdf39312a4 P 5fc2224268624617b5c9589ea85430e5: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 00:59:35.599117 12625 tablet_bootstrap.cc:492] T f1b4e168e52a4d688a542fcdf39312a4 P 805ce7cdd28f4e27bcb57f846fa47f04: No bootstrap required, opened a new log
I20260811 00:59:35.599208 12625 ts_tablet_manager.cc:1397] T f1b4e168e52a4d688a542fcdf39312a4 P 805ce7cdd28f4e27bcb57f846fa47f04: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 00:59:35.601569 12622 raft_consensus.cc:348] T f1b4e168e52a4d688a542fcdf39312a4 P 164745c127a4457db471a8d2489080fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fc2224268624617b5c9589ea85430e5" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 33113 } } peers { permanent_uuid: "805ce7cdd28f4e27bcb57f846fa47f04" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39927 } } peers { permanent_uuid: "164745c127a4457db471a8d2489080fe" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 45917 } }
I20260811 00:59:35.601768 12622 raft_consensus.cc:374] T f1b4e168e52a4d688a542fcdf39312a4 P 164745c127a4457db471a8d2489080fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:59:35.601816 12622 raft_consensus.cc:729] T f1b4e168e52a4d688a542fcdf39312a4 P 164745c127a4457db471a8d2489080fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164745c127a4457db471a8d2489080fe, State: Initialized, Role: FOLLOWER
I20260811 00:59:35.601958 12622 consensus_queue.cc:260] T f1b4e168e52a4d688a542fcdf39312a4 P 164745c127a4457db471a8d2489080fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fc2224268624617b5c9589ea85430e5" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 33113 } } peers { permanent_uuid: "805ce7cdd28f4e27bcb57f846fa47f04" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39927 } } peers { permanent_uuid: "164745c127a4457db471a8d2489080fe" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 45917 } }
I20260811 00:59:35.602324 12622 ts_tablet_manager.cc:1428] T f1b4e168e52a4d688a542fcdf39312a4 P 164745c127a4457db471a8d2489080fe: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 00:59:35.602299 12625 raft_consensus.cc:348] T f1b4e168e52a4d688a542fcdf39312a4 P 805ce7cdd28f4e27bcb57f846fa47f04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fc2224268624617b5c9589ea85430e5" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 33113 } } peers { permanent_uuid: "805ce7cdd28f4e27bcb57f846fa47f04" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39927 } } peers { permanent_uuid: "164745c127a4457db471a8d2489080fe" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 45917 } }
I20260811 00:59:35.602469 12625 raft_consensus.cc:374] T f1b4e168e52a4d688a542fcdf39312a4 P 805ce7cdd28f4e27bcb57f846fa47f04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:59:35.602487 12401 heartbeater.cc:503] Master 127.15.70.62:46131 was elected leader, sending a full tablet report...
I20260811 00:59:35.602509 12625 raft_consensus.cc:729] T f1b4e168e52a4d688a542fcdf39312a4 P 805ce7cdd28f4e27bcb57f846fa47f04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 805ce7cdd28f4e27bcb57f846fa47f04, State: Initialized, Role: FOLLOWER
I20260811 00:59:35.602664 12625 consensus_queue.cc:260] T f1b4e168e52a4d688a542fcdf39312a4 P 805ce7cdd28f4e27bcb57f846fa47f04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fc2224268624617b5c9589ea85430e5" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 33113 } } peers { permanent_uuid: "805ce7cdd28f4e27bcb57f846fa47f04" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39927 } } peers { permanent_uuid: "164745c127a4457db471a8d2489080fe" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 45917 } }
I20260811 00:59:35.602299 12621 raft_consensus.cc:348] T f1b4e168e52a4d688a542fcdf39312a4 P 5fc2224268624617b5c9589ea85430e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fc2224268624617b5c9589ea85430e5" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 33113 } } peers { permanent_uuid: "805ce7cdd28f4e27bcb57f846fa47f04" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39927 } } peers { permanent_uuid: "164745c127a4457db471a8d2489080fe" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 45917 } }
I20260811 00:59:35.602900 12621 raft_consensus.cc:374] T f1b4e168e52a4d688a542fcdf39312a4 P 5fc2224268624617b5c9589ea85430e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:59:35.602946 12621 raft_consensus.cc:729] T f1b4e168e52a4d688a542fcdf39312a4 P 5fc2224268624617b5c9589ea85430e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fc2224268624617b5c9589ea85430e5, State: Initialized, Role: FOLLOWER
I20260811 00:59:35.602962 12625 ts_tablet_manager.cc:1428] T f1b4e168e52a4d688a542fcdf39312a4 P 805ce7cdd28f4e27bcb57f846fa47f04: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260811 00:59:35.603099 12621 consensus_queue.cc:260] T f1b4e168e52a4d688a542fcdf39312a4 P 5fc2224268624617b5c9589ea85430e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fc2224268624617b5c9589ea85430e5" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 33113 } } peers { permanent_uuid: "805ce7cdd28f4e27bcb57f846fa47f04" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39927 } } peers { permanent_uuid: "164745c127a4457db471a8d2489080fe" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 45917 } }
I20260811 00:59:35.603163 12202 heartbeater.cc:503] Master 127.15.70.62:46131 was elected leader, sending a full tablet report...
I20260811 00:59:35.603425 12621 ts_tablet_manager.cc:1428] T f1b4e168e52a4d688a542fcdf39312a4 P 5fc2224268624617b5c9589ea85430e5: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260811 00:59:35.603754 12592 heartbeater.cc:503] Master 127.15.70.62:46131 was elected leader, sending a full tablet report...
I20260811 00:59:35.623271 12635 raft_consensus.cc:482] T f1b4e168e52a4d688a542fcdf39312a4 P 805ce7cdd28f4e27bcb57f846fa47f04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:59:35.623528 12635 raft_consensus.cc:504] T f1b4e168e52a4d688a542fcdf39312a4 P 805ce7cdd28f4e27bcb57f846fa47f04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fc2224268624617b5c9589ea85430e5" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 33113 } } peers { permanent_uuid: "805ce7cdd28f4e27bcb57f846fa47f04" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39927 } } peers { permanent_uuid: "164745c127a4457db471a8d2489080fe" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 45917 } }
I20260811 00:59:35.624043 12635 leader_election.cc:288] T f1b4e168e52a4d688a542fcdf39312a4 P 805ce7cdd28f4e27bcb57f846fa47f04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5fc2224268624617b5c9589ea85430e5 (127.15.70.3:33113), 164745c127a4457db471a8d2489080fe (127.15.70.2:45917)
I20260811 00:59:35.627527 12615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:35.624411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:32799 (local address 127.15.70.3:33113)
0811 00:59:35.624518 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:35.624520 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:35.624530 (+ 10us) server_negotiation.cc:407] Connection header received
0811 00:59:35.624573 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:35.624574 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:35.624586 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:35.624644 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:59:35.624851 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:35.625454 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:35.626523 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:35.627098 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:35.627173 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:35.627187 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:35.627392 (+ 205us) server_negotiation.cc:299] Negotiation successful
0811 00:59:35.627441 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 00:59:35.627545 12204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:35.624285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:33113 (local address 127.15.70.1:32799)
0811 00:59:35.624354 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:35.624371 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:35.624445 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:35.624647 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:35.624648 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:35.624651 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:59:35.624754 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:35.624757 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:35.625547 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:35.625549 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:35.626414 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:35.626417 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:35.627228 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:35.627229 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:35.627316 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:35.627320 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:59:35.627375 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 00:59:35.627431 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260811 00:59:35.627594 12620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:35.624507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:47847 (local address 127.15.70.2:45917)
0811 00:59:35.624566 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:35.624568 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:35.624744 (+ 176us) server_negotiation.cc:407] Connection header received
0811 00:59:35.624806 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:35.624807 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:35.624825 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:35.624879 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:59:35.625042 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:35.625571 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:35.626553 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:35.627199 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:35.627267 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:35.627279 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:35.627462 (+ 183us) server_negotiation.cc:299] Negotiation successful
0811 00:59:35.627507 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 00:59:35.627875 12642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:35.624404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.2:45917 (local address 127.15.70.1:47847)
0811 00:59:35.624682 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:35.624693 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:35.624755 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:35.624891 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:35.624892 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:35.624893 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:59:35.624975 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:35.624977 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:35.625656 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:35.625656 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:35.626431 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:35.626433 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:35.627282 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:35.627283 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:35.627375 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:35.627378 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:59:35.627452 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 00:59:35.627495 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":194,"threads_started":1}
I20260811 00:59:35.627971 12528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b4e168e52a4d688a542fcdf39312a4" candidate_uuid: "805ce7cdd28f4e27bcb57f846fa47f04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fc2224268624617b5c9589ea85430e5" is_pre_election: true
I20260811 00:59:35.628206 12528 raft_consensus.cc:2454] T f1b4e168e52a4d688a542fcdf39312a4 P 5fc2224268624617b5c9589ea85430e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 805ce7cdd28f4e27bcb57f846fa47f04 in term 0.
I20260811 00:59:35.628274 12331 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b4e168e52a4d688a542fcdf39312a4" candidate_uuid: "805ce7cdd28f4e27bcb57f846fa47f04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164745c127a4457db471a8d2489080fe" is_pre_election: true
I20260811 00:59:35.628470 12331 raft_consensus.cc:2454] T f1b4e168e52a4d688a542fcdf39312a4 P 164745c127a4457db471a8d2489080fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 805ce7cdd28f4e27bcb57f846fa47f04 in term 0.
I20260811 00:59:35.628505 12031 leader_election.cc:302] T f1b4e168e52a4d688a542fcdf39312a4 P 805ce7cdd28f4e27bcb57f846fa47f04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5fc2224268624617b5c9589ea85430e5, 805ce7cdd28f4e27bcb57f846fa47f04; no voters:
I20260811 00:59:35.628644 12635 raft_consensus.cc:2781] T f1b4e168e52a4d688a542fcdf39312a4 P 805ce7cdd28f4e27bcb57f846fa47f04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:59:35.628711 12635 raft_consensus.cc:482] T f1b4e168e52a4d688a542fcdf39312a4 P 805ce7cdd28f4e27bcb57f846fa47f04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:59:35.628742 12635 raft_consensus.cc:3037] T f1b4e168e52a4d688a542fcdf39312a4 P 805ce7cdd28f4e27bcb57f846fa47f04 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:59:35.629638 12635 raft_consensus.cc:504] T f1b4e168e52a4d688a542fcdf39312a4 P 805ce7cdd28f4e27bcb57f846fa47f04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fc2224268624617b5c9589ea85430e5" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 33113 } } peers { permanent_uuid: "805ce7cdd28f4e27bcb57f846fa47f04" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39927 } } peers { permanent_uuid: "164745c127a4457db471a8d2489080fe" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 45917 } }
I20260811 00:59:35.629792 12635 leader_election.cc:288] T f1b4e168e52a4d688a542fcdf39312a4 P 805ce7cdd28f4e27bcb57f846fa47f04 [CANDIDATE]: Term 1 election: Requested vote from peers 5fc2224268624617b5c9589ea85430e5 (127.15.70.3:33113), 164745c127a4457db471a8d2489080fe (127.15.70.2:45917)
I20260811 00:59:35.630110 12528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b4e168e52a4d688a542fcdf39312a4" candidate_uuid: "805ce7cdd28f4e27bcb57f846fa47f04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fc2224268624617b5c9589ea85430e5"
I20260811 00:59:35.630121 12331 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1b4e168e52a4d688a542fcdf39312a4" candidate_uuid: "805ce7cdd28f4e27bcb57f846fa47f04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164745c127a4457db471a8d2489080fe"
I20260811 00:59:35.630229 12528 raft_consensus.cc:3037] T f1b4e168e52a4d688a542fcdf39312a4 P 5fc2224268624617b5c9589ea85430e5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:59:35.630229 12331 raft_consensus.cc:3037] T f1b4e168e52a4d688a542fcdf39312a4 P 164745c127a4457db471a8d2489080fe [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:59:35.631493 12528 raft_consensus.cc:2454] T f1b4e168e52a4d688a542fcdf39312a4 P 5fc2224268624617b5c9589ea85430e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 805ce7cdd28f4e27bcb57f846fa47f04 in term 1.
I20260811 00:59:35.631493 12331 raft_consensus.cc:2454] T f1b4e168e52a4d688a542fcdf39312a4 P 164745c127a4457db471a8d2489080fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 805ce7cdd28f4e27bcb57f846fa47f04 in term 1.
I20260811 00:59:35.631780 12031 leader_election.cc:302] T f1b4e168e52a4d688a542fcdf39312a4 P 805ce7cdd28f4e27bcb57f846fa47f04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164745c127a4457db471a8d2489080fe, 805ce7cdd28f4e27bcb57f846fa47f04; no voters:
I20260811 00:59:35.631999 12635 raft_consensus.cc:2781] T f1b4e168e52a4d688a542fcdf39312a4 P 805ce7cdd28f4e27bcb57f846fa47f04 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:59:35.632283 12635 raft_consensus.cc:686] T f1b4e168e52a4d688a542fcdf39312a4 P 805ce7cdd28f4e27bcb57f846fa47f04 [term 1 LEADER]: Becoming Leader. State: Replica: 805ce7cdd28f4e27bcb57f846fa47f04, State: Running, Role: LEADER
I20260811 00:59:35.632418 12635 consensus_queue.cc:237] T f1b4e168e52a4d688a542fcdf39312a4 P 805ce7cdd28f4e27bcb57f846fa47f04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fc2224268624617b5c9589ea85430e5" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 33113 } } peers { permanent_uuid: "805ce7cdd28f4e27bcb57f846fa47f04" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39927 } } peers { permanent_uuid: "164745c127a4457db471a8d2489080fe" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 45917 } }
I20260811 00:59:35.633644 11924 catalog_manager.cc:5495] T f1b4e168e52a4d688a542fcdf39312a4 P 805ce7cdd28f4e27bcb57f846fa47f04 reported cstate change: term changed from 0 to 1, leader changed from <none> to 805ce7cdd28f4e27bcb57f846fa47f04 (127.15.70.1). New cstate: current_term: 1 leader_uuid: "805ce7cdd28f4e27bcb57f846fa47f04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fc2224268624617b5c9589ea85430e5" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 33113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "805ce7cdd28f4e27bcb57f846fa47f04" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164745c127a4457db471a8d2489080fe" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 45917 } health_report { overall_health: UNKNOWN } } }
I20260811 00:59:35.641785 12618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:35.639287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35750 (local address 127.15.70.1:39927)
0811 00:59:35.639339 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:35.639341 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:35.639350 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:59:35.639402 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:35.639403 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:35.639428 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:35.639500 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:59:35.639641 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:35.640188 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:35.641018 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:35.641220 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:35.641288 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:35.641434 (+ 146us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:59:35.641567 (+ 133us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:59:35.641642 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:35.641659 (+ 17us) server_negotiation.cc:299] Negotiation successful
0811 00:59:35.641683 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 00:59:35.644343 12528 raft_consensus.cc:1261] T f1b4e168e52a4d688a542fcdf39312a4 P 5fc2224268624617b5c9589ea85430e5 [term 1 FOLLOWER]: Refusing update from remote peer 805ce7cdd28f4e27bcb57f846fa47f04: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:59:35.644344 12331 raft_consensus.cc:1261] T f1b4e168e52a4d688a542fcdf39312a4 P 164745c127a4457db471a8d2489080fe [term 1 FOLLOWER]: Refusing update from remote peer 805ce7cdd28f4e27bcb57f846fa47f04: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:59:35.644822 12635 consensus_queue.cc:1035] T f1b4e168e52a4d688a542fcdf39312a4 P 805ce7cdd28f4e27bcb57f846fa47f04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164745c127a4457db471a8d2489080fe" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 45917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:59:35.645025 12643 consensus_queue.cc:1035] T f1b4e168e52a4d688a542fcdf39312a4 P 805ce7cdd28f4e27bcb57f846fa47f04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fc2224268624617b5c9589ea85430e5" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 33113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:59:35.648857 12653 mvcc.cc:205] Tried to move back new op lower bound from 7317135260235280384 to 7317135260191350784. Current Snapshot: MvccSnapshot[applied={T|T < 7317135260235280384}]
I20260811 00:59:35.649421 12652 mvcc.cc:205] Tried to move back new op lower bound from 7317135260235280384 to 7317135260191350784. Current Snapshot: MvccSnapshot[applied={T|T < 7317135260235280384}]
I20260811 00:59:35.652463 11923 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36760:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:59:35.652612 11923 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36760:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:59:35.653883 11923 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f4cd13f813fb4618a498e7498ef87a33: Sending DeleteTablet for 3 replicas of tablet f1b4e168e52a4d688a542fcdf39312a4
I20260811 00:59:35.654495 12496 tablet_service.cc:1514] Processing DeleteTablet for tablet f1b4e168e52a4d688a542fcdf39312a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:59:35 UTC) from {username='slave'} at 127.0.0.1:49504
I20260811 00:59:35.654502 12302 tablet_service.cc:1514] Processing DeleteTablet for tablet f1b4e168e52a4d688a542fcdf39312a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:59:35 UTC) from {username='slave'} at 127.0.0.1:53062
I20260811 00:59:35.654863 12666 tablet_replica.cc:330] T f1b4e168e52a4d688a542fcdf39312a4 P 164745c127a4457db471a8d2489080fe: stopping tablet replica
I20260811 00:59:35.655066 12094 tablet_service.cc:1514] Processing DeleteTablet for tablet f1b4e168e52a4d688a542fcdf39312a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:59:35 UTC) from {username='slave'} at 127.0.0.1:35734
I20260811 00:59:35.655355 12668 tablet_replica.cc:330] T f1b4e168e52a4d688a542fcdf39312a4 P 805ce7cdd28f4e27bcb57f846fa47f04: stopping tablet replica
I20260811 00:59:35.655491 12668 raft_consensus.cc:2229] T f1b4e168e52a4d688a542fcdf39312a4 P 805ce7cdd28f4e27bcb57f846fa47f04 [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:59:35.655561 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 12011
I20260811 00:59:35.655664 12668 raft_consensus.cc:2258] T f1b4e168e52a4d688a542fcdf39312a4 P 805ce7cdd28f4e27bcb57f846fa47f04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:59:35.671276 12666 raft_consensus.cc:2229] T f1b4e168e52a4d688a542fcdf39312a4 P 164745c127a4457db471a8d2489080fe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:59:35.671568 12666 raft_consensus.cc:2258] T f1b4e168e52a4d688a542fcdf39312a4 P 164745c127a4457db471a8d2489080fe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:59:35.671849 12667 tablet_replica.cc:330] T f1b4e168e52a4d688a542fcdf39312a4 P 5fc2224268624617b5c9589ea85430e5: stopping tablet replica
I20260811 00:59:35.672029 12667 raft_consensus.cc:2229] T f1b4e168e52a4d688a542fcdf39312a4 P 5fc2224268624617b5c9589ea85430e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:59:35.672138 12667 raft_consensus.cc:2258] T f1b4e168e52a4d688a542fcdf39312a4 P 5fc2224268624617b5c9589ea85430e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:59:35.673050 12666 ts_tablet_manager.cc:1905] T f1b4e168e52a4d688a542fcdf39312a4 P 164745c127a4457db471a8d2489080fe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:59:35.673071 12667 ts_tablet_manager.cc:1905] T f1b4e168e52a4d688a542fcdf39312a4 P 5fc2224268624617b5c9589ea85430e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:59:35.675127 12667 ts_tablet_manager.cc:1918] T f1b4e168e52a4d688a542fcdf39312a4 P 5fc2224268624617b5c9589ea85430e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:59:35.675251 12667 log.cc:1196] T f1b4e168e52a4d688a542fcdf39312a4 P 5fc2224268624617b5c9589ea85430e5: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-2/wal/wals/f1b4e168e52a4d688a542fcdf39312a4
I20260811 00:59:35.675551 12666 ts_tablet_manager.cc:1918] T f1b4e168e52a4d688a542fcdf39312a4 P 164745c127a4457db471a8d2489080fe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:59:35.675593 12667 ts_tablet_manager.cc:1939] T f1b4e168e52a4d688a542fcdf39312a4 P 5fc2224268624617b5c9589ea85430e5: Deleting consensus metadata
I20260811 00:59:35.675644 12666 log.cc:1196] T f1b4e168e52a4d688a542fcdf39312a4 P 164745c127a4457db471a8d2489080fe: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409704606556-15640-0/minicluster-data/ts-1/wal/wals/f1b4e168e52a4d688a542fcdf39312a4
I20260811 00:59:35.675918 12666 ts_tablet_manager.cc:1939] T f1b4e168e52a4d688a542fcdf39312a4 P 164745c127a4457db471a8d2489080fe: Deleting consensus metadata
I20260811 00:59:35.676220 11899 catalog_manager.cc:4841] TS 5fc2224268624617b5c9589ea85430e5 (127.15.70.3:33113): tablet f1b4e168e52a4d688a542fcdf39312a4 (table test-table [id=b67ab438c8554a38b95b4bf5a4416c38]) successfully deleted
I20260811 00:59:35.676424 11899 catalog_manager.cc:4841] TS 164745c127a4457db471a8d2489080fe (127.15.70.2:45917): tablet f1b4e168e52a4d688a542fcdf39312a4 (table test-table [id=b67ab438c8554a38b95b4bf5a4416c38]) successfully deleted
W20260811 00:59:35.679811 11901 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.70.1:39927 (error 108)
I20260811 00:59:35.680033 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 12205
I20260811 00:59:35.702484 12606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:35.702190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:39927 (local address 127.0.0.1:35756)
0811 00:59:35.702297 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:35.702400 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.1:39927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
W20260811 00:59:35.702745 11901 catalog_manager.cc:4584] TS 805ce7cdd28f4e27bcb57f846fa47f04 (127.15.70.1:39927): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f1b4e168e52a4d688a542fcdf39312a4: Network error: Client connection negotiation failed: client connection to 127.15.70.1:39927: connect: Connection refused (error 111)
I20260811 00:59:35.708379 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 12405
I20260811 00:59:35.731691 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 11873
2026-08-11T00:59:35Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (878 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:59:35 dist-test-slave-h3ft krb5kdc[12676](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:59:35 dist-test-slave-h3ft krb5kdc[12676](info): set up 2 sockets
Aug 11 00:59:35 dist-test-slave-h3ft krb5kdc[12676](info): commencing operation
krb5kdc: starting...
W20260811 00:59:37.085594 15640 mini_kdc.cc:121] Time spent starting KDC: real 1.321s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Aug 11 00:59:37 dist-test-slave-h3ft krb5kdc[12676](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409977, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:59:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:59:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.70.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
I20260811 00:59:37.230149 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:35895
--webserver_interface=127.15.70.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:46239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:35895
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:59:37.326144 12692 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:59:37.326463 12692 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:59:37.326516 12692 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:59:37.327960 12692 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:59:37.328045 12692 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:59:37.328073 12692 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:59:37.328105 12692 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:59:37.328140 12692 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:59:37.329849 12692 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:46239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:35895
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:35895
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12692
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:59:37.330192 12692 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:59:37.330487 12692 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:59:37.336280 12707 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:37.336295 12701 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:37.336295 12703 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:37.336575 12692 server_base.cc:1034] running on GCE node
I20260811 00:59:37.336880 12692 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:59:37.337230 12692 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:59:37.338403 12692 hybrid_clock.cc:648] HybridClock initialized: now 1786409977338384 us; error 46 us; skew 500 ppm
Aug 11 00:59:37 dist-test-slave-h3ft krb5kdc[12676](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409977, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:59:37.341389 12692 init.cc:377] Logged in from keytab as kudu/127.15.70.62@KRBTEST.COM (short username kudu)
I20260811 00:59:37.341925 12692 webserver.cc:460] Webserver started at http://127.15.70.62:40241/ using document root <none> and password file <none>
I20260811 00:59:37.342227 12692 fs_manager.cc:359] Metadata directory not provided
I20260811 00:59:37.342278 12692 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:59:37.342523 12692 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:59:37.343937 12692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "b25b18569f6e4236a8719129a051a432"
format_stamp: "Formatted at 2026-08-11 00:59:37 on dist-test-slave-h3ft"
server_key: "89a6a981cc604aa25fcd3c54a6f6d54f"
server_key_iv: "1acad925e49c462a93462277448bacd2"
server_key_version: "encryptionkey@0"
I20260811 00:59:37.344385 12692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "b25b18569f6e4236a8719129a051a432"
format_stamp: "Formatted at 2026-08-11 00:59:37 on dist-test-slave-h3ft"
server_key: "89a6a981cc604aa25fcd3c54a6f6d54f"
server_key_iv: "1acad925e49c462a93462277448bacd2"
server_key_version: "encryptionkey@0"
I20260811 00:59:37.345950 12692 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 00:59:37.346839 12719 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:37.347088 12692 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:59:37.347185 12692 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "b25b18569f6e4236a8719129a051a432"
format_stamp: "Formatted at 2026-08-11 00:59:37 on dist-test-slave-h3ft"
server_key: "89a6a981cc604aa25fcd3c54a6f6d54f"
server_key_iv: "1acad925e49c462a93462277448bacd2"
server_key_version: "encryptionkey@0"
I20260811 00:59:37.347247 12692 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:59:37.359551 12692 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:59:37.362175 12692 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:59:37.362316 12692 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:59:37.367409 12692 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:35895
I20260811 00:59:37.367450 12792 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:35895 every 8 connection(s)
I20260811 00:59:37.367888 12692 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:59:37.369032 12795 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:59:37.372153 12795 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b25b18569f6e4236a8719129a051a432: Bootstrap starting.
I20260811 00:59:37.372987 12795 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b25b18569f6e4236a8719129a051a432: Neither blocks nor log segments found. Creating new log.
I20260811 00:59:37.373353 12795 log.cc:824] T 00000000000000000000000000000000 P b25b18569f6e4236a8719129a051a432: Log is configured to *not* fsync() on all Append() calls
I20260811 00:59:37.374179 12795 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b25b18569f6e4236a8719129a051a432: No bootstrap required, opened a new log
I20260811 00:59:37.376094 12795 raft_consensus.cc:348] T 00000000000000000000000000000000 P b25b18569f6e4236a8719129a051a432 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b25b18569f6e4236a8719129a051a432" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 35895 } }
I20260811 00:59:37.376261 12795 raft_consensus.cc:374] T 00000000000000000000000000000000 P b25b18569f6e4236a8719129a051a432 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:59:37.376286 12795 raft_consensus.cc:729] T 00000000000000000000000000000000 P b25b18569f6e4236a8719129a051a432 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25b18569f6e4236a8719129a051a432, State: Initialized, Role: FOLLOWER
I20260811 00:59:37.376489 12795 consensus_queue.cc:260] T 00000000000000000000000000000000 P b25b18569f6e4236a8719129a051a432 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b25b18569f6e4236a8719129a051a432" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 35895 } }
I20260811 00:59:37.376578 12795 raft_consensus.cc:388] T 00000000000000000000000000000000 P b25b18569f6e4236a8719129a051a432 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:59:37.376628 12795 raft_consensus.cc:482] T 00000000000000000000000000000000 P b25b18569f6e4236a8719129a051a432 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:59:37.376684 12795 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b25b18569f6e4236a8719129a051a432 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:59:37.377039 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 12692
I20260811 00:59:37.377175 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 00:59:37.377405 15640 external_mini_cluster.cc:1428] Setting key a38c83abe64a608875e7167e8cdcff65
I20260811 00:59:37.377452 12795 raft_consensus.cc:504] T 00000000000000000000000000000000 P b25b18569f6e4236a8719129a051a432 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b25b18569f6e4236a8719129a051a432" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 35895 } }
I20260811 00:59:37.377574 12795 leader_election.cc:302] T 00000000000000000000000000000000 P b25b18569f6e4236a8719129a051a432 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b25b18569f6e4236a8719129a051a432; no voters:
I20260811 00:59:37.377782 12795 leader_election.cc:288] T 00000000000000000000000000000000 P b25b18569f6e4236a8719129a051a432 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:59:37.377812 12798 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b25b18569f6e4236a8719129a051a432 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:59:37.377961 12798 raft_consensus.cc:686] T 00000000000000000000000000000000 P b25b18569f6e4236a8719129a051a432 [term 1 LEADER]: Becoming Leader. State: Replica: b25b18569f6e4236a8719129a051a432, State: Running, Role: LEADER
I20260811 00:59:37.378121 12798 consensus_queue.cc:237] T 00000000000000000000000000000000 P b25b18569f6e4236a8719129a051a432 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b25b18569f6e4236a8719129a051a432" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 35895 } }
I20260811 00:59:37.378578 12800 sys_catalog.cc:455] T 00000000000000000000000000000000 P b25b18569f6e4236a8719129a051a432 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b25b18569f6e4236a8719129a051a432" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b25b18569f6e4236a8719129a051a432" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 35895 } } }
I20260811 00:59:37.378679 12800 sys_catalog.cc:458] T 00000000000000000000000000000000 P b25b18569f6e4236a8719129a051a432 [sys.catalog]: This master's current role is: LEADER
I20260811 00:59:37.378729 12802 sys_catalog.cc:455] T 00000000000000000000000000000000 P b25b18569f6e4236a8719129a051a432 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b25b18569f6e4236a8719129a051a432. Latest consensus state: current_term: 1 leader_uuid: "b25b18569f6e4236a8719129a051a432" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b25b18569f6e4236a8719129a051a432" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 35895 } } }
I20260811 00:59:37.378113 12795 sys_catalog.cc:564] T 00000000000000000000000000000000 P b25b18569f6e4236a8719129a051a432 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:59:37.378835 12802 sys_catalog.cc:458] T 00000000000000000000000000000000 P b25b18569f6e4236a8719129a051a432 [sys.catalog]: This master's current role is: LEADER
I20260811 00:59:37.378970 12809 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:59:37.379659 12809 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:59:37.382416 12809 catalog_manager.cc:1347] Generated new cluster ID: 7e1946dfcab747dc851bc5df1c777855
I20260811 00:59:37.382485 12809 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 00:59:37 dist-test-slave-h3ft krb5kdc[12676](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409977, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:59:37.390712 12804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:37.378097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36368 (local address 127.15.70.62:35895)
0811 00:59:37.378924 (+ 827us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:37.378936 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:37.378974 (+ 38us) server_negotiation.cc:407] Connection header received
0811 00:59:37.379147 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:37.379157 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:37.379242 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:37.379427 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:37.380346 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:37.381848 (+ 1502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:37.382948 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:37.383494 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:37.383643 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:37.386437 (+ 2794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:37.386441 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:37.386442 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:59:37.386462 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:37.388973 (+ 2511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:37.389400 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:37.389403 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:37.389404 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:37.389522 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:37.389752 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:37.389754 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:37.389754 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:37.390047 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:37.390247 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:37.390320 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 00:59:37.390482 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":765,"thread_start_us":78,"threads_started":1}
I20260811 00:59:37.415624 12809 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:59:37.416318 12809 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:59:37.419585 12809 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b25b18569f6e4236a8719129a051a432: Generated new TSK 0
I20260811 00:59:37.419831 12809 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.70.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab.
Entry for principal kudu/127.15.70.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab.
I20260811 00:59:37.459641 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.1:0
--local_ip_for_outbound_sockets=127.15.70.1
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:35895
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:46239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:59:37.569710 12835 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:59:37.569978 12835 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:59:37.570008 12835 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:59:37.571235 12835 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:59:37.571275 12835 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:59:37.571303 12835 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.1
I20260811 00:59:37.572871 12835 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:46239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:35895
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12835
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.1
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:59:37.573117 12835 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:59:37.573365 12835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:59:37.579284 12847 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:37.579373 12843 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:37.579272 12842 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:37.579392 12835 server_base.cc:1034] running on GCE node
I20260811 00:59:37.579710 12835 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:59:37.580013 12835 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:59:37.581255 12835 hybrid_clock.cc:648] HybridClock initialized: now 1786409977581232 us; error 41 us; skew 500 ppm
Aug 11 00:59:37 dist-test-slave-h3ft krb5kdc[12676](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409977, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:59:37.587601 12835 init.cc:377] Logged in from keytab as kudu/127.15.70.1@KRBTEST.COM (short username kudu)
I20260811 00:59:37.588201 12835 webserver.cc:460] Webserver started at http://127.15.70.1:38415/ using document root <none> and password file <none>
I20260811 00:59:37.588471 12835 fs_manager.cc:359] Metadata directory not provided
I20260811 00:59:37.588518 12835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:59:37.588629 12835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:59:37.589841 12835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-0/data/instance:
uuid: "f2e8435cf4f34449b7d24400bc36cea5"
format_stamp: "Formatted at 2026-08-11 00:59:37 on dist-test-slave-h3ft"
server_key: "4a1ba17741bf79debc7afcc1bd9a140b"
server_key_iv: "deffb6898499d5c024d24930074657eb"
server_key_version: "encryptionkey@0"
I20260811 00:59:37.590214 12835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance:
uuid: "f2e8435cf4f34449b7d24400bc36cea5"
format_stamp: "Formatted at 2026-08-11 00:59:37 on dist-test-slave-h3ft"
server_key: "4a1ba17741bf79debc7afcc1bd9a140b"
server_key_iv: "deffb6898499d5c024d24930074657eb"
server_key_version: "encryptionkey@0"
I20260811 00:59:37.591928 12835 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 00:59:37.592988 12858 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:37.593255 12835 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:59:37.593389 12835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-0/wal
uuid: "f2e8435cf4f34449b7d24400bc36cea5"
format_stamp: "Formatted at 2026-08-11 00:59:37 on dist-test-slave-h3ft"
server_key: "4a1ba17741bf79debc7afcc1bd9a140b"
server_key_iv: "deffb6898499d5c024d24930074657eb"
server_key_version: "encryptionkey@0"
I20260811 00:59:37.593497 12835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:59:37.601739 12835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:59:37.604483 12835 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:59:37.604635 12835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:59:37.604872 12835 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:59:37.605285 12835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:59:37.605325 12835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:37.605353 12835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:59:37.605366 12835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:37.612778 12835 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.1:43317
I20260811 00:59:37.612864 13027 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.1:43317 every 8 connection(s)
I20260811 00:59:37.613338 12835 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
I20260811 00:59:37.618623 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 12835
I20260811 00:59:37.618778 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance
I20260811 00:59:37.619084 15640 external_mini_cluster.cc:1428] Setting key 60318b5d6b9553f49650d6eb97b03e21
Aug 11 00:59:37 dist-test-slave-h3ft krb5kdc[12676](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409977, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:59:37.625753 12804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:37.614343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:42563 (local address 127.15.70.62:35895)
0811 00:59:37.614437 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:37.614440 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:37.614734 (+ 294us) server_negotiation.cc:407] Connection header received
0811 00:59:37.615519 (+ 785us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:37.615521 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:37.615544 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:37.615617 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:37.616834 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:37.617427 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:37.618752 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:37.619144 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:37.619234 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:37.622227 (+ 2993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:37.622229 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:37.622229 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:59:37.622241 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:37.623990 (+ 1749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:37.624514 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:37.624515 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:37.624516 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:37.624599 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:37.624901 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:37.624902 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:37.624903 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:37.625049 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:37.625130 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:37.625506 (+ 376us) server_negotiation.cc:299] Negotiation successful
0811 00:59:37.625642 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 00:59:37.626051 13032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:37.614308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35895 (local address 127.15.70.1:42563)
0811 00:59:37.614575 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:37.614621 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:37.615387 (+ 766us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:37.615715 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:37.615720 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:37.616454 (+ 734us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:59:37.616702 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:37.616707 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:37.617555 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:37.617556 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:37.618602 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:37.618607 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:37.619242 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:37.619243 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:37.619416 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:37.620129 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:59:37.620139 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:59:37.622110 (+ 1971us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:59:37.624103 (+ 1993us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:59:37.624115 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:59:37.624119 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:59:37.624423 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:59:37.624683 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:59:37.624684 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:59:37.624684 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:59:37.624824 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:59:37.625130 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:59:37.625139 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:59:37.625354 (+ 215us) client_negotiation.cc:769] Sending connection context
0811 00:59:37.625482 (+ 128us) client_negotiation.cc:240] Negotiation successful
0811 00:59:37.625694 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":119,"threads_started":1}
I20260811 00:59:37.626734 13028 heartbeater.cc:347] Connected to a master server at 127.15.70.62:35895
I20260811 00:59:37.626868 13028 heartbeater.cc:464] Registering TS with master...
I20260811 00:59:37.627168 13028 heartbeater.cc:511] Master 127.15.70.62:35895 requested a full tablet report, sending...
I20260811 00:59:37.627904 12743 ts_manager.cc:194] Registered new tserver with Master: f2e8435cf4f34449b7d24400bc36cea5 (127.15.70.1:43317)
I20260811 00:59:37.628644 12743 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.1@KRBTEST.COM'} at 127.15.70.1:42563
WARNING: no policy specified for kudu/127.15.70.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab.
Entry for principal kudu/127.15.70.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab.
I20260811 00:59:37.655826 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.2:0
--local_ip_for_outbound_sockets=127.15.70.2
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:35895
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:46239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:59:37.755390 13035 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:59:37.755671 13035 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:59:37.755699 13035 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:59:37.756910 13035 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:59:37.756949 13035 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:59:37.756976 13035 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.2
I20260811 00:59:37.758634 13035 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:46239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:35895
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13035
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.2
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:59:37.758968 13035 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:59:37.759371 13035 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:59:37.765511 13044 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:37.765515 13042 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:37.765666 13035 server_base.cc:1034] running on GCE node
W20260811 00:59:37.765511 13047 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:37.766033 13035 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:59:37.766367 13035 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:59:37.767544 13035 hybrid_clock.cc:648] HybridClock initialized: now 1786409977767530 us; error 52 us; skew 500 ppm
Aug 11 00:59:37 dist-test-slave-h3ft krb5kdc[12676](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409977, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:59:37.770649 13035 init.cc:377] Logged in from keytab as kudu/127.15.70.2@KRBTEST.COM (short username kudu)
I20260811 00:59:37.771306 13035 webserver.cc:460] Webserver started at http://127.15.70.2:37423/ using document root <none> and password file <none>
I20260811 00:59:37.771584 13035 fs_manager.cc:359] Metadata directory not provided
I20260811 00:59:37.771667 13035 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:59:37.771836 13035 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:59:37.773100 13035 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-1/data/instance:
uuid: "4ae53d217a834b0ba2ff4ebe280cd814"
format_stamp: "Formatted at 2026-08-11 00:59:37 on dist-test-slave-h3ft"
server_key: "47f6e7ab68fbc20bd2770f06e2f00ae6"
server_key_iv: "3c9db43823813380c2465e538095c46b"
server_key_version: "encryptionkey@0"
I20260811 00:59:37.773524 13035 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance:
uuid: "4ae53d217a834b0ba2ff4ebe280cd814"
format_stamp: "Formatted at 2026-08-11 00:59:37 on dist-test-slave-h3ft"
server_key: "47f6e7ab68fbc20bd2770f06e2f00ae6"
server_key_iv: "3c9db43823813380c2465e538095c46b"
server_key_version: "encryptionkey@0"
I20260811 00:59:37.775094 13035 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260811 00:59:37.776087 13057 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:37.776326 13035 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:59:37.776458 13035 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-1/wal
uuid: "4ae53d217a834b0ba2ff4ebe280cd814"
format_stamp: "Formatted at 2026-08-11 00:59:37 on dist-test-slave-h3ft"
server_key: "47f6e7ab68fbc20bd2770f06e2f00ae6"
server_key_iv: "3c9db43823813380c2465e538095c46b"
server_key_version: "encryptionkey@0"
I20260811 00:59:37.776541 13035 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:59:37.784368 13035 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:59:37.786818 13035 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:59:37.787076 13035 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:59:37.787434 13035 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:59:37.787824 13035 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:59:37.787882 13035 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:37.787931 13035 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:59:37.787966 13035 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:37.795606 13035 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.2:35535
I20260811 00:59:37.795663 13244 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.2:35535 every 8 connection(s)
I20260811 00:59:37.796075 13035 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
Aug 11 00:59:37 dist-test-slave-h3ft krb5kdc[12676](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409977, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:59:37.804396 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 13035
I20260811 00:59:37.804569 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance
I20260811 00:59:37.804841 15640 external_mini_cluster.cc:1428] Setting key 6ddccd8142d1e821f85d252cc8da20cc
I20260811 00:59:37.808751 12804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:37.796999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:35579 (local address 127.15.70.62:35895)
0811 00:59:37.797109 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:37.797111 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:37.797405 (+ 294us) server_negotiation.cc:407] Connection header received
0811 00:59:37.798077 (+ 672us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:37.798079 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:37.798097 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:37.798173 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:37.799447 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:37.800046 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:37.801285 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:37.801521 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:37.801600 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:37.804598 (+ 2998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:37.804600 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:37.804601 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:59:37.804627 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:37.806766 (+ 2139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:37.807367 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:37.807368 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:37.807369 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:37.807454 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:37.807796 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:37.807797 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:37.807798 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:37.807992 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:37.808072 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:37.808422 (+ 350us) server_negotiation.cc:299] Negotiation successful
0811 00:59:37.808581 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 00:59:37.808974 13250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:37.796981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35895 (local address 127.15.70.2:35579)
0811 00:59:37.797230 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:37.797278 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:37.797910 (+ 632us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:37.798278 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:37.798282 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:37.799039 (+ 757us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:59:37.799332 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:37.799337 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:37.800155 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:37.800156 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:37.801153 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:37.801156 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:37.801617 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:37.801618 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:37.801739 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:37.802503 (+ 764us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:59:37.802514 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:59:37.804392 (+ 1878us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:59:37.806878 (+ 2486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:59:37.806890 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:59:37.806893 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:59:37.807282 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:59:37.807566 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:59:37.807567 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:59:37.807567 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:59:37.807714 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:59:37.808069 (+ 355us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:59:37.808076 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:59:37.808257 (+ 181us) client_negotiation.cc:769] Sending connection context
0811 00:59:37.808352 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 00:59:37.808622 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":117,"threads_started":1}
I20260811 00:59:37.809674 13245 heartbeater.cc:347] Connected to a master server at 127.15.70.62:35895
I20260811 00:59:37.809819 13245 heartbeater.cc:464] Registering TS with master...
I20260811 00:59:37.810066 13245 heartbeater.cc:511] Master 127.15.70.62:35895 requested a full tablet report, sending...
I20260811 00:59:37.810611 12743 ts_manager.cc:194] Registered new tserver with Master: 4ae53d217a834b0ba2ff4ebe280cd814 (127.15.70.2:35535)
I20260811 00:59:37.811165 12743 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.2@KRBTEST.COM'} at 127.15.70.2:35579
WARNING: no policy specified for kudu/127.15.70.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab.
Entry for principal kudu/127.15.70.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab.
I20260811 00:59:37.843060 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.3:0
--local_ip_for_outbound_sockets=127.15.70.3
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:35895
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:46239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:59:37.945377 13255 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:59:37.945736 13255 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:59:37.945765 13255 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:59:37.947069 13255 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:59:37.947122 13255 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:59:37.947151 13255 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.3
I20260811 00:59:37.948719 13255 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:46239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:35895
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13255
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.3
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:59:37.948971 13255 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:59:37.949210 13255 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:59:37.955425 13267 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:37.955433 13272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:37.955753 13255 server_base.cc:1034] running on GCE node
W20260811 00:59:37.955433 13266 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:37.956080 13255 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:59:37.956377 13255 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:59:37.957540 13255 hybrid_clock.cc:648] HybridClock initialized: now 1786409977957530 us; error 36 us; skew 500 ppm
Aug 11 00:59:37 dist-test-slave-h3ft krb5kdc[12676](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409977, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:59:37.960745 13255 init.cc:377] Logged in from keytab as kudu/127.15.70.3@KRBTEST.COM (short username kudu)
I20260811 00:59:37.961313 13255 webserver.cc:460] Webserver started at http://127.15.70.3:36915/ using document root <none> and password file <none>
I20260811 00:59:37.961591 13255 fs_manager.cc:359] Metadata directory not provided
I20260811 00:59:37.961664 13255 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:59:37.961833 13255 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:59:37.963145 13255 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-2/data/instance:
uuid: "fa1f496a3cbf449c938d0868a763c7e7"
format_stamp: "Formatted at 2026-08-11 00:59:37 on dist-test-slave-h3ft"
server_key: "36e07101edfc0abaa2ae188aae9ab3c3"
server_key_iv: "6191a6bedd71c647b60054d30e9dbc1b"
server_key_version: "encryptionkey@0"
I20260811 00:59:37.963572 13255 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance:
uuid: "fa1f496a3cbf449c938d0868a763c7e7"
format_stamp: "Formatted at 2026-08-11 00:59:37 on dist-test-slave-h3ft"
server_key: "36e07101edfc0abaa2ae188aae9ab3c3"
server_key_iv: "6191a6bedd71c647b60054d30e9dbc1b"
server_key_version: "encryptionkey@0"
I20260811 00:59:37.965190 13255 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 00:59:37.966144 13282 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:37.966368 13255 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 00:59:37.966503 13255 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-2/wal
uuid: "fa1f496a3cbf449c938d0868a763c7e7"
format_stamp: "Formatted at 2026-08-11 00:59:37 on dist-test-slave-h3ft"
server_key: "36e07101edfc0abaa2ae188aae9ab3c3"
server_key_iv: "6191a6bedd71c647b60054d30e9dbc1b"
server_key_version: "encryptionkey@0"
I20260811 00:59:37.966590 13255 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:59:37.984503 13255 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:59:37.987123 13255 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:59:37.987313 13255 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:59:37.987632 13255 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:59:37.988029 13255 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:59:37.988093 13255 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:37.988157 13255 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:59:37.988184 13255 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:37.995966 13255 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.3:40787
I20260811 00:59:37.996109 13454 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.3:40787 every 8 connection(s)
I20260811 00:59:37.996542 13255 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
I20260811 00:59:38.001168 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 13255
I20260811 00:59:38.001268 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance
I20260811 00:59:38.001497 15640 external_mini_cluster.cc:1428] Setting key 1cca5b2bc7d62090888432a084b099e9
Aug 11 00:59:37 dist-test-slave-h3ft krb5kdc[12676](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409977, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:59:38.009127 12804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:37.998009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:52659 (local address 127.15.70.62:35895)
0811 00:59:37.998067 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:37.998070 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:37.998192 (+ 122us) server_negotiation.cc:407] Connection header received
0811 00:59:37.999077 (+ 885us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:37.999079 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:37.999093 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:37.999153 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:38.000612 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.001219 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.002810 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.003171 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.003245 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:38.005703 (+ 2458us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:38.005704 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:38.005704 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:59:38.005713 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:38.007447 (+ 1734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:38.008046 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:38.008047 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:38.008048 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:38.008115 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:38.008392 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:38.008393 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:38.008393 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:38.008530 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:38.008578 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:38.008954 (+ 376us) server_negotiation.cc:299] Negotiation successful
0811 00:59:38.009036 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 00:59:38.009369 13460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:37.997743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:35895 (local address 127.15.70.3:52659)
0811 00:59:37.997975 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:37.998078 (+ 103us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:37.998907 (+ 829us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:37.999251 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:37.999256 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:38.000234 (+ 978us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:59:38.000499 (+ 265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:38.000505 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.001359 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.001361 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:38.002740 (+ 1379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:38.002744 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.003253 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.003253 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:38.003373 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:38.003955 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:59:38.003965 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:59:38.005590 (+ 1625us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:59:38.007543 (+ 1953us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:59:38.007551 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:59:38.007553 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:59:38.007957 (+ 404us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:59:38.008203 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:59:38.008203 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:59:38.008204 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:59:38.008332 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:59:38.008603 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:59:38.008617 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:59:38.008775 (+ 158us) client_negotiation.cc:769] Sending connection context
0811 00:59:38.008923 (+ 148us) client_negotiation.cc:240] Negotiation successful
0811 00:59:38.009086 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":122,"threads_started":1}
I20260811 00:59:38.010025 13457 heartbeater.cc:347] Connected to a master server at 127.15.70.62:35895
I20260811 00:59:38.010166 13457 heartbeater.cc:464] Registering TS with master...
I20260811 00:59:38.010423 13457 heartbeater.cc:511] Master 127.15.70.62:35895 requested a full tablet report, sending...
I20260811 00:59:38.010948 12743 ts_manager.cc:194] Registered new tserver with Master: fa1f496a3cbf449c938d0868a763c7e7 (127.15.70.3:40787)
I20260811 00:59:38.011421 12743 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.3@KRBTEST.COM'} at 127.15.70.3:52659
I20260811 00:59:38.013382 15640 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 00:59:38.022284 12804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:38.014972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36374 (local address 127.15.70.62:35895)
0811 00:59:38.015072 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:38.015074 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:38.015304 (+ 230us) server_negotiation.cc:407] Connection header received
0811 00:59:38.015337 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:38.015338 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:38.015349 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:38.015410 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:38.016203 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.016736 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.017528 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.017726 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.017788 (+ 62us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:38.019461 (+ 1673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:38.019462 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:38.019462 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:59:38.019469 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:38.021003 (+ 1534us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:38.021447 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:38.021448 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:38.021448 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:38.021509 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:38.021755 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:38.021756 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:38.021756 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:38.021934 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:38.022043 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:38.022142 (+ 99us) server_negotiation.cc:299] Negotiation successful
0811 00:59:38.022200 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 00:59:38.024494 12743 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36374:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:59:38.026582 12743 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:59:38.034148 13484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:38.029835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56046 (local address 127.15.70.2:35535)
0811 00:59:38.030442 (+ 607us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:38.030448 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:38.030463 (+ 15us) server_negotiation.cc:407] Connection header received
0811 00:59:38.030608 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:38.030611 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:38.030629 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:38.030722 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:59:38.030897 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.031832 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.033119 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.033648 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.033737 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:38.033813 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:38.033976 (+ 163us) server_negotiation.cc:299] Negotiation successful
0811 00:59:38.034025 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":555,"thread_start_us":122,"threads_started":1}
I20260811 00:59:38.034132 13476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:38.029572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.2:35535 (local address 127.0.0.1:56046)
0811 00:59:38.029776 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:38.029840 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:38.029941 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:38.030757 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:38.030758 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:38.030760 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:59:38.030812 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:38.030814 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.031953 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.031954 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:38.033017 (+ 1063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:38.033020 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.033748 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.033749 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:38.033830 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:38.033845 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 00:59:38.033954 (+ 109us) client_negotiation.cc:240] Negotiation successful
0811 00:59:38.034019 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":85,"threads_started":1}
I20260811 00:59:38.035149 13483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:38.029590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:40787 (local address 127.0.0.1:47272)
0811 00:59:38.029999 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:38.030051 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:38.030118 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:38.030627 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:38.030631 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:38.030634 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:59:38.030736 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:38.030739 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.032185 (+ 1446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.032186 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:38.033895 (+ 1709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:38.033896 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.034867 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.034868 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:38.034932 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:38.034938 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 00:59:38.034973 (+ 35us) client_negotiation.cc:240] Negotiation successful
0811 00:59:38.035048 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":381,"mutex_wait_us":694,"thread_start_us":119,"threads_started":1}
I20260811 00:59:38.035455 13485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:38.030364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49042 (local address 127.15.70.1:43317)
0811 00:59:38.031065 (+ 701us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:38.031070 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:38.031081 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:59:38.031129 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:38.031131 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:38.031148 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:38.031239 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:59:38.031401 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.032467 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.034037 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.034904 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.035199 (+ 295us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:38.035280 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:38.035308 (+ 28us) server_negotiation.cc:299] Negotiation successful
0811 00:59:38.035359 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":650,"thread_start_us":127,"threads_started":1}
I20260811 00:59:38.035506 13474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:38.029840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:43317 (local address 127.0.0.1:49042)
0811 00:59:38.030210 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:38.030218 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:38.030290 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:38.031251 (+ 961us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:38.031252 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:38.031255 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:59:38.031297 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:38.031299 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.032601 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.032602 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:38.033332 (+ 730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:38.033335 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.035028 (+ 1693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.035029 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:38.035082 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:38.035086 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:59:38.035118 (+ 32us) client_negotiation.cc:240] Negotiation successful
0811 00:59:38.035153 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":92,"threads_started":1}
I20260811 00:59:38.035436 13147 tablet_service.cc:1467] Processing CreateTablet for tablet 90b83af69f5748cbafcfd6bfeb9db5ad (DEFAULT_TABLE table=test-table [id=9e7331b207ba492b947f4f73f1edbdf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:59:38.035650 13481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:38.029743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47272 (local address 127.15.70.3:40787)
0811 00:59:38.030438 (+ 695us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:38.030445 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:38.030457 (+ 12us) server_negotiation.cc:407] Connection header received
0811 00:59:38.030506 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:38.030508 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:38.030527 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:38.030624 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:59:38.030808 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.032056 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.033995 (+ 1939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.034756 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.035388 (+ 632us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:38.035459 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:38.035488 (+ 29us) server_negotiation.cc:299] Negotiation successful
0811 00:59:38.035541 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":646,"thread_start_us":170,"threads_started":1}
I20260811 00:59:38.035952 13147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90b83af69f5748cbafcfd6bfeb9db5ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:59:38.036218 12931 tablet_service.cc:1467] Processing CreateTablet for tablet 90b83af69f5748cbafcfd6bfeb9db5ad (DEFAULT_TABLE table=test-table [id=9e7331b207ba492b947f4f73f1edbdf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:59:38.036238 13361 tablet_service.cc:1467] Processing CreateTablet for tablet 90b83af69f5748cbafcfd6bfeb9db5ad (DEFAULT_TABLE table=test-table [id=9e7331b207ba492b947f4f73f1edbdf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:59:38.036583 13361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90b83af69f5748cbafcfd6bfeb9db5ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:59:38.036583 12931 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90b83af69f5748cbafcfd6bfeb9db5ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:59:38.039630 13488 tablet_bootstrap.cc:492] T 90b83af69f5748cbafcfd6bfeb9db5ad P 4ae53d217a834b0ba2ff4ebe280cd814: Bootstrap starting.
I20260811 00:59:38.040361 13490 tablet_bootstrap.cc:492] T 90b83af69f5748cbafcfd6bfeb9db5ad P f2e8435cf4f34449b7d24400bc36cea5: Bootstrap starting.
I20260811 00:59:38.040414 13488 tablet_bootstrap.cc:654] T 90b83af69f5748cbafcfd6bfeb9db5ad P 4ae53d217a834b0ba2ff4ebe280cd814: Neither blocks nor log segments found. Creating new log.
I20260811 00:59:38.040652 13491 tablet_bootstrap.cc:492] T 90b83af69f5748cbafcfd6bfeb9db5ad P fa1f496a3cbf449c938d0868a763c7e7: Bootstrap starting.
I20260811 00:59:38.041127 13488 log.cc:824] T 90b83af69f5748cbafcfd6bfeb9db5ad P 4ae53d217a834b0ba2ff4ebe280cd814: Log is configured to *not* fsync() on all Append() calls
I20260811 00:59:38.041247 13490 tablet_bootstrap.cc:654] T 90b83af69f5748cbafcfd6bfeb9db5ad P f2e8435cf4f34449b7d24400bc36cea5: Neither blocks nor log segments found. Creating new log.
I20260811 00:59:38.041392 13491 tablet_bootstrap.cc:654] T 90b83af69f5748cbafcfd6bfeb9db5ad P fa1f496a3cbf449c938d0868a763c7e7: Neither blocks nor log segments found. Creating new log.
I20260811 00:59:38.041867 13490 log.cc:824] T 90b83af69f5748cbafcfd6bfeb9db5ad P f2e8435cf4f34449b7d24400bc36cea5: Log is configured to *not* fsync() on all Append() calls
I20260811 00:59:38.041999 13491 log.cc:824] T 90b83af69f5748cbafcfd6bfeb9db5ad P fa1f496a3cbf449c938d0868a763c7e7: Log is configured to *not* fsync() on all Append() calls
I20260811 00:59:38.042697 13490 tablet_bootstrap.cc:492] T 90b83af69f5748cbafcfd6bfeb9db5ad P f2e8435cf4f34449b7d24400bc36cea5: No bootstrap required, opened a new log
I20260811 00:59:38.042778 13490 ts_tablet_manager.cc:1397] T 90b83af69f5748cbafcfd6bfeb9db5ad P f2e8435cf4f34449b7d24400bc36cea5: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 00:59:38.042816 13488 tablet_bootstrap.cc:492] T 90b83af69f5748cbafcfd6bfeb9db5ad P 4ae53d217a834b0ba2ff4ebe280cd814: No bootstrap required, opened a new log
I20260811 00:59:38.042837 13491 tablet_bootstrap.cc:492] T 90b83af69f5748cbafcfd6bfeb9db5ad P fa1f496a3cbf449c938d0868a763c7e7: No bootstrap required, opened a new log
I20260811 00:59:38.042889 13488 ts_tablet_manager.cc:1397] T 90b83af69f5748cbafcfd6bfeb9db5ad P 4ae53d217a834b0ba2ff4ebe280cd814: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 00:59:38.042912 13491 ts_tablet_manager.cc:1397] T 90b83af69f5748cbafcfd6bfeb9db5ad P fa1f496a3cbf449c938d0868a763c7e7: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 00:59:38.044428 13491 raft_consensus.cc:348] T 90b83af69f5748cbafcfd6bfeb9db5ad P fa1f496a3cbf449c938d0868a763c7e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae53d217a834b0ba2ff4ebe280cd814" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 35535 } } peers { permanent_uuid: "f2e8435cf4f34449b7d24400bc36cea5" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 43317 } } peers { permanent_uuid: "fa1f496a3cbf449c938d0868a763c7e7" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 40787 } }
I20260811 00:59:38.044622 13491 raft_consensus.cc:374] T 90b83af69f5748cbafcfd6bfeb9db5ad P fa1f496a3cbf449c938d0868a763c7e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:59:38.044672 13491 raft_consensus.cc:729] T 90b83af69f5748cbafcfd6bfeb9db5ad P fa1f496a3cbf449c938d0868a763c7e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa1f496a3cbf449c938d0868a763c7e7, State: Initialized, Role: FOLLOWER
I20260811 00:59:38.044831 13491 consensus_queue.cc:260] T 90b83af69f5748cbafcfd6bfeb9db5ad P fa1f496a3cbf449c938d0868a763c7e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae53d217a834b0ba2ff4ebe280cd814" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 35535 } } peers { permanent_uuid: "f2e8435cf4f34449b7d24400bc36cea5" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 43317 } } peers { permanent_uuid: "fa1f496a3cbf449c938d0868a763c7e7" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 40787 } }
I20260811 00:59:38.045023 13490 raft_consensus.cc:348] T 90b83af69f5748cbafcfd6bfeb9db5ad P f2e8435cf4f34449b7d24400bc36cea5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae53d217a834b0ba2ff4ebe280cd814" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 35535 } } peers { permanent_uuid: "f2e8435cf4f34449b7d24400bc36cea5" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 43317 } } peers { permanent_uuid: "fa1f496a3cbf449c938d0868a763c7e7" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 40787 } }
I20260811 00:59:38.045169 13491 ts_tablet_manager.cc:1428] T 90b83af69f5748cbafcfd6bfeb9db5ad P fa1f496a3cbf449c938d0868a763c7e7: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 00:59:38.045085 13488 raft_consensus.cc:348] T 90b83af69f5748cbafcfd6bfeb9db5ad P 4ae53d217a834b0ba2ff4ebe280cd814 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae53d217a834b0ba2ff4ebe280cd814" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 35535 } } peers { permanent_uuid: "f2e8435cf4f34449b7d24400bc36cea5" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 43317 } } peers { permanent_uuid: "fa1f496a3cbf449c938d0868a763c7e7" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 40787 } }
I20260811 00:59:38.045213 13490 raft_consensus.cc:374] T 90b83af69f5748cbafcfd6bfeb9db5ad P f2e8435cf4f34449b7d24400bc36cea5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:59:38.045239 13488 raft_consensus.cc:374] T 90b83af69f5748cbafcfd6bfeb9db5ad P 4ae53d217a834b0ba2ff4ebe280cd814 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:59:38.045255 13490 raft_consensus.cc:729] T 90b83af69f5748cbafcfd6bfeb9db5ad P f2e8435cf4f34449b7d24400bc36cea5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2e8435cf4f34449b7d24400bc36cea5, State: Initialized, Role: FOLLOWER
I20260811 00:59:38.045284 13488 raft_consensus.cc:729] T 90b83af69f5748cbafcfd6bfeb9db5ad P 4ae53d217a834b0ba2ff4ebe280cd814 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ae53d217a834b0ba2ff4ebe280cd814, State: Initialized, Role: FOLLOWER
I20260811 00:59:38.045324 13457 heartbeater.cc:503] Master 127.15.70.62:35895 was elected leader, sending a full tablet report...
I20260811 00:59:38.045396 13490 consensus_queue.cc:260] T 90b83af69f5748cbafcfd6bfeb9db5ad P f2e8435cf4f34449b7d24400bc36cea5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae53d217a834b0ba2ff4ebe280cd814" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 35535 } } peers { permanent_uuid: "f2e8435cf4f34449b7d24400bc36cea5" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 43317 } } peers { permanent_uuid: "fa1f496a3cbf449c938d0868a763c7e7" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 40787 } }
I20260811 00:59:38.045396 13488 consensus_queue.cc:260] T 90b83af69f5748cbafcfd6bfeb9db5ad P 4ae53d217a834b0ba2ff4ebe280cd814 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae53d217a834b0ba2ff4ebe280cd814" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 35535 } } peers { permanent_uuid: "f2e8435cf4f34449b7d24400bc36cea5" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 43317 } } peers { permanent_uuid: "fa1f496a3cbf449c938d0868a763c7e7" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 40787 } }
I20260811 00:59:38.045708 13490 ts_tablet_manager.cc:1428] T 90b83af69f5748cbafcfd6bfeb9db5ad P f2e8435cf4f34449b7d24400bc36cea5: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 00:59:38.045764 13488 ts_tablet_manager.cc:1428] T 90b83af69f5748cbafcfd6bfeb9db5ad P 4ae53d217a834b0ba2ff4ebe280cd814: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 00:59:38.045887 13245 heartbeater.cc:503] Master 127.15.70.62:35895 was elected leader, sending a full tablet report...
I20260811 00:59:38.046283 13028 heartbeater.cc:503] Master 127.15.70.62:35895 was elected leader, sending a full tablet report...
W20260811 00:59:38.046653 13247 tablet.cc:2369] T 90b83af69f5748cbafcfd6bfeb9db5ad P 4ae53d217a834b0ba2ff4ebe280cd814: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 00:59:38.064625 13497 raft_consensus.cc:482] T 90b83af69f5748cbafcfd6bfeb9db5ad P fa1f496a3cbf449c938d0868a763c7e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:59:38.064821 13497 raft_consensus.cc:504] T 90b83af69f5748cbafcfd6bfeb9db5ad P fa1f496a3cbf449c938d0868a763c7e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae53d217a834b0ba2ff4ebe280cd814" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 35535 } } peers { permanent_uuid: "f2e8435cf4f34449b7d24400bc36cea5" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 43317 } } peers { permanent_uuid: "fa1f496a3cbf449c938d0868a763c7e7" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 40787 } }
I20260811 00:59:38.065351 13497 leader_election.cc:288] T 90b83af69f5748cbafcfd6bfeb9db5ad P fa1f496a3cbf449c938d0868a763c7e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ae53d217a834b0ba2ff4ebe280cd814 (127.15.70.2:35535), f2e8435cf4f34449b7d24400bc36cea5 (127.15.70.1:43317)
I20260811 00:59:38.069707 13484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:38.065814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:51491 (local address 127.15.70.2:35535)
0811 00:59:38.065871 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:38.065874 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:38.065886 (+ 12us) server_negotiation.cc:407] Connection header received
0811 00:59:38.065942 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:38.065943 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:38.065961 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:38.066007 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:59:38.066266 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.067081 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.068586 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.069221 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.069294 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:38.069310 (+ 16us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:38.069553 (+ 243us) server_negotiation.cc:299] Negotiation successful
0811 00:59:38.069613 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 00:59:38.069707 13485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:38.066096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:33599 (local address 127.15.70.1:43317)
0811 00:59:38.066174 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:38.066177 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:38.066186 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:59:38.066247 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:38.066248 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:38.066264 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:38.066298 (+ 34us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:59:38.066576 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.067267 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.068589 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.069210 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.069294 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:38.069310 (+ 16us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:38.069557 (+ 247us) server_negotiation.cc:299] Negotiation successful
0811 00:59:38.069613 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 00:59:38.069710 13460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:38.065712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.2:35535 (local address 127.15.70.3:51491)
0811 00:59:38.065785 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:38.065804 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:38.065877 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:38.066074 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:38.066075 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:38.066078 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:59:38.066174 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:38.066177 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.067168 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.067169 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:38.068471 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:38.068474 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.069325 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.069326 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:38.069435 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:38.069438 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:59:38.069526 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 00:59:38.069581 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":4}
I20260811 00:59:38.069723 13506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:38.065841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:43317 (local address 127.15.70.3:33599)
0811 00:59:38.066102 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:38.066113 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:38.066173 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:38.066381 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:38.066382 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:38.066383 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:59:38.066472 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:38.066474 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.067344 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.067345 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:38.068494 (+ 1149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:38.068496 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.069325 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.069326 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:38.069423 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:38.069433 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 00:59:38.069535 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 00:59:38.069578 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"mutex_wait_us":10,"thread_start_us":170,"threads_started":1}
I20260811 00:59:38.070225 13171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90b83af69f5748cbafcfd6bfeb9db5ad" candidate_uuid: "fa1f496a3cbf449c938d0868a763c7e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ae53d217a834b0ba2ff4ebe280cd814" is_pre_election: true
I20260811 00:59:38.070490 13171 raft_consensus.cc:2454] T 90b83af69f5748cbafcfd6bfeb9db5ad P 4ae53d217a834b0ba2ff4ebe280cd814 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa1f496a3cbf449c938d0868a763c7e7 in term 0.
I20260811 00:59:38.070537 12961 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90b83af69f5748cbafcfd6bfeb9db5ad" candidate_uuid: "fa1f496a3cbf449c938d0868a763c7e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2e8435cf4f34449b7d24400bc36cea5" is_pre_election: true
I20260811 00:59:38.070729 12961 raft_consensus.cc:2454] T 90b83af69f5748cbafcfd6bfeb9db5ad P f2e8435cf4f34449b7d24400bc36cea5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa1f496a3cbf449c938d0868a763c7e7 in term 0.
I20260811 00:59:38.070804 13291 leader_election.cc:302] T 90b83af69f5748cbafcfd6bfeb9db5ad P fa1f496a3cbf449c938d0868a763c7e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ae53d217a834b0ba2ff4ebe280cd814, fa1f496a3cbf449c938d0868a763c7e7; no voters:
I20260811 00:59:38.070963 13497 raft_consensus.cc:2781] T 90b83af69f5748cbafcfd6bfeb9db5ad P fa1f496a3cbf449c938d0868a763c7e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:59:38.071084 13497 raft_consensus.cc:482] T 90b83af69f5748cbafcfd6bfeb9db5ad P fa1f496a3cbf449c938d0868a763c7e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:59:38.071127 13497 raft_consensus.cc:3037] T 90b83af69f5748cbafcfd6bfeb9db5ad P fa1f496a3cbf449c938d0868a763c7e7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:59:38.072142 13497 raft_consensus.cc:504] T 90b83af69f5748cbafcfd6bfeb9db5ad P fa1f496a3cbf449c938d0868a763c7e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae53d217a834b0ba2ff4ebe280cd814" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 35535 } } peers { permanent_uuid: "f2e8435cf4f34449b7d24400bc36cea5" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 43317 } } peers { permanent_uuid: "fa1f496a3cbf449c938d0868a763c7e7" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 40787 } }
I20260811 00:59:38.072319 13497 leader_election.cc:288] T 90b83af69f5748cbafcfd6bfeb9db5ad P fa1f496a3cbf449c938d0868a763c7e7 [CANDIDATE]: Term 1 election: Requested vote from peers 4ae53d217a834b0ba2ff4ebe280cd814 (127.15.70.2:35535), f2e8435cf4f34449b7d24400bc36cea5 (127.15.70.1:43317)
I20260811 00:59:38.072548 13171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90b83af69f5748cbafcfd6bfeb9db5ad" candidate_uuid: "fa1f496a3cbf449c938d0868a763c7e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ae53d217a834b0ba2ff4ebe280cd814"
I20260811 00:59:38.072570 12961 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90b83af69f5748cbafcfd6bfeb9db5ad" candidate_uuid: "fa1f496a3cbf449c938d0868a763c7e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2e8435cf4f34449b7d24400bc36cea5"
I20260811 00:59:38.072675 13171 raft_consensus.cc:3037] T 90b83af69f5748cbafcfd6bfeb9db5ad P 4ae53d217a834b0ba2ff4ebe280cd814 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:59:38.072660 12961 raft_consensus.cc:3037] T 90b83af69f5748cbafcfd6bfeb9db5ad P f2e8435cf4f34449b7d24400bc36cea5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:59:38.073642 13171 raft_consensus.cc:2454] T 90b83af69f5748cbafcfd6bfeb9db5ad P 4ae53d217a834b0ba2ff4ebe280cd814 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa1f496a3cbf449c938d0868a763c7e7 in term 1.
I20260811 00:59:38.073642 12961 raft_consensus.cc:2454] T 90b83af69f5748cbafcfd6bfeb9db5ad P f2e8435cf4f34449b7d24400bc36cea5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa1f496a3cbf449c938d0868a763c7e7 in term 1.
I20260811 00:59:38.073843 13291 leader_election.cc:302] T 90b83af69f5748cbafcfd6bfeb9db5ad P fa1f496a3cbf449c938d0868a763c7e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f2e8435cf4f34449b7d24400bc36cea5, fa1f496a3cbf449c938d0868a763c7e7; no voters:
I20260811 00:59:38.073974 13497 raft_consensus.cc:2781] T 90b83af69f5748cbafcfd6bfeb9db5ad P fa1f496a3cbf449c938d0868a763c7e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:59:38.074193 13497 raft_consensus.cc:686] T 90b83af69f5748cbafcfd6bfeb9db5ad P fa1f496a3cbf449c938d0868a763c7e7 [term 1 LEADER]: Becoming Leader. State: Replica: fa1f496a3cbf449c938d0868a763c7e7, State: Running, Role: LEADER
I20260811 00:59:38.074359 13497 consensus_queue.cc:237] T 90b83af69f5748cbafcfd6bfeb9db5ad P fa1f496a3cbf449c938d0868a763c7e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae53d217a834b0ba2ff4ebe280cd814" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 35535 } } peers { permanent_uuid: "f2e8435cf4f34449b7d24400bc36cea5" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 43317 } } peers { permanent_uuid: "fa1f496a3cbf449c938d0868a763c7e7" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 40787 } }
I20260811 00:59:38.075600 12740 catalog_manager.cc:5495] T 90b83af69f5748cbafcfd6bfeb9db5ad P fa1f496a3cbf449c938d0868a763c7e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa1f496a3cbf449c938d0868a763c7e7 (127.15.70.3). New cstate: current_term: 1 leader_uuid: "fa1f496a3cbf449c938d0868a763c7e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae53d217a834b0ba2ff4ebe280cd814" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 35535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2e8435cf4f34449b7d24400bc36cea5" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 43317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa1f496a3cbf449c938d0868a763c7e7" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 40787 } health_report { overall_health: HEALTHY } } }
I20260811 00:59:38.094439 13481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:38.091658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47286 (local address 127.15.70.3:40787)
0811 00:59:38.091730 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:38.091732 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:38.091741 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:59:38.091787 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:38.091788 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:38.091813 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:38.091886 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:59:38.092056 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.092570 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.093532 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.093766 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.093840 (+ 74us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:38.094002 (+ 162us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:59:38.094121 (+ 119us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:59:38.094205 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:38.094288 (+ 83us) server_negotiation.cc:299] Negotiation successful
0811 00:59:38.094300 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 00:59:38.097666 13171 raft_consensus.cc:1261] T 90b83af69f5748cbafcfd6bfeb9db5ad P 4ae53d217a834b0ba2ff4ebe280cd814 [term 1 FOLLOWER]: Refusing update from remote peer fa1f496a3cbf449c938d0868a763c7e7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:59:38.097684 12961 raft_consensus.cc:1261] T 90b83af69f5748cbafcfd6bfeb9db5ad P f2e8435cf4f34449b7d24400bc36cea5 [term 1 FOLLOWER]: Refusing update from remote peer fa1f496a3cbf449c938d0868a763c7e7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:59:38.098271 13507 consensus_queue.cc:1035] T 90b83af69f5748cbafcfd6bfeb9db5ad P fa1f496a3cbf449c938d0868a763c7e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae53d217a834b0ba2ff4ebe280cd814" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 35535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:59:38.098496 13497 consensus_queue.cc:1035] T 90b83af69f5748cbafcfd6bfeb9db5ad P fa1f496a3cbf449c938d0868a763c7e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2e8435cf4f34449b7d24400bc36cea5" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 43317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:59:38.102483 13513 mvcc.cc:205] Tried to move back new op lower bound from 7317135270283358208 to 7317135270193688576. Current Snapshot: MvccSnapshot[applied={T|T < 7317135270283358208}]
I20260811 00:59:38.105314 12740 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36374:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:59:38.105453 12740 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36374:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:59:38.106539 12740 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b25b18569f6e4236a8719129a051a432: Sending DeleteTablet for 3 replicas of tablet 90b83af69f5748cbafcfd6bfeb9db5ad
I20260811 00:59:38.107060 12931 tablet_service.cc:1514] Processing DeleteTablet for tablet 90b83af69f5748cbafcfd6bfeb9db5ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:59:38 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:49042
I20260811 00:59:38.107069 13147 tablet_service.cc:1514] Processing DeleteTablet for tablet 90b83af69f5748cbafcfd6bfeb9db5ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:59:38 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:56046
I20260811 00:59:38.107039 13361 tablet_service.cc:1514] Processing DeleteTablet for tablet 90b83af69f5748cbafcfd6bfeb9db5ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:59:38 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:47272
I20260811 00:59:38.107396 13527 tablet_replica.cc:330] T 90b83af69f5748cbafcfd6bfeb9db5ad P f2e8435cf4f34449b7d24400bc36cea5: stopping tablet replica
I20260811 00:59:38.107422 13529 tablet_replica.cc:330] T 90b83af69f5748cbafcfd6bfeb9db5ad P fa1f496a3cbf449c938d0868a763c7e7: stopping tablet replica
I20260811 00:59:38.107533 13529 raft_consensus.cc:2229] T 90b83af69f5748cbafcfd6bfeb9db5ad P fa1f496a3cbf449c938d0868a763c7e7 [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:59:38.107533 13527 raft_consensus.cc:2229] T 90b83af69f5748cbafcfd6bfeb9db5ad P f2e8435cf4f34449b7d24400bc36cea5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:59:38.107647 13529 raft_consensus.cc:2258] T 90b83af69f5748cbafcfd6bfeb9db5ad P fa1f496a3cbf449c938d0868a763c7e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:59:38.107694 13527 raft_consensus.cc:2258] T 90b83af69f5748cbafcfd6bfeb9db5ad P f2e8435cf4f34449b7d24400bc36cea5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:59:38.107883 13526 tablet_replica.cc:330] T 90b83af69f5748cbafcfd6bfeb9db5ad P 4ae53d217a834b0ba2ff4ebe280cd814: stopping tablet replica
I20260811 00:59:38.108008 13526 raft_consensus.cc:2229] T 90b83af69f5748cbafcfd6bfeb9db5ad P 4ae53d217a834b0ba2ff4ebe280cd814 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:59:38.108099 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 12835
I20260811 00:59:38.108129 13526 raft_consensus.cc:2258] T 90b83af69f5748cbafcfd6bfeb9db5ad P 4ae53d217a834b0ba2ff4ebe280cd814 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:59:38.108654 13526 ts_tablet_manager.cc:1905] T 90b83af69f5748cbafcfd6bfeb9db5ad P 4ae53d217a834b0ba2ff4ebe280cd814: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:59:38.110809 13526 ts_tablet_manager.cc:1918] T 90b83af69f5748cbafcfd6bfeb9db5ad P 4ae53d217a834b0ba2ff4ebe280cd814: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:59:38.110903 13526 log.cc:1196] T 90b83af69f5748cbafcfd6bfeb9db5ad P 4ae53d217a834b0ba2ff4ebe280cd814: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-1/wal/wals/90b83af69f5748cbafcfd6bfeb9db5ad
I20260811 00:59:38.111268 13526 ts_tablet_manager.cc:1939] T 90b83af69f5748cbafcfd6bfeb9db5ad P 4ae53d217a834b0ba2ff4ebe280cd814: Deleting consensus metadata
I20260811 00:59:38.112761 12725 catalog_manager.cc:4841] TS 4ae53d217a834b0ba2ff4ebe280cd814 (127.15.70.2:35535): tablet 90b83af69f5748cbafcfd6bfeb9db5ad (table test-table [id=9e7331b207ba492b947f4f73f1edbdf4]) successfully deleted
I20260811 00:59:38.108222 13529 ts_tablet_manager.cc:1905] T 90b83af69f5748cbafcfd6bfeb9db5ad P fa1f496a3cbf449c938d0868a763c7e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:59:38.115350 13529 ts_tablet_manager.cc:1918] T 90b83af69f5748cbafcfd6bfeb9db5ad P fa1f496a3cbf449c938d0868a763c7e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:59:38.115458 13529 log.cc:1196] T 90b83af69f5748cbafcfd6bfeb9db5ad P fa1f496a3cbf449c938d0868a763c7e7: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409704606556-15640-0/minicluster-data/ts-2/wal/wals/90b83af69f5748cbafcfd6bfeb9db5ad
I20260811 00:59:38.115823 13529 ts_tablet_manager.cc:1939] T 90b83af69f5748cbafcfd6bfeb9db5ad P fa1f496a3cbf449c938d0868a763c7e7: Deleting consensus metadata
I20260811 00:59:38.116458 12721 catalog_manager.cc:4841] TS fa1f496a3cbf449c938d0868a763c7e7 (127.15.70.3:40787): tablet 90b83af69f5748cbafcfd6bfeb9db5ad (table test-table [id=9e7331b207ba492b947f4f73f1edbdf4]) successfully deleted
W20260811 00:59:38.130462 12725 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.70.1:43317 (error 108)
I20260811 00:59:38.130934 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 13035
I20260811 00:59:38.142638 13474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:38.142397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:43317 (local address 127.0.0.1:49054)
0811 00:59:38.142493 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:38.142561 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.1:43317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260811 00:59:38.142869 12725 catalog_manager.cc:4584] TS f2e8435cf4f34449b7d24400bc36cea5 (127.15.70.1:43317): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 90b83af69f5748cbafcfd6bfeb9db5ad: Network error: Client connection negotiation failed: client connection to 127.15.70.1:43317: connect: Connection refused (error 111)
I20260811 00:59:38.154893 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 13255
I20260811 00:59:38.171921 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 12692
2026-08-11T00:59:38Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2440 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-11T00:59:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:59:38Z Disabled control of system clock
I20260811 00:59:38.216598 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:45043
--webserver_interface=127.15.70.62
--webserver_port=0
--builtin_ntp_servers=127.15.70.20:44877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:45043
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 00:59:38.311458 13536 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:59:38.311793 13536 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:59:38.311816 13536 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:59:38.313210 13536 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:59:38.313263 13536 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:59:38.313277 13536 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:59:38.313290 13536 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:59:38.313303 13536 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:59:38.314775 13536 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:44877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:45043
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:45043
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13536
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:59:38.315112 13536 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:59:38.315448 13536 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:59:38.321398 13547 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:38.321319 13546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:38.321341 13550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:38.321700 13536 server_base.cc:1034] running on GCE node
I20260811 00:59:38.322068 13536 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:59:38.322446 13536 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:59:38.323673 13536 hybrid_clock.cc:648] HybridClock initialized: now 1786409978323660 us; error 43 us; skew 500 ppm
I20260811 00:59:38.325421 13536 webserver.cc:460] Webserver started at http://127.15.70.62:39793/ using document root <none> and password file <none>
I20260811 00:59:38.325730 13536 fs_manager.cc:359] Metadata directory not provided
I20260811 00:59:38.325811 13536 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:59:38.325994 13536 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:59:38.327378 13536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "45283fddfdce4b9fa76e255f8540c00d"
format_stamp: "Formatted at 2026-08-11 00:59:38 on dist-test-slave-h3ft"
server_key: "f1d3c71b52c886fc698f86a0cc79a9d6"
server_key_iv: "349f780d9b9a6f0a7741239900285e6a"
server_key_version: "encryptionkey@0"
I20260811 00:59:38.327790 13536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "45283fddfdce4b9fa76e255f8540c00d"
format_stamp: "Formatted at 2026-08-11 00:59:38 on dist-test-slave-h3ft"
server_key: "f1d3c71b52c886fc698f86a0cc79a9d6"
server_key_iv: "349f780d9b9a6f0a7741239900285e6a"
server_key_version: "encryptionkey@0"
I20260811 00:59:38.329321 13536 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:59:38.330292 13556 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:38.330499 13536 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:59:38.330619 13536 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "45283fddfdce4b9fa76e255f8540c00d"
format_stamp: "Formatted at 2026-08-11 00:59:38 on dist-test-slave-h3ft"
server_key: "f1d3c71b52c886fc698f86a0cc79a9d6"
server_key_iv: "349f780d9b9a6f0a7741239900285e6a"
server_key_version: "encryptionkey@0"
I20260811 00:59:38.330714 13536 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:59:38.351699 13536 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:59:38.352082 13536 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:59:38.352224 13536 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:59:38.356956 13536 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:45043
I20260811 00:59:38.356995 13626 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:45043 every 8 connection(s)
I20260811 00:59:38.357439 13536 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:59:38.358682 13627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:59:38.361552 13627 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45283fddfdce4b9fa76e255f8540c00d: Bootstrap starting.
I20260811 00:59:38.362260 13627 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 45283fddfdce4b9fa76e255f8540c00d: Neither blocks nor log segments found. Creating new log.
I20260811 00:59:38.362637 13627 log.cc:824] T 00000000000000000000000000000000 P 45283fddfdce4b9fa76e255f8540c00d: Log is configured to *not* fsync() on all Append() calls
I20260811 00:59:38.363125 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 13536
I20260811 00:59:38.363224 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 00:59:38.363473 15640 external_mini_cluster.cc:1428] Setting key dbf9ed3178e2acd643a5ac8ae65383fc
I20260811 00:59:38.363734 13627 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45283fddfdce4b9fa76e255f8540c00d: No bootstrap required, opened a new log
I20260811 00:59:38.367465 13627 raft_consensus.cc:348] T 00000000000000000000000000000000 P 45283fddfdce4b9fa76e255f8540c00d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45283fddfdce4b9fa76e255f8540c00d" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 45043 } }
I20260811 00:59:38.367674 13627 raft_consensus.cc:374] T 00000000000000000000000000000000 P 45283fddfdce4b9fa76e255f8540c00d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:59:38.367712 13627 raft_consensus.cc:729] T 00000000000000000000000000000000 P 45283fddfdce4b9fa76e255f8540c00d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45283fddfdce4b9fa76e255f8540c00d, State: Initialized, Role: FOLLOWER
I20260811 00:59:38.367866 13627 consensus_queue.cc:260] T 00000000000000000000000000000000 P 45283fddfdce4b9fa76e255f8540c00d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45283fddfdce4b9fa76e255f8540c00d" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 45043 } }
I20260811 00:59:38.367986 13627 raft_consensus.cc:388] T 00000000000000000000000000000000 P 45283fddfdce4b9fa76e255f8540c00d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:59:38.368038 13627 raft_consensus.cc:482] T 00000000000000000000000000000000 P 45283fddfdce4b9fa76e255f8540c00d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:59:38.368094 13627 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 45283fddfdce4b9fa76e255f8540c00d [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:59:38.368834 13627 raft_consensus.cc:504] T 00000000000000000000000000000000 P 45283fddfdce4b9fa76e255f8540c00d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45283fddfdce4b9fa76e255f8540c00d" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 45043 } }
I20260811 00:59:38.369155 13627 leader_election.cc:302] T 00000000000000000000000000000000 P 45283fddfdce4b9fa76e255f8540c00d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 45283fddfdce4b9fa76e255f8540c00d; no voters:
I20260811 00:59:38.369421 13627 leader_election.cc:288] T 00000000000000000000000000000000 P 45283fddfdce4b9fa76e255f8540c00d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:59:38.369588 13636 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 45283fddfdce4b9fa76e255f8540c00d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:59:38.369784 13636 raft_consensus.cc:686] T 00000000000000000000000000000000 P 45283fddfdce4b9fa76e255f8540c00d [term 1 LEADER]: Becoming Leader. State: Replica: 45283fddfdce4b9fa76e255f8540c00d, State: Running, Role: LEADER
I20260811 00:59:38.369882 13636 consensus_queue.cc:237] T 00000000000000000000000000000000 P 45283fddfdce4b9fa76e255f8540c00d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45283fddfdce4b9fa76e255f8540c00d" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 45043 } }
I20260811 00:59:38.369925 13627 sys_catalog.cc:564] T 00000000000000000000000000000000 P 45283fddfdce4b9fa76e255f8540c00d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:59:38.370234 13638 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45283fddfdce4b9fa76e255f8540c00d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "45283fddfdce4b9fa76e255f8540c00d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45283fddfdce4b9fa76e255f8540c00d" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 45043 } } }
I20260811 00:59:38.370316 13638 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45283fddfdce4b9fa76e255f8540c00d [sys.catalog]: This master's current role is: LEADER
I20260811 00:59:38.371025 13643 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:59:38.371022 13640 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45283fddfdce4b9fa76e255f8540c00d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 45283fddfdce4b9fa76e255f8540c00d. Latest consensus state: current_term: 1 leader_uuid: "45283fddfdce4b9fa76e255f8540c00d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45283fddfdce4b9fa76e255f8540c00d" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 45043 } } }
I20260811 00:59:38.371165 13640 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45283fddfdce4b9fa76e255f8540c00d [sys.catalog]: This master's current role is: LEADER
I20260811 00:59:38.371855 13643 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:59:38.372119 13633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:38.364201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37748 (local address 127.15.70.62:45043)
0811 00:59:38.364500 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:38.364511 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:38.364553 (+ 42us) server_negotiation.cc:407] Connection header received
0811 00:59:38.365659 (+ 1106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:38.365670 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:38.365761 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:38.365946 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:38.366148 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.367746 (+ 1598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.368692 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.369626 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.369821 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:38.371148 (+ 1327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:38.371153 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:38.371153 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:59:38.371433 (+ 280us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:38.371492 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:59:38.371511 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:38.371608 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:38.371714 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 00:59:38.371814 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":109,"threads_started":1}
I20260811 00:59:38.374097 13643 catalog_manager.cc:1347] Generated new cluster ID: 0c3b166d176c42eca47327ce9a4d0782
I20260811 00:59:38.374152 13643 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:59:38.413746 13643 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:59:38.414433 13643 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:59:38.427177 13643 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 45283fddfdce4b9fa76e255f8540c00d: Generated new TSK 0
I20260811 00:59:38.427409 13643 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:59:38.433770 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.1:0
--local_ip_for_outbound_sockets=127.15.70.1
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:45043
--builtin_ntp_servers=127.15.70.20:44877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 00:59:38.530920 13663 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:59:38.531230 13663 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:59:38.531255 13663 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:59:38.532454 13663 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:59:38.532497 13663 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:59:38.532549 13663 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.1
I20260811 00:59:38.534049 13663 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:44877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:45043
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13663
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.1
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:59:38.534363 13663 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:59:38.534729 13663 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:59:38.540702 13671 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:38.540704 13672 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:38.540755 13663 server_base.cc:1034] running on GCE node
W20260811 00:59:38.540704 13676 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:38.541193 13663 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:59:38.541522 13663 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:59:38.542701 13663 hybrid_clock.cc:648] HybridClock initialized: now 1786409978542683 us; error 51 us; skew 500 ppm
I20260811 00:59:38.544240 13663 webserver.cc:460] Webserver started at http://127.15.70.1:44897/ using document root <none> and password file <none>
I20260811 00:59:38.544544 13663 fs_manager.cc:359] Metadata directory not provided
I20260811 00:59:38.544611 13663 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:59:38.544803 13663 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:59:38.546048 13663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-0/data/instance:
uuid: "51ae6ad1c6d045a9a4f9274c91db3dc3"
format_stamp: "Formatted at 2026-08-11 00:59:38 on dist-test-slave-h3ft"
server_key: "78fa73b98f714d5cfe86fd8d43bd597b"
server_key_iv: "d962d05b7c1a67bd97aded1d6480b737"
server_key_version: "encryptionkey@0"
I20260811 00:59:38.546452 13663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance:
uuid: "51ae6ad1c6d045a9a4f9274c91db3dc3"
format_stamp: "Formatted at 2026-08-11 00:59:38 on dist-test-slave-h3ft"
server_key: "78fa73b98f714d5cfe86fd8d43bd597b"
server_key_iv: "d962d05b7c1a67bd97aded1d6480b737"
server_key_version: "encryptionkey@0"
I20260811 00:59:38.548049 13663 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 00:59:38.548861 13685 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:38.549055 13663 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:59:38.549175 13663 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-0/wal
uuid: "51ae6ad1c6d045a9a4f9274c91db3dc3"
format_stamp: "Formatted at 2026-08-11 00:59:38 on dist-test-slave-h3ft"
server_key: "78fa73b98f714d5cfe86fd8d43bd597b"
server_key_iv: "d962d05b7c1a67bd97aded1d6480b737"
server_key_version: "encryptionkey@0"
I20260811 00:59:38.549258 13663 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:59:38.576294 13663 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:59:38.576750 13663 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:59:38.576934 13663 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:59:38.577237 13663 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:59:38.577661 13663 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:59:38.577720 13663 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:38.577765 13663 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:59:38.577797 13663 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:38.584822 13663 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.1:33759
I20260811 00:59:38.584899 13863 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.1:33759 every 8 connection(s)
I20260811 00:59:38.585327 13663 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
I20260811 00:59:38.591401 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 13663
I20260811 00:59:38.591552 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance
I20260811 00:59:38.591578 13633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:38.586253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:48747 (local address 127.15.70.62:45043)
0811 00:59:38.586325 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:38.586328 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:38.586611 (+ 283us) server_negotiation.cc:407] Connection header received
0811 00:59:38.587328 (+ 717us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:38.587330 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:38.587352 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:38.587438 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:38.588264 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.588828 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.589884 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.590101 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.590183 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:38.591242 (+ 1059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:38.591244 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:38.591244 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:59:38.591251 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:38.591275 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:59:38.591280 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:38.591343 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:38.591447 (+ 104us) server_negotiation.cc:299] Negotiation successful
0811 00:59:38.591481 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 00:59:38.591806 15640 external_mini_cluster.cc:1428] Setting key 52d05993a55b6776d4acd7a769977351
I20260811 00:59:38.591825 13871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:38.586225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:45043 (local address 127.15.70.1:48747)
0811 00:59:38.586463 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:38.586509 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:38.587207 (+ 698us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:38.587537 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:38.587541 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:38.587550 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:59:38.588153 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:38.588158 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.588934 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.588935 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:38.589786 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:38.589788 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.590194 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.590195 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:38.590350 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:38.591045 (+ 695us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:59:38.591045 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:59:38.591079 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:59:38.591106 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:59:38.591344 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:59:38.591352 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:59:38.591355 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:59:38.591449 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 00:59:38.591576 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":111,"threads_started":1}
I20260811 00:59:38.592455 13864 heartbeater.cc:347] Connected to a master server at 127.15.70.62:45043
I20260811 00:59:38.592607 13864 heartbeater.cc:464] Registering TS with master...
I20260811 00:59:38.592840 13864 heartbeater.cc:511] Master 127.15.70.62:45043 requested a full tablet report, sending...
I20260811 00:59:38.593237 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.2:0
--local_ip_for_outbound_sockets=127.15.70.2
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:45043
--builtin_ntp_servers=127.15.70.20:44877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 00:59:38.593549 13578 ts_manager.cc:194] Registered new tserver with Master: 51ae6ad1c6d045a9a4f9274c91db3dc3 (127.15.70.1:33759)
I20260811 00:59:38.594264 13578 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.70.1:48747
W20260811 00:59:38.695622 13872 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:59:38.695941 13872 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:59:38.695971 13872 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:59:38.697377 13872 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:59:38.697440 13872 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:59:38.697470 13872 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.2
I20260811 00:59:38.699148 13872 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:44877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:45043
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13872
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.2
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:59:38.699518 13872 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:59:38.699947 13872 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:59:38.706243 13887 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:38.706267 13881 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:38.706228 13872 server_base.cc:1034] running on GCE node
W20260811 00:59:38.706228 13878 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:38.706736 13872 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:59:38.707113 13872 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:59:38.708302 13872 hybrid_clock.cc:648] HybridClock initialized: now 1786409978708293 us; error 38 us; skew 500 ppm
I20260811 00:59:38.710006 13872 webserver.cc:460] Webserver started at http://127.15.70.2:34901/ using document root <none> and password file <none>
I20260811 00:59:38.710362 13872 fs_manager.cc:359] Metadata directory not provided
I20260811 00:59:38.710448 13872 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:59:38.710625 13872 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:59:38.712018 13872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-1/data/instance:
uuid: "84a9d1cb61b74f43b222458b3c98ca92"
format_stamp: "Formatted at 2026-08-11 00:59:38 on dist-test-slave-h3ft"
server_key: "54188a67278865d0bd6d39ecd6dae861"
server_key_iv: "0db0a8aae670aceab4d56cf65ef53ce2"
server_key_version: "encryptionkey@0"
I20260811 00:59:38.712462 13872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance:
uuid: "84a9d1cb61b74f43b222458b3c98ca92"
format_stamp: "Formatted at 2026-08-11 00:59:38 on dist-test-slave-h3ft"
server_key: "54188a67278865d0bd6d39ecd6dae861"
server_key_iv: "0db0a8aae670aceab4d56cf65ef53ce2"
server_key_version: "encryptionkey@0"
I20260811 00:59:38.714080 13872 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 00:59:38.714972 13897 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:38.715273 13872 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:59:38.715395 13872 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-1/wal
uuid: "84a9d1cb61b74f43b222458b3c98ca92"
format_stamp: "Formatted at 2026-08-11 00:59:38 on dist-test-slave-h3ft"
server_key: "54188a67278865d0bd6d39ecd6dae861"
server_key_iv: "0db0a8aae670aceab4d56cf65ef53ce2"
server_key_version: "encryptionkey@0"
I20260811 00:59:38.715484 13872 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:59:38.722796 13872 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:59:38.723266 13872 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:59:38.723436 13872 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:59:38.723721 13872 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:59:38.724149 13872 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:59:38.724208 13872 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:38.724255 13872 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:59:38.724291 13872 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:38.731412 13872 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.2:33449
I20260811 00:59:38.731523 14078 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.2:33449 every 8 connection(s)
I20260811 00:59:38.731966 13872 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
I20260811 00:59:38.738633 13633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:38.732987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:45439 (local address 127.15.70.62:45043)
0811 00:59:38.733077 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:38.733079 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:38.733331 (+ 252us) server_negotiation.cc:407] Connection header received
0811 00:59:38.733974 (+ 643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:38.733975 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:38.733991 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:38.734120 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:38.735083 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.735678 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.736863 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.737093 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.737165 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:38.738251 (+ 1086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:38.738253 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:38.738253 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:59:38.738259 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:38.738280 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:59:38.738284 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:38.738337 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:38.738510 (+ 173us) server_negotiation.cc:299] Negotiation successful
0811 00:59:38.738543 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 00:59:38.738890 14081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:38.732899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:45043 (local address 127.15.70.2:45439)
0811 00:59:38.733147 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:38.733197 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:38.733843 (+ 646us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:38.734225 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:38.734229 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:38.734239 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:59:38.734853 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:38.734857 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.735801 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.735801 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:38.736754 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:38.736757 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.737208 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.737209 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:38.737377 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:38.738069 (+ 692us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:59:38.738069 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:59:38.738117 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:59:38.738149 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:59:38.738387 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:59:38.738407 (+ 20us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:59:38.738411 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:59:38.738500 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 00:59:38.738611 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":131,"threads_started":1}
I20260811 00:59:38.739662 14079 heartbeater.cc:347] Connected to a master server at 127.15.70.62:45043
I20260811 00:59:38.739802 14079 heartbeater.cc:464] Registering TS with master...
I20260811 00:59:38.740049 14079 heartbeater.cc:511] Master 127.15.70.62:45043 requested a full tablet report, sending...
I20260811 00:59:38.740520 13578 ts_manager.cc:194] Registered new tserver with Master: 84a9d1cb61b74f43b222458b3c98ca92 (127.15.70.2:33449)
I20260811 00:59:38.740949 13578 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.70.2:45439
I20260811 00:59:38.741444 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 13872
I20260811 00:59:38.741575 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance
I20260811 00:59:38.741827 15640 external_mini_cluster.cc:1428] Setting key 7e32a04d0da24ffa974713c6fcf0c24b
I20260811 00:59:38.742894 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.3:0
--local_ip_for_outbound_sockets=127.15.70.3
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:45043
--builtin_ntp_servers=127.15.70.20:44877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 00:59:38.841463 14083 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:59:38.841732 14083 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:59:38.841758 14083 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:59:38.843950 14083 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:59:38.844048 14083 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:59:38.844113 14083 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.3
I20260811 00:59:38.845670 14083 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:44877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:45043
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14083
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.3
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:59:38.845996 14083 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:59:38.846398 14083 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:59:38.853987 14094 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:38.854058 14093 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:38.854010 14096 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:38.854502 14083 server_base.cc:1034] running on GCE node
I20260811 00:59:38.854707 14083 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:59:38.854950 14083 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:59:38.856163 14083 hybrid_clock.cc:648] HybridClock initialized: now 1786409978856144 us; error 36 us; skew 500 ppm
I20260811 00:59:38.857697 14083 webserver.cc:460] Webserver started at http://127.15.70.3:38603/ using document root <none> and password file <none>
I20260811 00:59:38.858048 14083 fs_manager.cc:359] Metadata directory not provided
I20260811 00:59:38.858132 14083 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:59:38.858300 14083 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:59:38.859678 14083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-2/data/instance:
uuid: "bf2a467bf35148ec96f14a374e38b131"
format_stamp: "Formatted at 2026-08-11 00:59:38 on dist-test-slave-h3ft"
server_key: "ccb7891e72714698ec1a021e0afe65a4"
server_key_iv: "b776a3ebb5d29db9591adfd030e538c2"
server_key_version: "encryptionkey@0"
I20260811 00:59:38.860103 14083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance:
uuid: "bf2a467bf35148ec96f14a374e38b131"
format_stamp: "Formatted at 2026-08-11 00:59:38 on dist-test-slave-h3ft"
server_key: "ccb7891e72714698ec1a021e0afe65a4"
server_key_iv: "b776a3ebb5d29db9591adfd030e538c2"
server_key_version: "encryptionkey@0"
I20260811 00:59:38.861649 14083 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:59:38.862466 14108 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:38.862655 14083 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:59:38.862771 14083 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-2/wal
uuid: "bf2a467bf35148ec96f14a374e38b131"
format_stamp: "Formatted at 2026-08-11 00:59:38 on dist-test-slave-h3ft"
server_key: "ccb7891e72714698ec1a021e0afe65a4"
server_key_iv: "b776a3ebb5d29db9591adfd030e538c2"
server_key_version: "encryptionkey@0"
I20260811 00:59:38.862855 14083 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:59:38.875982 14083 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:59:38.876392 14083 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:59:38.876588 14083 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:59:38.876883 14083 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:59:38.877306 14083 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:59:38.877368 14083 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:38.877417 14083 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:59:38.877447 14083 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:38.884802 14083 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.3:33037
I20260811 00:59:38.884859 14294 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.3:33037 every 8 connection(s)
I20260811 00:59:38.885293 14083 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
I20260811 00:59:38.890976 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 14083
I20260811 00:59:38.891134 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance
I20260811 00:59:38.891409 15640 external_mini_cluster.cc:1428] Setting key e69da334585b6cb2c630283420d44f8e
I20260811 00:59:38.891415 13633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:38.886213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:35817 (local address 127.15.70.62:45043)
0811 00:59:38.886297 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:38.886301 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:38.886618 (+ 317us) server_negotiation.cc:407] Connection header received
0811 00:59:38.887356 (+ 738us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:38.887357 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:38.887372 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:38.887429 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:38.888183 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.888725 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.889767 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.889960 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.890013 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:38.890949 (+ 936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:38.890952 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:38.890952 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:59:38.890961 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:38.890983 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:59:38.890988 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:38.891116 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:38.891274 (+ 158us) server_negotiation.cc:299] Negotiation successful
0811 00:59:38.891314 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 00:59:38.891616 14298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:38.886211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:45043 (local address 127.15.70.3:35817)
0811 00:59:38.886467 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:38.886516 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:38.887253 (+ 737us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:38.887497 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:38.887502 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:38.887512 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:59:38.888104 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:38.888109 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.888817 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.888818 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:38.889685 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:38.889688 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.890039 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.890040 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:38.890161 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:38.890778 (+ 617us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:59:38.890778 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:59:38.890811 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:59:38.890839 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:59:38.891118 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:59:38.891126 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:59:38.891130 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:59:38.891238 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 00:59:38.891347 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":123,"threads_started":1}
I20260811 00:59:38.892213 14295 heartbeater.cc:347] Connected to a master server at 127.15.70.62:45043
I20260811 00:59:38.892333 14295 heartbeater.cc:464] Registering TS with master...
I20260811 00:59:38.892577 14295 heartbeater.cc:511] Master 127.15.70.62:45043 requested a full tablet report, sending...
I20260811 00:59:38.893043 13578 ts_manager.cc:194] Registered new tserver with Master: bf2a467bf35148ec96f14a374e38b131 (127.15.70.3:33037)
I20260811 00:59:38.893458 13578 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.70.3:35817
I20260811 00:59:38.903784 15640 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 00:59:38.909196 13633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:38.905761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52834 (local address 127.15.70.62:45043)
0811 00:59:38.905868 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:38.905870 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:38.905977 (+ 107us) server_negotiation.cc:407] Connection header received
0811 00:59:38.906097 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:38.906097 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:38.906111 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:38.906185 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:38.906369 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.906910 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.907741 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.907945 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.908049 (+ 104us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:38.908866 (+ 817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:38.908868 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:38.908868 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:59:38.908874 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:38.908895 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:59:38.908899 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:38.909006 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:38.909091 (+ 85us) server_negotiation.cc:299] Negotiation successful
0811 00:59:38.909106 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 00:59:38.911265 13578 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52834:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:59:38.913434 13578 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:59:38.921106 14319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:38.916694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47218 (local address 127.15.70.2:33449)
0811 00:59:38.916961 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:38.916967 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:38.917113 (+ 146us) server_negotiation.cc:407] Connection header received
0811 00:59:38.917169 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:38.917171 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:38.917190 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:38.917269 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:59:38.917607 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.918849 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.919991 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.920685 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.920767 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:38.920879 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:38.920970 (+ 91us) server_negotiation.cc:299] Negotiation successful
0811 00:59:38.921016 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":222,"thread_start_us":110,"threads_started":1}
I20260811 00:59:38.921123 14316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:38.916374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.2:33449 (local address 127.0.0.1:47218)
0811 00:59:38.916970 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:38.916980 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:38.917046 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:38.917377 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:38.917377 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:38.917379 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:59:38.917510 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:38.917513 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.918943 (+ 1430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.918944 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:38.919901 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:38.919904 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.920763 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.920764 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:38.920847 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:38.920863 (+ 16us) client_negotiation.cc:769] Sending connection context
0811 00:59:38.920948 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 00:59:38.921012 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":585,"mutex_wait_us":51,"thread_start_us":67,"threads_started":1}
I20260811 00:59:38.921629 14315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:38.916359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:33759 (local address 127.0.0.1:37864)
0811 00:59:38.916712 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:38.916770 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:38.916858 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:38.917370 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:38.917373 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:38.917376 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:59:38.917511 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:38.917514 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.918583 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.918584 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:38.919762 (+ 1178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:38.919765 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.921368 (+ 1603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.921369 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:38.921449 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:38.921453 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:59:38.921504 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 00:59:38.921550 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"mutex_wait_us":9,"thread_start_us":83,"threads_started":1}
I20260811 00:59:38.921991 14314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:38.916374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:33037 (local address 127.0.0.1:43814)
0811 00:59:38.916754 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:38.916775 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:38.917125 (+ 350us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:38.917374 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:38.917375 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:38.917378 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:59:38.917512 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:38.917513 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.919034 (+ 1521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.919035 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:38.920584 (+ 1549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:38.920586 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.921779 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.921780 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:38.921840 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:38.921843 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:59:38.921886 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 00:59:38.921925 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":360,"mutex_wait_us":864,"spinlock_wait_cycles":768,"thread_start_us":108,"threads_started":1}
I20260811 00:59:38.922045 14320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:38.916694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43814 (local address 127.15.70.3:33037)
0811 00:59:38.916961 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:38.916967 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:38.917011 (+ 44us) server_negotiation.cc:407] Connection header received
0811 00:59:38.917253 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:38.917256 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:38.917274 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:38.917356 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:59:38.917617 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.918810 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.920676 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.921709 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.921780 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:38.921874 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:38.921903 (+ 29us) server_negotiation.cc:299] Negotiation successful
0811 00:59:38.921939 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":223,"thread_start_us":121,"threads_started":1}
I20260811 00:59:38.922096 13968 tablet_service.cc:1467] Processing CreateTablet for tablet 7872607f230144b1822fe224db796cc8 (DEFAULT_TABLE table=test-table [id=2d2f700a43f04ce6aa6fc8e1fbed3c5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:59:38.922592 14318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:38.916481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37864 (local address 127.15.70.1:33759)
0811 00:59:38.917085 (+ 604us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:38.917090 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:38.917101 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:59:38.917154 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:38.917156 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:38.917176 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:38.917262 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:59:38.917616 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.918483 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.919860 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:38.920685 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:38.920767 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:38.920879 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:38.922427 (+ 1548us) server_negotiation.cc:299] Negotiation successful
0811 00:59:38.922490 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":551,"thread_start_us":157,"threads_started":1}
I20260811 00:59:38.922596 13968 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7872607f230144b1822fe224db796cc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:59:38.922705 14186 tablet_service.cc:1467] Processing CreateTablet for tablet 7872607f230144b1822fe224db796cc8 (DEFAULT_TABLE table=test-table [id=2d2f700a43f04ce6aa6fc8e1fbed3c5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:59:38.923163 14186 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7872607f230144b1822fe224db796cc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:59:38.926251 14321 tablet_bootstrap.cc:492] T 7872607f230144b1822fe224db796cc8 P bf2a467bf35148ec96f14a374e38b131: Bootstrap starting.
I20260811 00:59:38.926425 14322 tablet_bootstrap.cc:492] T 7872607f230144b1822fe224db796cc8 P 84a9d1cb61b74f43b222458b3c98ca92: Bootstrap starting.
I20260811 00:59:38.927167 14322 tablet_bootstrap.cc:654] T 7872607f230144b1822fe224db796cc8 P 84a9d1cb61b74f43b222458b3c98ca92: Neither blocks nor log segments found. Creating new log.
I20260811 00:59:38.927162 14321 tablet_bootstrap.cc:654] T 7872607f230144b1822fe224db796cc8 P bf2a467bf35148ec96f14a374e38b131: Neither blocks nor log segments found. Creating new log.
I20260811 00:59:38.927032 13758 tablet_service.cc:1467] Processing CreateTablet for tablet 7872607f230144b1822fe224db796cc8 (DEFAULT_TABLE table=test-table [id=2d2f700a43f04ce6aa6fc8e1fbed3c5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:59:38.927445 13758 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7872607f230144b1822fe224db796cc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:59:38.927584 14321 log.cc:824] T 7872607f230144b1822fe224db796cc8 P bf2a467bf35148ec96f14a374e38b131: Log is configured to *not* fsync() on all Append() calls
I20260811 00:59:38.927584 14322 log.cc:824] T 7872607f230144b1822fe224db796cc8 P 84a9d1cb61b74f43b222458b3c98ca92: Log is configured to *not* fsync() on all Append() calls
I20260811 00:59:38.928510 14322 tablet_bootstrap.cc:492] T 7872607f230144b1822fe224db796cc8 P 84a9d1cb61b74f43b222458b3c98ca92: No bootstrap required, opened a new log
I20260811 00:59:38.928748 14321 tablet_bootstrap.cc:492] T 7872607f230144b1822fe224db796cc8 P bf2a467bf35148ec96f14a374e38b131: No bootstrap required, opened a new log
I20260811 00:59:38.928820 14321 ts_tablet_manager.cc:1397] T 7872607f230144b1822fe224db796cc8 P bf2a467bf35148ec96f14a374e38b131: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260811 00:59:38.928781 14322 ts_tablet_manager.cc:1397] T 7872607f230144b1822fe224db796cc8 P 84a9d1cb61b74f43b222458b3c98ca92: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 00:59:38.930959 14322 raft_consensus.cc:348] T 7872607f230144b1822fe224db796cc8 P 84a9d1cb61b74f43b222458b3c98ca92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51ae6ad1c6d045a9a4f9274c91db3dc3" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33759 } } peers { permanent_uuid: "bf2a467bf35148ec96f14a374e38b131" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 33037 } } peers { permanent_uuid: "84a9d1cb61b74f43b222458b3c98ca92" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 33449 } }
I20260811 00:59:38.931224 14322 raft_consensus.cc:374] T 7872607f230144b1822fe224db796cc8 P 84a9d1cb61b74f43b222458b3c98ca92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:59:38.931279 14322 raft_consensus.cc:729] T 7872607f230144b1822fe224db796cc8 P 84a9d1cb61b74f43b222458b3c98ca92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84a9d1cb61b74f43b222458b3c98ca92, State: Initialized, Role: FOLLOWER
I20260811 00:59:38.931414 14322 consensus_queue.cc:260] T 7872607f230144b1822fe224db796cc8 P 84a9d1cb61b74f43b222458b3c98ca92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51ae6ad1c6d045a9a4f9274c91db3dc3" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33759 } } peers { permanent_uuid: "bf2a467bf35148ec96f14a374e38b131" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 33037 } } peers { permanent_uuid: "84a9d1cb61b74f43b222458b3c98ca92" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 33449 } }
I20260811 00:59:38.931761 14322 ts_tablet_manager.cc:1428] T 7872607f230144b1822fe224db796cc8 P 84a9d1cb61b74f43b222458b3c98ca92: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 00:59:38.931897 14326 tablet_bootstrap.cc:492] T 7872607f230144b1822fe224db796cc8 P 51ae6ad1c6d045a9a4f9274c91db3dc3: Bootstrap starting.
I20260811 00:59:38.931931 14079 heartbeater.cc:503] Master 127.15.70.62:45043 was elected leader, sending a full tablet report...
I20260811 00:59:38.931859 14321 raft_consensus.cc:348] T 7872607f230144b1822fe224db796cc8 P bf2a467bf35148ec96f14a374e38b131 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51ae6ad1c6d045a9a4f9274c91db3dc3" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33759 } } peers { permanent_uuid: "bf2a467bf35148ec96f14a374e38b131" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 33037 } } peers { permanent_uuid: "84a9d1cb61b74f43b222458b3c98ca92" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 33449 } }
I20260811 00:59:38.932014 14321 raft_consensus.cc:374] T 7872607f230144b1822fe224db796cc8 P bf2a467bf35148ec96f14a374e38b131 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:59:38.932065 14321 raft_consensus.cc:729] T 7872607f230144b1822fe224db796cc8 P bf2a467bf35148ec96f14a374e38b131 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf2a467bf35148ec96f14a374e38b131, State: Initialized, Role: FOLLOWER
I20260811 00:59:38.932179 14321 consensus_queue.cc:260] T 7872607f230144b1822fe224db796cc8 P bf2a467bf35148ec96f14a374e38b131 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51ae6ad1c6d045a9a4f9274c91db3dc3" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33759 } } peers { permanent_uuid: "bf2a467bf35148ec96f14a374e38b131" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 33037 } } peers { permanent_uuid: "84a9d1cb61b74f43b222458b3c98ca92" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 33449 } }
I20260811 00:59:38.932628 14321 ts_tablet_manager.cc:1428] T 7872607f230144b1822fe224db796cc8 P bf2a467bf35148ec96f14a374e38b131: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260811 00:59:38.932686 14295 heartbeater.cc:503] Master 127.15.70.62:45043 was elected leader, sending a full tablet report...
I20260811 00:59:38.932782 14326 tablet_bootstrap.cc:654] T 7872607f230144b1822fe224db796cc8 P 51ae6ad1c6d045a9a4f9274c91db3dc3: Neither blocks nor log segments found. Creating new log.
I20260811 00:59:38.933208 14326 log.cc:824] T 7872607f230144b1822fe224db796cc8 P 51ae6ad1c6d045a9a4f9274c91db3dc3: Log is configured to *not* fsync() on all Append() calls
I20260811 00:59:38.934098 14326 tablet_bootstrap.cc:492] T 7872607f230144b1822fe224db796cc8 P 51ae6ad1c6d045a9a4f9274c91db3dc3: No bootstrap required, opened a new log
I20260811 00:59:38.934156 14326 ts_tablet_manager.cc:1397] T 7872607f230144b1822fe224db796cc8 P 51ae6ad1c6d045a9a4f9274c91db3dc3: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 00:59:38.936278 14326 raft_consensus.cc:348] T 7872607f230144b1822fe224db796cc8 P 51ae6ad1c6d045a9a4f9274c91db3dc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51ae6ad1c6d045a9a4f9274c91db3dc3" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33759 } } peers { permanent_uuid: "bf2a467bf35148ec96f14a374e38b131" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 33037 } } peers { permanent_uuid: "84a9d1cb61b74f43b222458b3c98ca92" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 33449 } }
I20260811 00:59:38.936430 14326 raft_consensus.cc:374] T 7872607f230144b1822fe224db796cc8 P 51ae6ad1c6d045a9a4f9274c91db3dc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:59:38.936455 14326 raft_consensus.cc:729] T 7872607f230144b1822fe224db796cc8 P 51ae6ad1c6d045a9a4f9274c91db3dc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51ae6ad1c6d045a9a4f9274c91db3dc3, State: Initialized, Role: FOLLOWER
I20260811 00:59:38.936596 14326 consensus_queue.cc:260] T 7872607f230144b1822fe224db796cc8 P 51ae6ad1c6d045a9a4f9274c91db3dc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51ae6ad1c6d045a9a4f9274c91db3dc3" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33759 } } peers { permanent_uuid: "bf2a467bf35148ec96f14a374e38b131" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 33037 } } peers { permanent_uuid: "84a9d1cb61b74f43b222458b3c98ca92" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 33449 } }
I20260811 00:59:38.936923 14326 ts_tablet_manager.cc:1428] T 7872607f230144b1822fe224db796cc8 P 51ae6ad1c6d045a9a4f9274c91db3dc3: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 00:59:38.936988 13864 heartbeater.cc:503] Master 127.15.70.62:45043 was elected leader, sending a full tablet report...
W20260811 00:59:38.982702 14080 tablet.cc:2369] T 7872607f230144b1822fe224db796cc8 P 84a9d1cb61b74f43b222458b3c98ca92: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 00:59:39.086285 13867 tablet.cc:2369] T 7872607f230144b1822fe224db796cc8 P 51ae6ad1c6d045a9a4f9274c91db3dc3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 00:59:39.135998 14297 tablet.cc:2369] T 7872607f230144b1822fe224db796cc8 P bf2a467bf35148ec96f14a374e38b131: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 00:59:39.239676 14327 raft_consensus.cc:482] T 7872607f230144b1822fe224db796cc8 P 84a9d1cb61b74f43b222458b3c98ca92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:59:39.239916 14327 raft_consensus.cc:504] T 7872607f230144b1822fe224db796cc8 P 84a9d1cb61b74f43b222458b3c98ca92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51ae6ad1c6d045a9a4f9274c91db3dc3" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33759 } } peers { permanent_uuid: "bf2a467bf35148ec96f14a374e38b131" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 33037 } } peers { permanent_uuid: "84a9d1cb61b74f43b222458b3c98ca92" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 33449 } }
I20260811 00:59:39.240448 14327 leader_election.cc:288] T 7872607f230144b1822fe224db796cc8 P 84a9d1cb61b74f43b222458b3c98ca92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51ae6ad1c6d045a9a4f9274c91db3dc3 (127.15.70.1:33759), bf2a467bf35148ec96f14a374e38b131 (127.15.70.3:33037)
I20260811 00:59:39.245352 14320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:39.240918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:54763 (local address 127.15.70.3:33037)
0811 00:59:39.240979 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:39.240982 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:39.241109 (+ 127us) server_negotiation.cc:407] Connection header received
0811 00:59:39.241161 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:39.241162 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:39.241175 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:39.241267 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:59:39.241505 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:39.242409 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:39.244254 (+ 1845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:39.244862 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:39.244941 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:39.244957 (+ 16us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:39.245195 (+ 238us) server_negotiation.cc:299] Negotiation successful
0811 00:59:39.245269 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 00:59:39.245352 14318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:39.240892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:45717 (local address 127.15.70.1:33759)
0811 00:59:39.240949 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:39.240952 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:39.241111 (+ 159us) server_negotiation.cc:407] Connection header received
0811 00:59:39.241158 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:39.241159 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:39.241175 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:39.241267 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:59:39.241507 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:39.242428 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:39.244243 (+ 1815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:39.244850 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:39.244942 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:39.244957 (+ 15us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:39.245194 (+ 237us) server_negotiation.cc:299] Negotiation successful
0811 00:59:39.245259 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 00:59:39.245399 14333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:39.240743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:33037 (local address 127.15.70.2:54763)
0811 00:59:39.241009 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:39.241024 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:39.241096 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:39.241282 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:39.241283 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:39.241287 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:59:39.241408 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:39.241409 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:39.242560 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:39.242561 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:39.244117 (+ 1556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:39.244122 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:39.244989 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:39.244990 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:39.245072 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:39.245078 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 00:59:39.245145 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 00:59:39.245218 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"mutex_wait_us":194,"thread_start_us":114,"threads_started":1}
I20260811 00:59:39.245399 14332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:39.240743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:33759 (local address 127.15.70.2:45717)
0811 00:59:39.240944 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:39.240995 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:39.241087 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:39.241282 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:39.241283 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:39.241286 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:59:39.241403 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:39.241406 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:39.242560 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:39.242561 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:39.244118 (+ 1557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:39.244122 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:39.244992 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:39.244993 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:39.245070 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:39.245076 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 00:59:39.245145 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 00:59:39.245218 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"mutex_wait_us":112,"thread_start_us":78,"threads_started":1}
I20260811 00:59:39.246031 13791 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7872607f230144b1822fe224db796cc8" candidate_uuid: "84a9d1cb61b74f43b222458b3c98ca92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51ae6ad1c6d045a9a4f9274c91db3dc3" is_pre_election: true
I20260811 00:59:39.246078 14227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7872607f230144b1822fe224db796cc8" candidate_uuid: "84a9d1cb61b74f43b222458b3c98ca92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf2a467bf35148ec96f14a374e38b131" is_pre_election: true
I20260811 00:59:39.246270 13791 raft_consensus.cc:2454] T 7872607f230144b1822fe224db796cc8 P 51ae6ad1c6d045a9a4f9274c91db3dc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84a9d1cb61b74f43b222458b3c98ca92 in term 0.
I20260811 00:59:39.246270 14227 raft_consensus.cc:2454] T 7872607f230144b1822fe224db796cc8 P bf2a467bf35148ec96f14a374e38b131 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84a9d1cb61b74f43b222458b3c98ca92 in term 0.
I20260811 00:59:39.246546 13902 leader_election.cc:302] T 7872607f230144b1822fe224db796cc8 P 84a9d1cb61b74f43b222458b3c98ca92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84a9d1cb61b74f43b222458b3c98ca92, bf2a467bf35148ec96f14a374e38b131; no voters:
I20260811 00:59:39.246714 14327 raft_consensus.cc:2781] T 7872607f230144b1822fe224db796cc8 P 84a9d1cb61b74f43b222458b3c98ca92 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:59:39.246779 14327 raft_consensus.cc:482] T 7872607f230144b1822fe224db796cc8 P 84a9d1cb61b74f43b222458b3c98ca92 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:59:39.246805 14327 raft_consensus.cc:3037] T 7872607f230144b1822fe224db796cc8 P 84a9d1cb61b74f43b222458b3c98ca92 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:59:39.247822 14327 raft_consensus.cc:504] T 7872607f230144b1822fe224db796cc8 P 84a9d1cb61b74f43b222458b3c98ca92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51ae6ad1c6d045a9a4f9274c91db3dc3" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33759 } } peers { permanent_uuid: "bf2a467bf35148ec96f14a374e38b131" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 33037 } } peers { permanent_uuid: "84a9d1cb61b74f43b222458b3c98ca92" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 33449 } }
I20260811 00:59:39.248006 14327 leader_election.cc:288] T 7872607f230144b1822fe224db796cc8 P 84a9d1cb61b74f43b222458b3c98ca92 [CANDIDATE]: Term 1 election: Requested vote from peers 51ae6ad1c6d045a9a4f9274c91db3dc3 (127.15.70.1:33759), bf2a467bf35148ec96f14a374e38b131 (127.15.70.3:33037)
I20260811 00:59:39.248188 13791 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7872607f230144b1822fe224db796cc8" candidate_uuid: "84a9d1cb61b74f43b222458b3c98ca92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51ae6ad1c6d045a9a4f9274c91db3dc3"
I20260811 00:59:39.248283 13791 raft_consensus.cc:3037] T 7872607f230144b1822fe224db796cc8 P 51ae6ad1c6d045a9a4f9274c91db3dc3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:59:39.249204 13791 raft_consensus.cc:2454] T 7872607f230144b1822fe224db796cc8 P 51ae6ad1c6d045a9a4f9274c91db3dc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84a9d1cb61b74f43b222458b3c98ca92 in term 1.
I20260811 00:59:39.249352 14227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7872607f230144b1822fe224db796cc8" candidate_uuid: "84a9d1cb61b74f43b222458b3c98ca92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf2a467bf35148ec96f14a374e38b131"
I20260811 00:59:39.249413 13903 leader_election.cc:302] T 7872607f230144b1822fe224db796cc8 P 84a9d1cb61b74f43b222458b3c98ca92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51ae6ad1c6d045a9a4f9274c91db3dc3, 84a9d1cb61b74f43b222458b3c98ca92; no voters:
I20260811 00:59:39.249485 14227 raft_consensus.cc:3037] T 7872607f230144b1822fe224db796cc8 P bf2a467bf35148ec96f14a374e38b131 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:59:39.249600 14327 raft_consensus.cc:2781] T 7872607f230144b1822fe224db796cc8 P 84a9d1cb61b74f43b222458b3c98ca92 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:59:39.249822 14327 raft_consensus.cc:686] T 7872607f230144b1822fe224db796cc8 P 84a9d1cb61b74f43b222458b3c98ca92 [term 1 LEADER]: Becoming Leader. State: Replica: 84a9d1cb61b74f43b222458b3c98ca92, State: Running, Role: LEADER
I20260811 00:59:39.249948 14327 consensus_queue.cc:237] T 7872607f230144b1822fe224db796cc8 P 84a9d1cb61b74f43b222458b3c98ca92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51ae6ad1c6d045a9a4f9274c91db3dc3" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33759 } } peers { permanent_uuid: "bf2a467bf35148ec96f14a374e38b131" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 33037 } } peers { permanent_uuid: "84a9d1cb61b74f43b222458b3c98ca92" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 33449 } }
I20260811 00:59:39.250684 14227 raft_consensus.cc:2454] T 7872607f230144b1822fe224db796cc8 P bf2a467bf35148ec96f14a374e38b131 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84a9d1cb61b74f43b222458b3c98ca92 in term 1.
I20260811 00:59:39.251420 13578 catalog_manager.cc:5495] T 7872607f230144b1822fe224db796cc8 P 84a9d1cb61b74f43b222458b3c98ca92 reported cstate change: term changed from 0 to 1, leader changed from <none> to 84a9d1cb61b74f43b222458b3c98ca92 (127.15.70.2). New cstate: current_term: 1 leader_uuid: "84a9d1cb61b74f43b222458b3c98ca92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51ae6ad1c6d045a9a4f9274c91db3dc3" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf2a467bf35148ec96f14a374e38b131" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 33037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84a9d1cb61b74f43b222458b3c98ca92" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 33449 } health_report { overall_health: HEALTHY } } }
I20260811 00:59:39.279250 14319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:39.276633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47228 (local address 127.15.70.2:33449)
0811 00:59:39.276736 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:39.276738 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:39.276748 (+ 10us) server_negotiation.cc:407] Connection header received
0811 00:59:39.276806 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:39.276807 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:39.276831 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:39.276905 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:59:39.277064 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:39.277597 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:39.278392 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:39.278599 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:39.278659 (+ 60us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:39.278793 (+ 134us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:59:39.278896 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:59:39.278972 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:39.279113 (+ 141us) server_negotiation.cc:299] Negotiation successful
0811 00:59:39.279128 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 00:59:39.281627 13791 raft_consensus.cc:1261] T 7872607f230144b1822fe224db796cc8 P 51ae6ad1c6d045a9a4f9274c91db3dc3 [term 1 FOLLOWER]: Refusing update from remote peer 84a9d1cb61b74f43b222458b3c98ca92: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:59:39.281628 14227 raft_consensus.cc:1261] T 7872607f230144b1822fe224db796cc8 P bf2a467bf35148ec96f14a374e38b131 [term 1 FOLLOWER]: Refusing update from remote peer 84a9d1cb61b74f43b222458b3c98ca92: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:59:39.282140 14334 consensus_queue.cc:1035] T 7872607f230144b1822fe224db796cc8 P 84a9d1cb61b74f43b222458b3c98ca92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51ae6ad1c6d045a9a4f9274c91db3dc3" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 33759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:59:39.282300 14327 consensus_queue.cc:1035] T 7872607f230144b1822fe224db796cc8 P 84a9d1cb61b74f43b222458b3c98ca92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2a467bf35148ec96f14a374e38b131" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 33037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:59:39.285727 14339 mvcc.cc:205] Tried to move back new op lower bound from 7317135275134074880 to 7317135275008585728. Current Snapshot: MvccSnapshot[applied={T|T < 7317135275134074880}]
I20260811 00:59:39.285899 14340 mvcc.cc:205] Tried to move back new op lower bound from 7317135275134074880 to 7317135275008585728. Current Snapshot: MvccSnapshot[applied={T|T < 7317135275134074880}]
I20260811 00:59:39.288627 13579 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52834:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:59:39.288766 13579 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52834:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:59:39.289781 13579 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 45283fddfdce4b9fa76e255f8540c00d: Sending DeleteTablet for 3 replicas of tablet 7872607f230144b1822fe224db796cc8
I20260811 00:59:39.290187 13968 tablet_service.cc:1514] Processing DeleteTablet for tablet 7872607f230144b1822fe224db796cc8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:59:39 UTC) from {username='slave'} at 127.0.0.1:47218
I20260811 00:59:39.290203 13758 tablet_service.cc:1514] Processing DeleteTablet for tablet 7872607f230144b1822fe224db796cc8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:59:39 UTC) from {username='slave'} at 127.0.0.1:37864
I20260811 00:59:39.290297 14186 tablet_service.cc:1514] Processing DeleteTablet for tablet 7872607f230144b1822fe224db796cc8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:59:39 UTC) from {username='slave'} at 127.0.0.1:43814
I20260811 00:59:39.290592 14359 tablet_replica.cc:330] T 7872607f230144b1822fe224db796cc8 P bf2a467bf35148ec96f14a374e38b131: stopping tablet replica
I20260811 00:59:39.290733 14359 raft_consensus.cc:2229] T 7872607f230144b1822fe224db796cc8 P bf2a467bf35148ec96f14a374e38b131 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:59:39.290755 14356 tablet_replica.cc:330] T 7872607f230144b1822fe224db796cc8 P 84a9d1cb61b74f43b222458b3c98ca92: stopping tablet replica
I20260811 00:59:39.290879 14359 raft_consensus.cc:2258] T 7872607f230144b1822fe224db796cc8 P bf2a467bf35148ec96f14a374e38b131 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:59:39.291043 14356 raft_consensus.cc:2229] T 7872607f230144b1822fe224db796cc8 P 84a9d1cb61b74f43b222458b3c98ca92 [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:59:39.291069 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 13663
I20260811 00:59:39.291472 14359 ts_tablet_manager.cc:1905] T 7872607f230144b1822fe224db796cc8 P bf2a467bf35148ec96f14a374e38b131: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:59:39.293736 14359 ts_tablet_manager.cc:1918] T 7872607f230144b1822fe224db796cc8 P bf2a467bf35148ec96f14a374e38b131: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:59:39.293828 14359 log.cc:1196] T 7872607f230144b1822fe224db796cc8 P bf2a467bf35148ec96f14a374e38b131: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-2/wal/wals/7872607f230144b1822fe224db796cc8
I20260811 00:59:39.294140 14359 ts_tablet_manager.cc:1939] T 7872607f230144b1822fe224db796cc8 P bf2a467bf35148ec96f14a374e38b131: Deleting consensus metadata
I20260811 00:59:39.300464 13558 catalog_manager.cc:4841] TS bf2a467bf35148ec96f14a374e38b131 (127.15.70.3:33037): tablet 7872607f230144b1822fe224db796cc8 (table test-table [id=2d2f700a43f04ce6aa6fc8e1fbed3c5f]) successfully deleted
I20260811 00:59:39.302946 14356 raft_consensus.cc:2258] T 7872607f230144b1822fe224db796cc8 P 84a9d1cb61b74f43b222458b3c98ca92 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:59:39.304157 14356 ts_tablet_manager.cc:1905] T 7872607f230144b1822fe224db796cc8 P 84a9d1cb61b74f43b222458b3c98ca92: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:59:39.306375 14356 ts_tablet_manager.cc:1918] T 7872607f230144b1822fe224db796cc8 P 84a9d1cb61b74f43b222458b3c98ca92: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:59:39.306489 14356 log.cc:1196] T 7872607f230144b1822fe224db796cc8 P 84a9d1cb61b74f43b222458b3c98ca92: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409704606556-15640-0/minicluster-data/ts-1/wal/wals/7872607f230144b1822fe224db796cc8
I20260811 00:59:39.306774 14356 ts_tablet_manager.cc:1939] T 7872607f230144b1822fe224db796cc8 P 84a9d1cb61b74f43b222458b3c98ca92: Deleting consensus metadata
I20260811 00:59:39.307458 13561 catalog_manager.cc:4841] TS 84a9d1cb61b74f43b222458b3c98ca92 (127.15.70.2:33449): tablet 7872607f230144b1822fe224db796cc8 (table test-table [id=2d2f700a43f04ce6aa6fc8e1fbed3c5f]) successfully deleted
W20260811 00:59:39.313721 13560 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.70.1:33759 (error 108)
I20260811 00:59:39.314006 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 13872
I20260811 00:59:39.315128 14314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:39.314363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:33759 (local address 127.0.0.1:37866)
0811 00:59:39.314969 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:39.315067 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.1:33759: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":568}
W20260811 00:59:39.315316 13560 catalog_manager.cc:4584] TS 51ae6ad1c6d045a9a4f9274c91db3dc3 (127.15.70.1:33759): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7872607f230144b1822fe224db796cc8: Network error: Client connection negotiation failed: client connection to 127.15.70.1:33759: connect: Connection refused (error 111)
I20260811 00:59:39.336135 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 14083
I20260811 00:59:39.365559 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 13536
2026-08-11T00:59:39Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1196 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:59:39 dist-test-slave-h3ft krb5kdc[14367](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:59:39 dist-test-slave-h3ft krb5kdc[14367](info): set up 2 sockets
Aug 11 00:59:39 dist-test-slave-h3ft krb5kdc[14367](info): commencing operation
krb5kdc: starting...
W20260811 00:59:40.707975 15640 mini_kdc.cc:121] Time spent starting KDC: real 1.306s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Aug 11 00:59:40 dist-test-slave-h3ft krb5kdc[14367](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409980, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:59:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:59:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.70.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
I20260811 00:59:40.867301 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:43109
--webserver_interface=127.15.70.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:43245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:43109
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:59:40.964231 14386 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:59:40.964514 14386 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:59:40.964540 14386 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:59:40.965801 14386 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:59:40.965857 14386 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:59:40.965873 14386 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:59:40.965885 14386 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:59:40.965898 14386 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:59:40.968221 14386 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:43245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:43109
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:43109
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14386
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:59:40.968554 14386 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:59:40.968856 14386 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:59:40.974805 14395 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:40.974838 14386 server_base.cc:1034] running on GCE node
W20260811 00:59:40.974807 14393 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:40.974819 14392 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:40.975471 14386 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:59:40.975826 14386 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:59:40.977025 14386 hybrid_clock.cc:648] HybridClock initialized: now 1786409980977001 us; error 42 us; skew 500 ppm
Aug 11 00:59:40 dist-test-slave-h3ft krb5kdc[14367](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409980, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:59:40.980337 14386 init.cc:377] Logged in from keytab as kudu/127.15.70.62@KRBTEST.COM (short username kudu)
I20260811 00:59:40.980938 14386 webserver.cc:460] Webserver started at http://127.15.70.62:45385/ using document root <none> and password file <none>
I20260811 00:59:40.981227 14386 fs_manager.cc:359] Metadata directory not provided
I20260811 00:59:40.981302 14386 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:59:40.981470 14386 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:59:40.982695 14386 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "33db53e76a2b45b6b3ea74111d6a20d2"
format_stamp: "Formatted at 2026-08-11 00:59:40 on dist-test-slave-h3ft"
server_key: "c4144b8bfde1c706a6e9c8c83f953dcc"
server_key_iv: "7882bdf9a3cf92f8b6561765848b1353"
server_key_version: "encryptionkey@0"
I20260811 00:59:40.983218 14386 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "33db53e76a2b45b6b3ea74111d6a20d2"
format_stamp: "Formatted at 2026-08-11 00:59:40 on dist-test-slave-h3ft"
server_key: "c4144b8bfde1c706a6e9c8c83f953dcc"
server_key_iv: "7882bdf9a3cf92f8b6561765848b1353"
server_key_version: "encryptionkey@0"
I20260811 00:59:40.984903 14386 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 00:59:40.985769 14404 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:40.986039 14386 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:59:40.986162 14386 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "33db53e76a2b45b6b3ea74111d6a20d2"
format_stamp: "Formatted at 2026-08-11 00:59:40 on dist-test-slave-h3ft"
server_key: "c4144b8bfde1c706a6e9c8c83f953dcc"
server_key_iv: "7882bdf9a3cf92f8b6561765848b1353"
server_key_version: "encryptionkey@0"
I20260811 00:59:40.986245 14386 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:59:40.999603 14386 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:59:41.002504 14386 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:59:41.002717 14386 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:59:41.007949 14386 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:43109
I20260811 00:59:41.008009 14488 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:43109 every 8 connection(s)
I20260811 00:59:41.008500 14386 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:59:41.009739 14489 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:59:41.013227 14489 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33db53e76a2b45b6b3ea74111d6a20d2: Bootstrap starting.
I20260811 00:59:41.014165 14489 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 33db53e76a2b45b6b3ea74111d6a20d2: Neither blocks nor log segments found. Creating new log.
I20260811 00:59:41.014612 14489 log.cc:824] T 00000000000000000000000000000000 P 33db53e76a2b45b6b3ea74111d6a20d2: Log is configured to *not* fsync() on all Append() calls
I20260811 00:59:41.015439 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 14386
I20260811 00:59:41.015591 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 00:59:41.015795 14489 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33db53e76a2b45b6b3ea74111d6a20d2: No bootstrap required, opened a new log
I20260811 00:59:41.015825 15640 external_mini_cluster.cc:1428] Setting key ee3e61a1d7cbed2c8cc3e2e215bf17e6
I20260811 00:59:41.018843 14489 raft_consensus.cc:348] T 00000000000000000000000000000000 P 33db53e76a2b45b6b3ea74111d6a20d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33db53e76a2b45b6b3ea74111d6a20d2" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 43109 } }
I20260811 00:59:41.019061 14489 raft_consensus.cc:374] T 00000000000000000000000000000000 P 33db53e76a2b45b6b3ea74111d6a20d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:59:41.019119 14489 raft_consensus.cc:729] T 00000000000000000000000000000000 P 33db53e76a2b45b6b3ea74111d6a20d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33db53e76a2b45b6b3ea74111d6a20d2, State: Initialized, Role: FOLLOWER
I20260811 00:59:41.019271 14489 consensus_queue.cc:260] T 00000000000000000000000000000000 P 33db53e76a2b45b6b3ea74111d6a20d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33db53e76a2b45b6b3ea74111d6a20d2" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 43109 } }
I20260811 00:59:41.019381 14489 raft_consensus.cc:388] T 00000000000000000000000000000000 P 33db53e76a2b45b6b3ea74111d6a20d2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:59:41.019428 14489 raft_consensus.cc:482] T 00000000000000000000000000000000 P 33db53e76a2b45b6b3ea74111d6a20d2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:59:41.019488 14489 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 33db53e76a2b45b6b3ea74111d6a20d2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:59:41.020205 14489 raft_consensus.cc:504] T 00000000000000000000000000000000 P 33db53e76a2b45b6b3ea74111d6a20d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33db53e76a2b45b6b3ea74111d6a20d2" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 43109 } }
I20260811 00:59:41.020344 14489 leader_election.cc:302] T 00000000000000000000000000000000 P 33db53e76a2b45b6b3ea74111d6a20d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 33db53e76a2b45b6b3ea74111d6a20d2; no voters:
I20260811 00:59:41.020598 14489 leader_election.cc:288] T 00000000000000000000000000000000 P 33db53e76a2b45b6b3ea74111d6a20d2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:59:41.020700 14496 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 33db53e76a2b45b6b3ea74111d6a20d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:59:41.020942 14496 raft_consensus.cc:686] T 00000000000000000000000000000000 P 33db53e76a2b45b6b3ea74111d6a20d2 [term 1 LEADER]: Becoming Leader. State: Replica: 33db53e76a2b45b6b3ea74111d6a20d2, State: Running, Role: LEADER
I20260811 00:59:41.020952 14489 sys_catalog.cc:564] T 00000000000000000000000000000000 P 33db53e76a2b45b6b3ea74111d6a20d2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:59:41.021173 14496 consensus_queue.cc:237] T 00000000000000000000000000000000 P 33db53e76a2b45b6b3ea74111d6a20d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33db53e76a2b45b6b3ea74111d6a20d2" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 43109 } }
I20260811 00:59:41.021620 14498 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33db53e76a2b45b6b3ea74111d6a20d2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "33db53e76a2b45b6b3ea74111d6a20d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33db53e76a2b45b6b3ea74111d6a20d2" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 43109 } } }
I20260811 00:59:41.021696 14498 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33db53e76a2b45b6b3ea74111d6a20d2 [sys.catalog]: This master's current role is: LEADER
I20260811 00:59:41.022177 14499 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33db53e76a2b45b6b3ea74111d6a20d2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 33db53e76a2b45b6b3ea74111d6a20d2. Latest consensus state: current_term: 1 leader_uuid: "33db53e76a2b45b6b3ea74111d6a20d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33db53e76a2b45b6b3ea74111d6a20d2" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 43109 } } }
I20260811 00:59:41.022634 14499 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33db53e76a2b45b6b3ea74111d6a20d2 [sys.catalog]: This master's current role is: LEADER
W20260811 00:59:41.023540 14518 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 33db53e76a2b45b6b3ea74111d6a20d2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 00:59:41.023615 14518 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 00:59:41.023715 14502 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:59:41.023918 14502 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 00:59:41 dist-test-slave-h3ft krb5kdc[14367](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409980, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:59:41.025655 14502 catalog_manager.cc:1347] Generated new cluster ID: c8de9bd4b2b54489865897cd673a4ba7
I20260811 00:59:41.025715 14502 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:59:41.030392 14495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:41.016656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52660 (local address 127.15.70.62:43109)
0811 00:59:41.016917 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:41.016929 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:41.016966 (+ 37us) server_negotiation.cc:407] Connection header received
0811 00:59:41.017604 (+ 638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:41.017612 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:41.017671 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:41.017807 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:41.018764 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:41.020300 (+ 1536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:41.021484 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:41.022205 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:41.022339 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:41.025689 (+ 3350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:41.025694 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:41.025694 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:59:41.025709 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:41.027917 (+ 2208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:41.028321 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:41.028324 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:41.028325 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:41.028426 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:41.028597 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:41.028598 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:41.028598 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:41.028901 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:41.029433 (+ 532us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:41.030012 (+ 579us) server_negotiation.cc:299] Negotiation successful
0811 00:59:41.030174 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":169,"threads_started":1}
I20260811 00:59:41.036120 14502 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:59:41.036917 14502 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:59:41.039657 14502 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 33db53e76a2b45b6b3ea74111d6a20d2: Generated new TSK 0
I20260811 00:59:41.039848 14502 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.70.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab.
Entry for principal kudu/127.15.70.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab.
I20260811 00:59:41.079396 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.1:0
--local_ip_for_outbound_sockets=127.15.70.1
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:43109
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:43245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:59:41.183069 14527 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:59:41.183379 14527 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:59:41.183425 14527 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:59:41.184805 14527 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:59:41.184883 14527 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:59:41.184937 14527 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.1
I20260811 00:59:41.186652 14527 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:43245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.1.keytab
--principal=kudu/127.15.70.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:43109
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14527
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.1
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:59:41.186980 14527 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:59:41.187301 14527 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:59:41.194087 14540 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:41.194089 14537 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:41.194089 14534 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:41.194236 14527 server_base.cc:1034] running on GCE node
I20260811 00:59:41.194794 14527 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:59:41.195175 14527 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:59:41.196365 14527 hybrid_clock.cc:648] HybridClock initialized: now 1786409981196351 us; error 46 us; skew 500 ppm
Aug 11 00:59:41 dist-test-slave-h3ft krb5kdc[14367](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409981, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:59:41.199751 14527 init.cc:377] Logged in from keytab as kudu/127.15.70.1@KRBTEST.COM (short username kudu)
I20260811 00:59:41.200309 14527 webserver.cc:460] Webserver started at http://127.15.70.1:37539/ using document root <none> and password file <none>
I20260811 00:59:41.200536 14527 fs_manager.cc:359] Metadata directory not provided
I20260811 00:59:41.200580 14527 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:59:41.200687 14527 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:59:41.201982 14527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-0/data/instance:
uuid: "264dda355367429c811d618bfe7629a7"
format_stamp: "Formatted at 2026-08-11 00:59:41 on dist-test-slave-h3ft"
server_key: "719db0a21bee551081b726a046fc8de6"
server_key_iv: "2a463d91cf1f3bf1219483d3389bb0f8"
server_key_version: "encryptionkey@0"
I20260811 00:59:41.202337 14527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance:
uuid: "264dda355367429c811d618bfe7629a7"
format_stamp: "Formatted at 2026-08-11 00:59:41 on dist-test-slave-h3ft"
server_key: "719db0a21bee551081b726a046fc8de6"
server_key_iv: "2a463d91cf1f3bf1219483d3389bb0f8"
server_key_version: "encryptionkey@0"
I20260811 00:59:41.203990 14527 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 00:59:41.204947 14550 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:41.205256 14527 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:59:41.205358 14527 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-0/wal
uuid: "264dda355367429c811d618bfe7629a7"
format_stamp: "Formatted at 2026-08-11 00:59:41 on dist-test-slave-h3ft"
server_key: "719db0a21bee551081b726a046fc8de6"
server_key_iv: "2a463d91cf1f3bf1219483d3389bb0f8"
server_key_version: "encryptionkey@0"
I20260811 00:59:41.205423 14527 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:59:41.214164 14527 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:59:41.216991 14527 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:59:41.217273 14527 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:59:41.217604 14527 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:59:41.218060 14527 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:59:41.218106 14527 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:41.218133 14527 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:59:41.218146 14527 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:41.225956 14527 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.1:39007
I20260811 00:59:41.226109 14725 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.1:39007 every 8 connection(s)
I20260811 00:59:41.226462 14527 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
I20260811 00:59:41.228029 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 14527
I20260811 00:59:41.228180 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance
I20260811 00:59:41.228451 15640 external_mini_cluster.cc:1428] Setting key 5bb79a8831c47f3aab9d0c8a6cd6a7cc
Aug 11 00:59:41 dist-test-slave-h3ft krb5kdc[14367](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409981, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.1@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:59:41.240501 14495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:41.227549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:51881 (local address 127.15.70.62:43109)
0811 00:59:41.227664 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:41.227667 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:41.227948 (+ 281us) server_negotiation.cc:407] Connection header received
0811 00:59:41.228858 (+ 910us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:41.228860 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:41.228876 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:41.228928 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:41.230372 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:41.231101 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:41.232539 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:41.232938 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:41.233032 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:41.236360 (+ 3328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:41.236363 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:41.236363 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:59:41.236374 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:41.238520 (+ 2146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:41.239155 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:41.239157 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:41.239158 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:41.239243 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:41.239526 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:41.239527 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:41.239527 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:41.239723 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:41.239816 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:41.240202 (+ 386us) server_negotiation.cc:299] Negotiation successful
0811 00:59:41.240322 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 00:59:41.240612 14730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:41.227403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:43109 (local address 127.15.70.1:51881)
0811 00:59:41.227702 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:41.227763 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:41.228726 (+ 963us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:41.229018 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:41.229023 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:41.229913 (+ 890us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:59:41.230237 (+ 324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:41.230244 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:41.231204 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:41.231205 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:41.232430 (+ 1225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:41.232433 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:41.233073 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:41.233074 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:41.233215 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:41.234038 (+ 823us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:59:41.234051 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:59:41.236236 (+ 2185us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:59:41.238632 (+ 2396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:59:41.238641 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:59:41.238650 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:59:41.239059 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:59:41.239323 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:59:41.239324 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:59:41.239324 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:59:41.239447 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:59:41.239827 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:59:41.239836 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:59:41.240021 (+ 185us) client_negotiation.cc:769] Sending connection context
0811 00:59:41.240143 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 00:59:41.240316 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":142,"threads_started":1}
I20260811 00:59:41.241343 14726 heartbeater.cc:347] Connected to a master server at 127.15.70.62:43109
I20260811 00:59:41.241513 14726 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.15.70.2@KRBTEST.COM; defaulting to no policy
I20260811 00:59:41.241786 14726 heartbeater.cc:511] Master 127.15.70.62:43109 requested a full tablet report, sending...
I20260811 00:59:41.242654 14426 ts_manager.cc:194] Registered new tserver with Master: 264dda355367429c811d618bfe7629a7 (127.15.70.1:39007)
I20260811 00:59:41.243602 14426 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.1@KRBTEST.COM'} at 127.15.70.1:51881
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab.
Entry for principal kudu/127.15.70.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab.
I20260811 00:59:41.267525 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.2:0
--local_ip_for_outbound_sockets=127.15.70.2
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:43109
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:43245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:59:41.363794 14734 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:59:41.364075 14734 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:59:41.364102 14734 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:59:41.365377 14734 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:59:41.365430 14734 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:59:41.365460 14734 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.2
I20260811 00:59:41.367147 14734 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:43245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.2.keytab
--principal=kudu/127.15.70.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:43109
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14734
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.2
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:59:41.367455 14734 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:59:41.367761 14734 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 00:59:41.373919 14734 server_base.cc:1034] running on GCE node
W20260811 00:59:41.373896 14742 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:41.373891 14741 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:41.373891 14744 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:41.374548 14734 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:59:41.374841 14734 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:59:41.376004 14734 hybrid_clock.cc:648] HybridClock initialized: now 1786409981375972 us; error 44 us; skew 500 ppm
Aug 11 00:59:41 dist-test-slave-h3ft krb5kdc[14367](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409981, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:59:41.379367 14734 init.cc:377] Logged in from keytab as kudu/127.15.70.2@KRBTEST.COM (short username kudu)
I20260811 00:59:41.379988 14734 webserver.cc:460] Webserver started at http://127.15.70.2:42731/ using document root <none> and password file <none>
I20260811 00:59:41.380307 14734 fs_manager.cc:359] Metadata directory not provided
I20260811 00:59:41.380390 14734 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:59:41.380579 14734 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:59:41.381924 14734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-1/data/instance:
uuid: "d70a52cf41414bdaaedebbc705d2cf83"
format_stamp: "Formatted at 2026-08-11 00:59:41 on dist-test-slave-h3ft"
server_key: "2da0af20cc8c6065afb640852b124d2c"
server_key_iv: "02cfe05da8192b2a355a83fbaa83dfca"
server_key_version: "encryptionkey@0"
I20260811 00:59:41.382372 14734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance:
uuid: "d70a52cf41414bdaaedebbc705d2cf83"
format_stamp: "Formatted at 2026-08-11 00:59:41 on dist-test-slave-h3ft"
server_key: "2da0af20cc8c6065afb640852b124d2c"
server_key_iv: "02cfe05da8192b2a355a83fbaa83dfca"
server_key_version: "encryptionkey@0"
I20260811 00:59:41.384070 14734 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260811 00:59:41.385007 14754 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:41.385222 14734 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:59:41.385337 14734 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-1/wal
uuid: "d70a52cf41414bdaaedebbc705d2cf83"
format_stamp: "Formatted at 2026-08-11 00:59:41 on dist-test-slave-h3ft"
server_key: "2da0af20cc8c6065afb640852b124d2c"
server_key_iv: "02cfe05da8192b2a355a83fbaa83dfca"
server_key_version: "encryptionkey@0"
I20260811 00:59:41.385428 14734 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:59:41.405697 14734 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:59:41.408783 14734 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:59:41.408978 14734 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:59:41.409330 14734 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:59:41.409724 14734 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:59:41.409761 14734 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:41.409788 14734 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:59:41.409834 14734 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:41.416783 14734 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.2:40743
I20260811 00:59:41.416873 14920 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.2:40743 every 8 connection(s)
I20260811 00:59:41.417306 14734 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
Aug 11 00:59:41 dist-test-slave-h3ft krb5kdc[14367](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409981, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.2@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:59:41.425447 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 14734
I20260811 00:59:41.425576 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance
I20260811 00:59:41.425828 15640 external_mini_cluster.cc:1428] Setting key 078a850ae6a64a4f859c6aaf01386706
I20260811 00:59:41.429523 14495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:41.418278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:46175 (local address 127.15.70.62:43109)
0811 00:59:41.418366 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:41.418368 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:41.418639 (+ 271us) server_negotiation.cc:407] Connection header received
0811 00:59:41.419341 (+ 702us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:41.419342 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:41.419355 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:41.419424 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:41.420649 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:41.421459 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:41.422787 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:41.423132 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:41.423210 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:41.425854 (+ 2644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:41.425856 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:41.425856 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:59:41.425876 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:41.427843 (+ 1967us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:41.428344 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:41.428346 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:41.428346 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:41.428425 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:41.428691 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:41.428692 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:41.428693 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:41.428872 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:41.428950 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:41.429241 (+ 291us) server_negotiation.cc:299] Negotiation successful
0811 00:59:41.429340 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 00:59:41.429747 14928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:41.418240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:43109 (local address 127.15.70.2:46175)
0811 00:59:41.418478 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:41.418533 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:41.419236 (+ 703us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:41.419528 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:41.419532 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:41.420271 (+ 739us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:59:41.420517 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:41.420521 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:41.421553 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:41.421554 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:41.422689 (+ 1135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:41.422692 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:41.423221 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:41.423222 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:41.423344 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:41.423925 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:59:41.423935 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:59:41.425749 (+ 1814us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:59:41.427972 (+ 2223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:59:41.427980 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:59:41.427982 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:59:41.428251 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:59:41.428503 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:59:41.428504 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:59:41.428504 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:59:41.428619 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:59:41.428944 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:59:41.428950 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:59:41.429090 (+ 140us) client_negotiation.cc:769] Sending connection context
0811 00:59:41.429189 (+ 99us) client_negotiation.cc:240] Negotiation successful
0811 00:59:41.429426 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":144,"threads_started":1}
I20260811 00:59:41.430560 14926 heartbeater.cc:347] Connected to a master server at 127.15.70.62:43109
I20260811 00:59:41.430711 14926 heartbeater.cc:464] Registering TS with master...
I20260811 00:59:41.430934 14926 heartbeater.cc:511] Master 127.15.70.62:43109 requested a full tablet report, sending...
I20260811 00:59:41.431509 14426 ts_manager.cc:194] Registered new tserver with Master: d70a52cf41414bdaaedebbc705d2cf83 (127.15.70.2:40743)
I20260811 00:59:41.431974 14426 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.2@KRBTEST.COM'} at 127.15.70.2:46175
WARNING: no policy specified for kudu/127.15.70.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab.
Entry for principal kudu/127.15.70.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab.
I20260811 00:59:41.458609 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.3:0
--local_ip_for_outbound_sockets=127.15.70.3
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:43109
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:43245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:59:41.555886 14931 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:59:41.556192 14931 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:59:41.556234 14931 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:59:41.557507 14931 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:59:41.557585 14931 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:59:41.557636 14931 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.3
I20260811 00:59:41.559381 14931 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:43245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.3.keytab
--principal=kudu/127.15.70.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:43109
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14931
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.3
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:59:41.559716 14931 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:59:41.560002 14931 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:59:41.566002 14939 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:41.566077 14941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:41.566002 14938 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:41.566666 14931 server_base.cc:1034] running on GCE node
I20260811 00:59:41.566903 14931 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:59:41.567255 14931 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:59:41.568423 14931 hybrid_clock.cc:648] HybridClock initialized: now 1786409981568392 us; error 52 us; skew 500 ppm
Aug 11 00:59:41 dist-test-slave-h3ft krb5kdc[14367](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409981, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:59:41.571846 14931 init.cc:377] Logged in from keytab as kudu/127.15.70.3@KRBTEST.COM (short username kudu)
I20260811 00:59:41.572470 14931 webserver.cc:460] Webserver started at http://127.15.70.3:38539/ using document root <none> and password file <none>
I20260811 00:59:41.572772 14931 fs_manager.cc:359] Metadata directory not provided
I20260811 00:59:41.572852 14931 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:59:41.573025 14931 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:59:41.574318 14931 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-2/data/instance:
uuid: "900d58bd5a3f4e00a46442e45ff4c6ea"
format_stamp: "Formatted at 2026-08-11 00:59:41 on dist-test-slave-h3ft"
server_key: "973e7dcb48d9563230b6b28f23c77df0"
server_key_iv: "ac5385e9301381a11157ea17dc4304a1"
server_key_version: "encryptionkey@0"
I20260811 00:59:41.574759 14931 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance:
uuid: "900d58bd5a3f4e00a46442e45ff4c6ea"
format_stamp: "Formatted at 2026-08-11 00:59:41 on dist-test-slave-h3ft"
server_key: "973e7dcb48d9563230b6b28f23c77df0"
server_key_iv: "ac5385e9301381a11157ea17dc4304a1"
server_key_version: "encryptionkey@0"
I20260811 00:59:41.576474 14931 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260811 00:59:41.577350 14950 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:41.577557 14931 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:59:41.577678 14931 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-2/wal
uuid: "900d58bd5a3f4e00a46442e45ff4c6ea"
format_stamp: "Formatted at 2026-08-11 00:59:41 on dist-test-slave-h3ft"
server_key: "973e7dcb48d9563230b6b28f23c77df0"
server_key_iv: "ac5385e9301381a11157ea17dc4304a1"
server_key_version: "encryptionkey@0"
I20260811 00:59:41.577764 14931 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:59:41.588498 14931 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:59:41.591240 14931 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:59:41.591445 14931 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:59:41.591755 14931 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:59:41.592139 14931 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:59:41.592198 14931 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:41.592244 14931 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:59:41.592288 14931 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:41.599900 14931 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.3:33245
I20260811 00:59:41.600032 15140 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.3:33245 every 8 connection(s)
I20260811 00:59:41.600427 14931 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
I20260811 00:59:41.605955 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 14931
I20260811 00:59:41.606127 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance
I20260811 00:59:41.606407 15640 external_mini_cluster.cc:1428] Setting key bd1457e162f37c181a9c98a509ed57da
Aug 11 00:59:41 dist-test-slave-h3ft krb5kdc[14367](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409981, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.3@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 00:59:41.612797 14495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:41.601351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:50751 (local address 127.15.70.62:43109)
0811 00:59:41.601428 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:41.601430 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:41.601739 (+ 309us) server_negotiation.cc:407] Connection header received
0811 00:59:41.602365 (+ 626us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:41.602367 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:41.602382 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:41.602448 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:41.603701 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:41.604430 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:41.605713 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:41.606158 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:41.606263 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:41.609523 (+ 3260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:41.609525 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:41.609525 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:59:41.609541 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:41.611229 (+ 1688us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:41.611713 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:41.611715 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:41.611715 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:41.611797 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:41.612057 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:41.612057 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:41.612058 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:41.612214 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:41.612276 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:41.612608 (+ 332us) server_negotiation.cc:299] Negotiation successful
0811 00:59:41.612699 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 00:59:41.612991 15144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:41.601332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:43109 (local address 127.15.70.3:50751)
0811 00:59:41.601567 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:41.601611 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:41.602205 (+ 594us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:41.602538 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:41.602542 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:41.603325 (+ 783us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:59:41.603589 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:41.603595 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:41.604576 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:41.604577 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:41.605570 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:41.605574 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:41.606321 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:41.606323 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:41.606562 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:41.607508 (+ 946us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:59:41.607540 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:59:41.609390 (+ 1850us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:59:41.611314 (+ 1924us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:59:41.611323 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:59:41.611325 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:59:41.611623 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:59:41.611871 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:59:41.611872 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:59:41.611872 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:59:41.611994 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:59:41.612282 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:59:41.612288 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:59:41.612445 (+ 157us) client_negotiation.cc:769] Sending connection context
0811 00:59:41.612561 (+ 116us) client_negotiation.cc:240] Negotiation successful
0811 00:59:41.612737 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":108,"threads_started":1}
I20260811 00:59:41.613605 15141 heartbeater.cc:347] Connected to a master server at 127.15.70.62:43109
I20260811 00:59:41.613736 15141 heartbeater.cc:464] Registering TS with master...
I20260811 00:59:41.613981 15141 heartbeater.cc:511] Master 127.15.70.62:43109 requested a full tablet report, sending...
I20260811 00:59:41.614499 14426 ts_manager.cc:194] Registered new tserver with Master: 900d58bd5a3f4e00a46442e45ff4c6ea (127.15.70.3:33245)
I20260811 00:59:41.614985 14426 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.70.3@KRBTEST.COM'} at 127.15.70.3:50751
I20260811 00:59:41.618942 15640 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 00:59:41.628306 14495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:41.620673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52670 (local address 127.15.70.62:43109)
0811 00:59:41.620752 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:41.620755 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:41.620863 (+ 108us) server_negotiation.cc:407] Connection header received
0811 00:59:41.620937 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:41.620938 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:41.620950 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:41.620992 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:41.621743 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:41.622461 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:41.623363 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:41.623594 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:41.623678 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:41.625207 (+ 1529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:41.625208 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:41.625209 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:59:41.625217 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:41.626899 (+ 1682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:41.627377 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:41.627379 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:41.627380 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:41.627451 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:41.627680 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:41.627681 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:41.627681 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:41.627881 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:41.628009 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:41.628080 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 00:59:41.628162 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 00:59:41.630270 14426 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52670:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:59:41.632550 14426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:59:41.640195 15160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:41.635733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:33245 (local address 127.0.0.1:33042)
0811 00:59:41.636143 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:41.636155 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:41.636226 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:41.636537 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:41.636541 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:41.636544 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:59:41.636640 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:41.636643 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:41.637916 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:41.637918 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:41.639120 (+ 1202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:41.639123 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:41.639862 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:41.639862 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:41.639939 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:41.639955 (+ 16us) client_negotiation.cc:769] Sending connection context
0811 00:59:41.640031 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 00:59:41.640093 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":135,"threads_started":1}
I20260811 00:59:41.640216 15162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:41.635860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33042 (local address 127.15.70.3:33245)
0811 00:59:41.636079 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:41.636085 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:41.636339 (+ 254us) server_negotiation.cc:407] Connection header received
0811 00:59:41.636400 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:41.636403 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:41.636423 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:41.636512 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:59:41.636727 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:41.637654 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:41.639212 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:41.639783 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:41.639865 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:41.639938 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:41.640057 (+ 119us) server_negotiation.cc:299] Negotiation successful
0811 00:59:41.640110 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":131,"threads_started":1}
I20260811 00:59:41.641022 15157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:41.635727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:39007 (local address 127.0.0.1:46056)
0811 00:59:41.636650 (+ 923us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:41.636660 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:41.636715 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:41.636999 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:41.637000 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:41.637002 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:59:41.637067 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:41.637069 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:41.638415 (+ 1346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:41.638416 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:41.639708 (+ 1292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:41.639712 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:41.640734 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:41.640736 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:41.640809 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:41.640814 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 00:59:41.640885 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 00:59:41.640940 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":908,"mutex_wait_us":32,"thread_start_us":126,"threads_started":1}
I20260811 00:59:41.641076 15164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:41.636387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46056 (local address 127.15.70.1:39007)
0811 00:59:41.636625 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:41.636629 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:41.636775 (+ 146us) server_negotiation.cc:407] Connection header received
0811 00:59:41.636828 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:41.636830 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:41.636845 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:41.636916 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:59:41.637135 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:41.638278 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:41.639819 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:41.640572 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:41.640637 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:41.640688 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:41.640904 (+ 216us) server_negotiation.cc:299] Negotiation successful
0811 00:59:41.640973 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":187,"thread_start_us":126,"threads_started":1}
I20260811 00:59:41.641224 15163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:41.636106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49612 (local address 127.15.70.2:40743)
0811 00:59:41.636695 (+ 589us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:41.636700 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:41.636712 (+ 12us) server_negotiation.cc:407] Connection header received
0811 00:59:41.636754 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:41.636756 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:41.636771 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:41.636875 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:59:41.637091 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:41.638278 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:41.639819 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:41.640648 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:41.640720 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:41.640781 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:41.641064 (+ 283us) server_negotiation.cc:299] Negotiation successful
0811 00:59:41.641121 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":538,"thread_start_us":108,"threads_started":1}
I20260811 00:59:41.641464 15158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:41.635727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.2:40743 (local address 127.0.0.1:49612)
0811 00:59:41.636085 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:41.636137 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:41.636225 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:41.636925 (+ 700us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:41.636926 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:41.636928 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:59:41.636994 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:41.636996 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:41.638415 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:41.638416 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:41.639720 (+ 1304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:41.639722 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:41.640817 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:41.640818 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:41.640903 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:41.640908 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 00:59:41.640960 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 00:59:41.641007 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"mutex_wait_us":101,"thread_start_us":80,"threads_started":1}
I20260811 00:59:41.641647 15028 tablet_service.cc:1467] Processing CreateTablet for tablet 2393cb4c6b84492e932899791d277540 (DEFAULT_TABLE table=test-table [id=946f46dc4e724025aec25607d6596216]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:59:41.642174 15028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2393cb4c6b84492e932899791d277540. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:59:41.642302 14829 tablet_service.cc:1467] Processing CreateTablet for tablet 2393cb4c6b84492e932899791d277540 (DEFAULT_TABLE table=test-table [id=946f46dc4e724025aec25607d6596216]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:59:41.642653 14829 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2393cb4c6b84492e932899791d277540. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:59:41.646373 15166 tablet_bootstrap.cc:492] T 2393cb4c6b84492e932899791d277540 P d70a52cf41414bdaaedebbc705d2cf83: Bootstrap starting.
I20260811 00:59:41.646752 15165 tablet_bootstrap.cc:492] T 2393cb4c6b84492e932899791d277540 P 900d58bd5a3f4e00a46442e45ff4c6ea: Bootstrap starting.
I20260811 00:59:41.646791 14622 tablet_service.cc:1467] Processing CreateTablet for tablet 2393cb4c6b84492e932899791d277540 (DEFAULT_TABLE table=test-table [id=946f46dc4e724025aec25607d6596216]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:59:41.647233 14622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2393cb4c6b84492e932899791d277540. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:59:41.647567 15165 tablet_bootstrap.cc:654] T 2393cb4c6b84492e932899791d277540 P 900d58bd5a3f4e00a46442e45ff4c6ea: Neither blocks nor log segments found. Creating new log.
I20260811 00:59:41.647569 15166 tablet_bootstrap.cc:654] T 2393cb4c6b84492e932899791d277540 P d70a52cf41414bdaaedebbc705d2cf83: Neither blocks nor log segments found. Creating new log.
I20260811 00:59:41.648257 15165 log.cc:824] T 2393cb4c6b84492e932899791d277540 P 900d58bd5a3f4e00a46442e45ff4c6ea: Log is configured to *not* fsync() on all Append() calls
I20260811 00:59:41.648257 15166 log.cc:824] T 2393cb4c6b84492e932899791d277540 P d70a52cf41414bdaaedebbc705d2cf83: Log is configured to *not* fsync() on all Append() calls
I20260811 00:59:41.649150 15166 tablet_bootstrap.cc:492] T 2393cb4c6b84492e932899791d277540 P d70a52cf41414bdaaedebbc705d2cf83: No bootstrap required, opened a new log
I20260811 00:59:41.649184 15165 tablet_bootstrap.cc:492] T 2393cb4c6b84492e932899791d277540 P 900d58bd5a3f4e00a46442e45ff4c6ea: No bootstrap required, opened a new log
I20260811 00:59:41.649250 15166 ts_tablet_manager.cc:1397] T 2393cb4c6b84492e932899791d277540 P d70a52cf41414bdaaedebbc705d2cf83: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260811 00:59:41.649250 15165 ts_tablet_manager.cc:1397] T 2393cb4c6b84492e932899791d277540 P 900d58bd5a3f4e00a46442e45ff4c6ea: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 00:59:41.650652 15173 tablet_bootstrap.cc:492] T 2393cb4c6b84492e932899791d277540 P 264dda355367429c811d618bfe7629a7: Bootstrap starting.
I20260811 00:59:41.651391 15166 raft_consensus.cc:348] T 2393cb4c6b84492e932899791d277540 P d70a52cf41414bdaaedebbc705d2cf83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "900d58bd5a3f4e00a46442e45ff4c6ea" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 33245 } } peers { permanent_uuid: "264dda355367429c811d618bfe7629a7" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39007 } } peers { permanent_uuid: "d70a52cf41414bdaaedebbc705d2cf83" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 40743 } }
I20260811 00:59:41.651605 15173 tablet_bootstrap.cc:654] T 2393cb4c6b84492e932899791d277540 P 264dda355367429c811d618bfe7629a7: Neither blocks nor log segments found. Creating new log.
I20260811 00:59:41.651518 15165 raft_consensus.cc:348] T 2393cb4c6b84492e932899791d277540 P 900d58bd5a3f4e00a46442e45ff4c6ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "900d58bd5a3f4e00a46442e45ff4c6ea" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 33245 } } peers { permanent_uuid: "264dda355367429c811d618bfe7629a7" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39007 } } peers { permanent_uuid: "d70a52cf41414bdaaedebbc705d2cf83" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 40743 } }
I20260811 00:59:41.651656 15166 raft_consensus.cc:374] T 2393cb4c6b84492e932899791d277540 P d70a52cf41414bdaaedebbc705d2cf83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:59:41.651684 15165 raft_consensus.cc:374] T 2393cb4c6b84492e932899791d277540 P 900d58bd5a3f4e00a46442e45ff4c6ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:59:41.651697 15166 raft_consensus.cc:729] T 2393cb4c6b84492e932899791d277540 P d70a52cf41414bdaaedebbc705d2cf83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d70a52cf41414bdaaedebbc705d2cf83, State: Initialized, Role: FOLLOWER
I20260811 00:59:41.651731 15165 raft_consensus.cc:729] T 2393cb4c6b84492e932899791d277540 P 900d58bd5a3f4e00a46442e45ff4c6ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 900d58bd5a3f4e00a46442e45ff4c6ea, State: Initialized, Role: FOLLOWER
I20260811 00:59:41.651862 15165 consensus_queue.cc:260] T 2393cb4c6b84492e932899791d277540 P 900d58bd5a3f4e00a46442e45ff4c6ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "900d58bd5a3f4e00a46442e45ff4c6ea" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 33245 } } peers { permanent_uuid: "264dda355367429c811d618bfe7629a7" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39007 } } peers { permanent_uuid: "d70a52cf41414bdaaedebbc705d2cf83" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 40743 } }
I20260811 00:59:41.651909 15166 consensus_queue.cc:260] T 2393cb4c6b84492e932899791d277540 P d70a52cf41414bdaaedebbc705d2cf83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "900d58bd5a3f4e00a46442e45ff4c6ea" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 33245 } } peers { permanent_uuid: "264dda355367429c811d618bfe7629a7" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39007 } } peers { permanent_uuid: "d70a52cf41414bdaaedebbc705d2cf83" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 40743 } }
I20260811 00:59:41.652343 14926 heartbeater.cc:503] Master 127.15.70.62:43109 was elected leader, sending a full tablet report...
I20260811 00:59:41.652326 15173 log.cc:824] T 2393cb4c6b84492e932899791d277540 P 264dda355367429c811d618bfe7629a7: Log is configured to *not* fsync() on all Append() calls
I20260811 00:59:41.652736 15166 ts_tablet_manager.cc:1428] T 2393cb4c6b84492e932899791d277540 P d70a52cf41414bdaaedebbc705d2cf83: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 00:59:41.652779 15165 ts_tablet_manager.cc:1428] T 2393cb4c6b84492e932899791d277540 P 900d58bd5a3f4e00a46442e45ff4c6ea: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 00:59:41.652897 15141 heartbeater.cc:503] Master 127.15.70.62:43109 was elected leader, sending a full tablet report...
I20260811 00:59:41.653278 15173 tablet_bootstrap.cc:492] T 2393cb4c6b84492e932899791d277540 P 264dda355367429c811d618bfe7629a7: No bootstrap required, opened a new log
I20260811 00:59:41.653370 15173 ts_tablet_manager.cc:1397] T 2393cb4c6b84492e932899791d277540 P 264dda355367429c811d618bfe7629a7: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 00:59:41.655354 15173 raft_consensus.cc:348] T 2393cb4c6b84492e932899791d277540 P 264dda355367429c811d618bfe7629a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "900d58bd5a3f4e00a46442e45ff4c6ea" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 33245 } } peers { permanent_uuid: "264dda355367429c811d618bfe7629a7" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39007 } } peers { permanent_uuid: "d70a52cf41414bdaaedebbc705d2cf83" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 40743 } }
I20260811 00:59:41.655527 15173 raft_consensus.cc:374] T 2393cb4c6b84492e932899791d277540 P 264dda355367429c811d618bfe7629a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:59:41.655551 15173 raft_consensus.cc:729] T 2393cb4c6b84492e932899791d277540 P 264dda355367429c811d618bfe7629a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 264dda355367429c811d618bfe7629a7, State: Initialized, Role: FOLLOWER
I20260811 00:59:41.655690 15173 consensus_queue.cc:260] T 2393cb4c6b84492e932899791d277540 P 264dda355367429c811d618bfe7629a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "900d58bd5a3f4e00a46442e45ff4c6ea" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 33245 } } peers { permanent_uuid: "264dda355367429c811d618bfe7629a7" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39007 } } peers { permanent_uuid: "d70a52cf41414bdaaedebbc705d2cf83" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 40743 } }
I20260811 00:59:41.656013 15173 ts_tablet_manager.cc:1428] T 2393cb4c6b84492e932899791d277540 P 264dda355367429c811d618bfe7629a7: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 00:59:41.656090 14726 heartbeater.cc:503] Master 127.15.70.62:43109 was elected leader, sending a full tablet report...
I20260811 00:59:41.666294 15179 raft_consensus.cc:482] T 2393cb4c6b84492e932899791d277540 P 900d58bd5a3f4e00a46442e45ff4c6ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:59:41.666482 15179 raft_consensus.cc:504] T 2393cb4c6b84492e932899791d277540 P 900d58bd5a3f4e00a46442e45ff4c6ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "900d58bd5a3f4e00a46442e45ff4c6ea" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 33245 } } peers { permanent_uuid: "264dda355367429c811d618bfe7629a7" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39007 } } peers { permanent_uuid: "d70a52cf41414bdaaedebbc705d2cf83" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 40743 } }
I20260811 00:59:41.666926 15179 leader_election.cc:288] T 2393cb4c6b84492e932899791d277540 P 900d58bd5a3f4e00a46442e45ff4c6ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 264dda355367429c811d618bfe7629a7 (127.15.70.1:39007), d70a52cf41414bdaaedebbc705d2cf83 (127.15.70.2:40743)
W20260811 00:59:41.667985 14927 tablet.cc:2369] T 2393cb4c6b84492e932899791d277540 P d70a52cf41414bdaaedebbc705d2cf83: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 00:59:41.671181 15163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:41.667224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:59687 (local address 127.15.70.2:40743)
0811 00:59:41.667282 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:41.667285 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:41.667296 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:59:41.667333 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:41.667334 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:41.667351 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:41.667424 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:59:41.667630 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:41.668494 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:41.670096 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:41.670704 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:41.670833 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:41.670846 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:41.671054 (+ 208us) server_negotiation.cc:299] Negotiation successful
0811 00:59:41.671102 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 00:59:41.671181 15164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:41.667273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:35657 (local address 127.15.70.1:39007)
0811 00:59:41.667328 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:41.667330 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:41.667564 (+ 234us) server_negotiation.cc:407] Connection header received
0811 00:59:41.667636 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:41.667637 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:41.667653 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:41.667710 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:59:41.667828 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:41.668548 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:41.670096 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:41.670705 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:41.670815 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:41.670835 (+ 20us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:41.671054 (+ 219us) server_negotiation.cc:299] Negotiation successful
0811 00:59:41.671099 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 00:59:41.671198 15144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:41.667130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.2:40743 (local address 127.15.70.3:59687)
0811 00:59:41.667198 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:41.667213 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:41.667267 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:41.667442 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:41.667443 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:41.667446 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:59:41.667548 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:41.667551 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:41.668601 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:41.668603 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:41.670002 (+ 1399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:41.670005 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:41.670833 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:41.670834 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:41.670928 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:41.670934 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 00:59:41.671032 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 00:59:41.671081 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":49}
I20260811 00:59:41.671211 15181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:41.667150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:39007 (local address 127.15.70.3:35657)
0811 00:59:41.667477 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:41.667488 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:41.667555 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:41.667711 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:41.667712 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:41.667713 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:59:41.667765 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:41.667766 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:41.668623 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:41.668624 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:41.670001 (+ 1377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:41.670005 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:41.670817 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:41.670819 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:41.670951 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:41.670954 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:59:41.671026 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 00:59:41.671081 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"mutex_wait_us":149,"thread_start_us":164,"threads_started":1}
I20260811 00:59:41.671640 14859 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2393cb4c6b84492e932899791d277540" candidate_uuid: "900d58bd5a3f4e00a46442e45ff4c6ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d70a52cf41414bdaaedebbc705d2cf83" is_pre_election: true
I20260811 00:59:41.671844 14859 raft_consensus.cc:2454] T 2393cb4c6b84492e932899791d277540 P d70a52cf41414bdaaedebbc705d2cf83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 900d58bd5a3f4e00a46442e45ff4c6ea in term 0.
I20260811 00:59:41.671978 14657 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2393cb4c6b84492e932899791d277540" candidate_uuid: "900d58bd5a3f4e00a46442e45ff4c6ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264dda355367429c811d618bfe7629a7" is_pre_election: true
I20260811 00:59:41.672158 14657 raft_consensus.cc:2454] T 2393cb4c6b84492e932899791d277540 P 264dda355367429c811d618bfe7629a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 900d58bd5a3f4e00a46442e45ff4c6ea in term 0.
I20260811 00:59:41.672134 14951 leader_election.cc:302] T 2393cb4c6b84492e932899791d277540 P 900d58bd5a3f4e00a46442e45ff4c6ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 900d58bd5a3f4e00a46442e45ff4c6ea, d70a52cf41414bdaaedebbc705d2cf83; no voters:
I20260811 00:59:41.672348 15179 raft_consensus.cc:2781] T 2393cb4c6b84492e932899791d277540 P 900d58bd5a3f4e00a46442e45ff4c6ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:59:41.672439 15179 raft_consensus.cc:482] T 2393cb4c6b84492e932899791d277540 P 900d58bd5a3f4e00a46442e45ff4c6ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:59:41.672475 15179 raft_consensus.cc:3037] T 2393cb4c6b84492e932899791d277540 P 900d58bd5a3f4e00a46442e45ff4c6ea [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:59:41.673424 15179 raft_consensus.cc:504] T 2393cb4c6b84492e932899791d277540 P 900d58bd5a3f4e00a46442e45ff4c6ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "900d58bd5a3f4e00a46442e45ff4c6ea" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 33245 } } peers { permanent_uuid: "264dda355367429c811d618bfe7629a7" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39007 } } peers { permanent_uuid: "d70a52cf41414bdaaedebbc705d2cf83" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 40743 } }
I20260811 00:59:41.673599 15179 leader_election.cc:288] T 2393cb4c6b84492e932899791d277540 P 900d58bd5a3f4e00a46442e45ff4c6ea [CANDIDATE]: Term 1 election: Requested vote from peers 264dda355367429c811d618bfe7629a7 (127.15.70.1:39007), d70a52cf41414bdaaedebbc705d2cf83 (127.15.70.2:40743)
I20260811 00:59:41.673779 14859 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2393cb4c6b84492e932899791d277540" candidate_uuid: "900d58bd5a3f4e00a46442e45ff4c6ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d70a52cf41414bdaaedebbc705d2cf83"
I20260811 00:59:41.673848 14657 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2393cb4c6b84492e932899791d277540" candidate_uuid: "900d58bd5a3f4e00a46442e45ff4c6ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "264dda355367429c811d618bfe7629a7"
I20260811 00:59:41.673905 14859 raft_consensus.cc:3037] T 2393cb4c6b84492e932899791d277540 P d70a52cf41414bdaaedebbc705d2cf83 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:59:41.673925 14657 raft_consensus.cc:3037] T 2393cb4c6b84492e932899791d277540 P 264dda355367429c811d618bfe7629a7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:59:41.675091 14859 raft_consensus.cc:2454] T 2393cb4c6b84492e932899791d277540 P d70a52cf41414bdaaedebbc705d2cf83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 900d58bd5a3f4e00a46442e45ff4c6ea in term 1.
I20260811 00:59:41.675091 14657 raft_consensus.cc:2454] T 2393cb4c6b84492e932899791d277540 P 264dda355367429c811d618bfe7629a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 900d58bd5a3f4e00a46442e45ff4c6ea in term 1.
I20260811 00:59:41.675393 14954 leader_election.cc:302] T 2393cb4c6b84492e932899791d277540 P 900d58bd5a3f4e00a46442e45ff4c6ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 264dda355367429c811d618bfe7629a7, 900d58bd5a3f4e00a46442e45ff4c6ea; no voters:
I20260811 00:59:41.675508 15179 raft_consensus.cc:2781] T 2393cb4c6b84492e932899791d277540 P 900d58bd5a3f4e00a46442e45ff4c6ea [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:59:41.675702 15179 raft_consensus.cc:686] T 2393cb4c6b84492e932899791d277540 P 900d58bd5a3f4e00a46442e45ff4c6ea [term 1 LEADER]: Becoming Leader. State: Replica: 900d58bd5a3f4e00a46442e45ff4c6ea, State: Running, Role: LEADER
I20260811 00:59:41.675846 15179 consensus_queue.cc:237] T 2393cb4c6b84492e932899791d277540 P 900d58bd5a3f4e00a46442e45ff4c6ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "900d58bd5a3f4e00a46442e45ff4c6ea" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 33245 } } peers { permanent_uuid: "264dda355367429c811d618bfe7629a7" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39007 } } peers { permanent_uuid: "d70a52cf41414bdaaedebbc705d2cf83" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 40743 } }
I20260811 00:59:41.676934 14426 catalog_manager.cc:5495] T 2393cb4c6b84492e932899791d277540 P 900d58bd5a3f4e00a46442e45ff4c6ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 900d58bd5a3f4e00a46442e45ff4c6ea (127.15.70.3). New cstate: current_term: 1 leader_uuid: "900d58bd5a3f4e00a46442e45ff4c6ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "900d58bd5a3f4e00a46442e45ff4c6ea" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 33245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "264dda355367429c811d618bfe7629a7" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d70a52cf41414bdaaedebbc705d2cf83" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 40743 } health_report { overall_health: UNKNOWN } } }
I20260811 00:59:41.687680 15162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:41.684695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33048 (local address 127.15.70.3:33245)
0811 00:59:41.684764 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:41.684766 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:41.684776 (+ 10us) server_negotiation.cc:407] Connection header received
0811 00:59:41.684841 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:41.684842 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:41.684862 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:41.684926 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:59:41.685086 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:41.685600 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:41.686606 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:41.686804 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:41.686854 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:41.687209 (+ 355us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:59:41.687339 (+ 130us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:59:41.687424 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:41.687497 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 00:59:41.687521 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 00:59:41.690172 14657 raft_consensus.cc:1261] T 2393cb4c6b84492e932899791d277540 P 264dda355367429c811d618bfe7629a7 [term 1 FOLLOWER]: Refusing update from remote peer 900d58bd5a3f4e00a46442e45ff4c6ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:59:41.690145 14859 raft_consensus.cc:1261] T 2393cb4c6b84492e932899791d277540 P d70a52cf41414bdaaedebbc705d2cf83 [term 1 FOLLOWER]: Refusing update from remote peer 900d58bd5a3f4e00a46442e45ff4c6ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:59:41.690590 15182 consensus_queue.cc:1035] T 2393cb4c6b84492e932899791d277540 P 900d58bd5a3f4e00a46442e45ff4c6ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "264dda355367429c811d618bfe7629a7" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:59:41.690807 15179 consensus_queue.cc:1035] T 2393cb4c6b84492e932899791d277540 P 900d58bd5a3f4e00a46442e45ff4c6ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "d70a52cf41414bdaaedebbc705d2cf83" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 40743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:59:41.694482 15192 mvcc.cc:205] Tried to move back new op lower bound from 7317135284999680000 to 7317135284945125376. Current Snapshot: MvccSnapshot[applied={T|T < 7317135284999680000}]
I20260811 00:59:41.698894 14426 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52670:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:59:41.699074 14426 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52670:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:59:41.701588 14426 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 33db53e76a2b45b6b3ea74111d6a20d2: Sending DeleteTablet for 3 replicas of tablet 2393cb4c6b84492e932899791d277540
I20260811 00:59:41.702095 15028 tablet_service.cc:1514] Processing DeleteTablet for tablet 2393cb4c6b84492e932899791d277540 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:59:41 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:33042
I20260811 00:59:41.702373 14622 tablet_service.cc:1514] Processing DeleteTablet for tablet 2393cb4c6b84492e932899791d277540 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:59:41 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:46056
I20260811 00:59:41.702669 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 14527
I20260811 00:59:41.702674 14829 tablet_service.cc:1514] Processing DeleteTablet for tablet 2393cb4c6b84492e932899791d277540 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:59:41 UTC) from {username='kudu', principal='kudu/127.15.70.62@KRBTEST.COM'} at 127.0.0.1:49612
I20260811 00:59:41.721014 15203 tablet_replica.cc:330] T 2393cb4c6b84492e932899791d277540 P d70a52cf41414bdaaedebbc705d2cf83: stopping tablet replica
I20260811 00:59:41.721274 15203 raft_consensus.cc:2229] T 2393cb4c6b84492e932899791d277540 P d70a52cf41414bdaaedebbc705d2cf83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:59:41.721483 15203 raft_consensus.cc:2258] T 2393cb4c6b84492e932899791d277540 P d70a52cf41414bdaaedebbc705d2cf83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:59:41.722182 15203 ts_tablet_manager.cc:1905] T 2393cb4c6b84492e932899791d277540 P d70a52cf41414bdaaedebbc705d2cf83: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:59:41.723922 15201 tablet_replica.cc:330] T 2393cb4c6b84492e932899791d277540 P 900d58bd5a3f4e00a46442e45ff4c6ea: stopping tablet replica
I20260811 00:59:41.724129 15201 raft_consensus.cc:2229] T 2393cb4c6b84492e932899791d277540 P 900d58bd5a3f4e00a46442e45ff4c6ea [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:59:41.724360 15201 raft_consensus.cc:2258] T 2393cb4c6b84492e932899791d277540 P 900d58bd5a3f4e00a46442e45ff4c6ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:59:41.724581 15203 ts_tablet_manager.cc:1918] T 2393cb4c6b84492e932899791d277540 P d70a52cf41414bdaaedebbc705d2cf83: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:59:41.724675 15203 log.cc:1196] T 2393cb4c6b84492e932899791d277540 P d70a52cf41414bdaaedebbc705d2cf83: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-1/wal/wals/2393cb4c6b84492e932899791d277540
I20260811 00:59:41.725215 15203 ts_tablet_manager.cc:1939] T 2393cb4c6b84492e932899791d277540 P d70a52cf41414bdaaedebbc705d2cf83: Deleting consensus metadata
I20260811 00:59:41.725291 15201 ts_tablet_manager.cc:1905] T 2393cb4c6b84492e932899791d277540 P 900d58bd5a3f4e00a46442e45ff4c6ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:59:41.725937 14405 catalog_manager.cc:4841] TS d70a52cf41414bdaaedebbc705d2cf83 (127.15.70.2:40743): tablet 2393cb4c6b84492e932899791d277540 (table test-table [id=946f46dc4e724025aec25607d6596216]) successfully deleted
I20260811 00:59:41.727830 15201 ts_tablet_manager.cc:1918] T 2393cb4c6b84492e932899791d277540 P 900d58bd5a3f4e00a46442e45ff4c6ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:59:41.728006 15201 log.cc:1196] T 2393cb4c6b84492e932899791d277540 P 900d58bd5a3f4e00a46442e45ff4c6ea: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409704606556-15640-0/minicluster-data/ts-2/wal/wals/2393cb4c6b84492e932899791d277540
I20260811 00:59:41.728434 15201 ts_tablet_manager.cc:1939] T 2393cb4c6b84492e932899791d277540 P 900d58bd5a3f4e00a46442e45ff4c6ea: Deleting consensus metadata
W20260811 00:59:41.728546 14408 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.70.1:39007 (error 108)
I20260811 00:59:41.729033 14410 catalog_manager.cc:4841] TS 900d58bd5a3f4e00a46442e45ff4c6ea (127.15.70.3:33245): tablet 2393cb4c6b84492e932899791d277540 (table test-table [id=946f46dc4e724025aec25607d6596216]) successfully deleted
I20260811 00:59:41.729727 15160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:41.729546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:39007 (local address 127.0.0.1:46060)
0811 00:59:41.729607 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:41.729669 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.1:39007: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260811 00:59:41.729712 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 14734
W20260811 00:59:41.733733 14408 catalog_manager.cc:4584] TS 264dda355367429c811d618bfe7629a7 (127.15.70.1:39007): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2393cb4c6b84492e932899791d277540: Network error: Client connection negotiation failed: client connection to 127.15.70.1:39007: connect: Connection refused (error 111)
I20260811 00:59:41.747124 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 14931
I20260811 00:59:41.767620 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 14386
2026-08-11T00:59:41Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2400 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-11T00:59:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:59:41Z Disabled control of system clock
I20260811 00:59:41.813258 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:45413
--webserver_interface=127.15.70.62
--webserver_port=0
--builtin_ntp_servers=127.15.70.20:43997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:45413
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 00:59:41.914016 15213 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:59:41.914337 15213 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:59:41.914363 15213 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:59:41.915802 15213 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:59:41.915858 15213 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:59:41.915870 15213 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:59:41.915884 15213 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:59:41.915897 15213 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:59:41.917418 15213 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:43997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:45413
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:45413
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15213
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:59:41.917750 15213 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:59:41.918145 15213 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:59:41.924182 15219 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:41.924199 15221 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:41.924358 15218 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:41.924624 15213 server_base.cc:1034] running on GCE node
I20260811 00:59:41.924954 15213 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:59:41.925334 15213 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:59:41.926527 15213 hybrid_clock.cc:648] HybridClock initialized: now 1786409981926523 us; error 46 us; skew 500 ppm
I20260811 00:59:41.928155 15213 webserver.cc:460] Webserver started at http://127.15.70.62:36051/ using document root <none> and password file <none>
I20260811 00:59:41.928412 15213 fs_manager.cc:359] Metadata directory not provided
I20260811 00:59:41.928462 15213 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:59:41.928573 15213 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:59:41.929826 15213 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "a09094334b7442ca91854ed820dc95b4"
format_stamp: "Formatted at 2026-08-11 00:59:41 on dist-test-slave-h3ft"
server_key: "ea1a86f004e90ea3d212d82e2a7a01a7"
server_key_iv: "aa4b5b9b1bdf1d890ea44d107df75e5d"
server_key_version: "encryptionkey@0"
I20260811 00:59:41.930253 15213 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "a09094334b7442ca91854ed820dc95b4"
format_stamp: "Formatted at 2026-08-11 00:59:41 on dist-test-slave-h3ft"
server_key: "ea1a86f004e90ea3d212d82e2a7a01a7"
server_key_iv: "aa4b5b9b1bdf1d890ea44d107df75e5d"
server_key_version: "encryptionkey@0"
I20260811 00:59:41.931818 15213 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260811 00:59:41.932791 15231 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:41.933068 15213 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:59:41.933189 15213 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "a09094334b7442ca91854ed820dc95b4"
format_stamp: "Formatted at 2026-08-11 00:59:41 on dist-test-slave-h3ft"
server_key: "ea1a86f004e90ea3d212d82e2a7a01a7"
server_key_iv: "aa4b5b9b1bdf1d890ea44d107df75e5d"
server_key_version: "encryptionkey@0"
I20260811 00:59:41.933283 15213 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:59:41.968658 15213 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:59:41.969208 15213 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:59:41.969430 15213 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:59:41.976554 15213 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:45413
I20260811 00:59:41.976605 15318 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:45413 every 8 connection(s)
I20260811 00:59:41.977221 15213 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:59:41.978574 15320 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:59:41.979902 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 15213
I20260811 00:59:41.980046 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 00:59:41.980278 15640 external_mini_cluster.cc:1428] Setting key c030acda2ec32489f838f20400502b8d
I20260811 00:59:41.981998 15320 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a09094334b7442ca91854ed820dc95b4: Bootstrap starting.
I20260811 00:59:41.982802 15320 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a09094334b7442ca91854ed820dc95b4: Neither blocks nor log segments found. Creating new log.
I20260811 00:59:41.983179 15320 log.cc:824] T 00000000000000000000000000000000 P a09094334b7442ca91854ed820dc95b4: Log is configured to *not* fsync() on all Append() calls
I20260811 00:59:41.984035 15320 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a09094334b7442ca91854ed820dc95b4: No bootstrap required, opened a new log
I20260811 00:59:41.986894 15323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:41.981009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35434 (local address 127.15.70.62:45413)
0811 00:59:41.981242 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:41.981251 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:41.981280 (+ 29us) server_negotiation.cc:407] Connection header received
0811 00:59:41.981777 (+ 497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:41.981785 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:41.981856 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:41.982010 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:41.982299 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:41.983432 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:41.984335 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:41.985016 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:41.985166 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:41.986018 (+ 852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:41.986024 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:41.986024 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:59:41.986313 (+ 289us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:41.986371 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:59:41.986404 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:41.986489 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:41.986564 (+ 75us) server_negotiation.cc:299] Negotiation successful
0811 00:59:41.986654 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":102,"threads_started":1}
I20260811 00:59:41.986807 15320 raft_consensus.cc:348] T 00000000000000000000000000000000 P a09094334b7442ca91854ed820dc95b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a09094334b7442ca91854ed820dc95b4" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 45413 } }
I20260811 00:59:41.987030 15320 raft_consensus.cc:374] T 00000000000000000000000000000000 P a09094334b7442ca91854ed820dc95b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:59:41.987069 15320 raft_consensus.cc:729] T 00000000000000000000000000000000 P a09094334b7442ca91854ed820dc95b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09094334b7442ca91854ed820dc95b4, State: Initialized, Role: FOLLOWER
I20260811 00:59:41.987241 15320 consensus_queue.cc:260] T 00000000000000000000000000000000 P a09094334b7442ca91854ed820dc95b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a09094334b7442ca91854ed820dc95b4" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 45413 } }
I20260811 00:59:41.987339 15320 raft_consensus.cc:388] T 00000000000000000000000000000000 P a09094334b7442ca91854ed820dc95b4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:59:41.987373 15320 raft_consensus.cc:482] T 00000000000000000000000000000000 P a09094334b7442ca91854ed820dc95b4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:59:41.987427 15320 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a09094334b7442ca91854ed820dc95b4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:59:41.988088 15320 raft_consensus.cc:504] T 00000000000000000000000000000000 P a09094334b7442ca91854ed820dc95b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a09094334b7442ca91854ed820dc95b4" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 45413 } }
I20260811 00:59:41.988190 15320 leader_election.cc:302] T 00000000000000000000000000000000 P a09094334b7442ca91854ed820dc95b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a09094334b7442ca91854ed820dc95b4; no voters:
I20260811 00:59:41.988346 15320 leader_election.cc:288] T 00000000000000000000000000000000 P a09094334b7442ca91854ed820dc95b4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:59:41.988440 15325 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a09094334b7442ca91854ed820dc95b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:59:41.988616 15325 raft_consensus.cc:686] T 00000000000000000000000000000000 P a09094334b7442ca91854ed820dc95b4 [term 1 LEADER]: Becoming Leader. State: Replica: a09094334b7442ca91854ed820dc95b4, State: Running, Role: LEADER
I20260811 00:59:41.988718 15325 consensus_queue.cc:237] T 00000000000000000000000000000000 P a09094334b7442ca91854ed820dc95b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a09094334b7442ca91854ed820dc95b4" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 45413 } }
I20260811 00:59:41.988721 15320 sys_catalog.cc:564] T 00000000000000000000000000000000 P a09094334b7442ca91854ed820dc95b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:59:41.989180 15327 sys_catalog.cc:455] T 00000000000000000000000000000000 P a09094334b7442ca91854ed820dc95b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a09094334b7442ca91854ed820dc95b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a09094334b7442ca91854ed820dc95b4" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 45413 } } }
I20260811 00:59:41.989197 15329 sys_catalog.cc:455] T 00000000000000000000000000000000 P a09094334b7442ca91854ed820dc95b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a09094334b7442ca91854ed820dc95b4. Latest consensus state: current_term: 1 leader_uuid: "a09094334b7442ca91854ed820dc95b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a09094334b7442ca91854ed820dc95b4" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 45413 } } }
I20260811 00:59:41.989454 15329 sys_catalog.cc:458] T 00000000000000000000000000000000 P a09094334b7442ca91854ed820dc95b4 [sys.catalog]: This master's current role is: LEADER
I20260811 00:59:41.989434 15327 sys_catalog.cc:458] T 00000000000000000000000000000000 P a09094334b7442ca91854ed820dc95b4 [sys.catalog]: This master's current role is: LEADER
I20260811 00:59:41.990130 15340 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:59:41.990736 15340 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:59:41.992651 15340 catalog_manager.cc:1347] Generated new cluster ID: 54f349c8151c45c8ac1379ab91cbb61b
I20260811 00:59:41.992702 15340 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:59:42.025238 15340 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:59:42.026083 15340 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:59:42.030442 15340 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a09094334b7442ca91854ed820dc95b4: Generated new TSK 0
I20260811 00:59:42.030664 15340 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:59:42.035475 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.1:0
--local_ip_for_outbound_sockets=127.15.70.1
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:45413
--builtin_ntp_servers=127.15.70.20:43997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 00:59:42.135280 15352 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:59:42.135542 15352 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:59:42.135568 15352 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:59:42.136822 15352 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:59:42.136870 15352 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:59:42.136899 15352 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.1
I20260811 00:59:42.138443 15352 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:43997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.70.1
--webserver_port=0
--tserver_master_addrs=127.15.70.62:45413
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15352
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.1
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:59:42.138696 15352 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:59:42.139086 15352 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:59:42.144979 15357 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:42.144981 15358 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:42.145334 15352 server_base.cc:1034] running on GCE node
W20260811 00:59:42.144979 15360 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:42.145666 15352 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:59:42.145915 15352 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:59:42.147080 15352 hybrid_clock.cc:648] HybridClock initialized: now 1786409982147060 us; error 49 us; skew 500 ppm
I20260811 00:59:42.148648 15352 webserver.cc:460] Webserver started at http://127.15.70.1:42227/ using document root <none> and password file <none>
I20260811 00:59:42.148990 15352 fs_manager.cc:359] Metadata directory not provided
I20260811 00:59:42.149075 15352 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:59:42.149246 15352 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:59:42.150516 15352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-0/data/instance:
uuid: "9f4524f2c51a48e4aa7b854993e12814"
format_stamp: "Formatted at 2026-08-11 00:59:42 on dist-test-slave-h3ft"
server_key: "c3a070a9b039093598e54d4fcc1af856"
server_key_iv: "fd27d759ad47a673a1a637b2ac43b6c4"
server_key_version: "encryptionkey@0"
I20260811 00:59:42.150943 15352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance:
uuid: "9f4524f2c51a48e4aa7b854993e12814"
format_stamp: "Formatted at 2026-08-11 00:59:42 on dist-test-slave-h3ft"
server_key: "c3a070a9b039093598e54d4fcc1af856"
server_key_iv: "fd27d759ad47a673a1a637b2ac43b6c4"
server_key_version: "encryptionkey@0"
I20260811 00:59:42.152524 15352 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:59:42.153472 15370 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:42.153700 15352 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:59:42.153854 15352 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-0/wal
uuid: "9f4524f2c51a48e4aa7b854993e12814"
format_stamp: "Formatted at 2026-08-11 00:59:42 on dist-test-slave-h3ft"
server_key: "c3a070a9b039093598e54d4fcc1af856"
server_key_iv: "fd27d759ad47a673a1a637b2ac43b6c4"
server_key_version: "encryptionkey@0"
I20260811 00:59:42.153985 15352 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:59:42.179872 15352 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:59:42.180356 15352 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:59:42.180552 15352 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:59:42.180883 15352 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:59:42.181340 15352 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:59:42.181402 15352 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:42.181445 15352 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:59:42.181495 15352 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:42.188622 15352 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.1:39809
I20260811 00:59:42.188679 15537 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.1:39809 every 8 connection(s)
I20260811 00:59:42.189181 15352 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-0/data/info.pb
I20260811 00:59:42.193441 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 15352
I20260811 00:59:42.193547 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-0/wal/instance
I20260811 00:59:42.193809 15640 external_mini_cluster.cc:1428] Setting key e98a5a839a13231fb2cf6765e630d27c
I20260811 00:59:42.195120 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.2:0
--local_ip_for_outbound_sockets=127.15.70.2
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:45413
--builtin_ntp_servers=127.15.70.20:43997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 00:59:42.195931 15323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:42.190162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:60393 (local address 127.15.70.62:45413)
0811 00:59:42.190227 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:42.190229 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:42.190550 (+ 321us) server_negotiation.cc:407] Connection header received
0811 00:59:42.191312 (+ 762us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:42.191314 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:42.191337 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:42.191413 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:42.192276 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:42.192859 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:42.194116 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:42.194399 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:42.194492 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:42.195640 (+ 1148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:42.195642 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:42.195642 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:59:42.195648 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:42.195667 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:59:42.195672 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:42.195720 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:42.195830 (+ 110us) server_negotiation.cc:299] Negotiation successful
0811 00:59:42.195858 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 00:59:42.196297 15544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:42.190139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:45413 (local address 127.15.70.1:60393)
0811 00:59:42.190363 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:42.190413 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:42.191171 (+ 758us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:42.191500 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:42.191504 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:42.191515 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:59:42.192177 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:42.192182 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:42.192944 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:42.192945 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:42.194016 (+ 1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:42.194019 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:42.194496 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:42.194498 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:42.194662 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:42.195444 (+ 782us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:59:42.195445 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:59:42.195499 (+ 54us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:59:42.195536 (+ 37us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:59:42.195740 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:59:42.195746 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:59:42.195750 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:59:42.195823 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 00:59:42.195969 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":107,"threads_started":1}
I20260811 00:59:42.196946 15541 heartbeater.cc:347] Connected to a master server at 127.15.70.62:45413
I20260811 00:59:42.197053 15541 heartbeater.cc:464] Registering TS with master...
I20260811 00:59:42.197311 15541 heartbeater.cc:511] Master 127.15.70.62:45413 requested a full tablet report, sending...
I20260811 00:59:42.198004 15263 ts_manager.cc:194] Registered new tserver with Master: 9f4524f2c51a48e4aa7b854993e12814 (127.15.70.1:39809)
I20260811 00:59:42.198716 15263 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.70.1:60393
W20260811 00:59:42.293951 15545 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:59:42.294237 15545 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:59:42.294267 15545 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:59:42.295549 15545 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:59:42.295593 15545 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:59:42.295620 15545 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.2
I20260811 00:59:42.297101 15545 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:43997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.70.2
--webserver_port=0
--tserver_master_addrs=127.15.70.62:45413
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15545
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.2
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:59:42.297366 15545 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:59:42.297698 15545 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:59:42.304158 15555 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:42.304158 15560 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:42.304198 15556 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:42.304544 15545 server_base.cc:1034] running on GCE node
I20260811 00:59:42.304800 15545 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:59:42.305058 15545 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:59:42.306236 15545 hybrid_clock.cc:648] HybridClock initialized: now 1786409982306228 us; error 38 us; skew 500 ppm
I20260811 00:59:42.308037 15545 webserver.cc:460] Webserver started at http://127.15.70.2:39689/ using document root <none> and password file <none>
I20260811 00:59:42.308346 15545 fs_manager.cc:359] Metadata directory not provided
I20260811 00:59:42.308425 15545 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:59:42.308602 15545 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:59:42.309922 15545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-1/data/instance:
uuid: "5170d214df984ed8b319d513bb302c5f"
format_stamp: "Formatted at 2026-08-11 00:59:42 on dist-test-slave-h3ft"
server_key: "d4c48a67f90ed47caebe50379ae365cf"
server_key_iv: "02588b58483c71f49c0c3e6840c73940"
server_key_version: "encryptionkey@0"
I20260811 00:59:42.310353 15545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance:
uuid: "5170d214df984ed8b319d513bb302c5f"
format_stamp: "Formatted at 2026-08-11 00:59:42 on dist-test-slave-h3ft"
server_key: "d4c48a67f90ed47caebe50379ae365cf"
server_key_iv: "02588b58483c71f49c0c3e6840c73940"
server_key_version: "encryptionkey@0"
I20260811 00:59:42.312142 15545 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260811 00:59:42.313273 15566 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:42.313524 15545 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:59:42.313656 15545 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-1/wal
uuid: "5170d214df984ed8b319d513bb302c5f"
format_stamp: "Formatted at 2026-08-11 00:59:42 on dist-test-slave-h3ft"
server_key: "d4c48a67f90ed47caebe50379ae365cf"
server_key_iv: "02588b58483c71f49c0c3e6840c73940"
server_key_version: "encryptionkey@0"
I20260811 00:59:42.313751 15545 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:59:42.328531 15545 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:59:42.328999 15545 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:59:42.329185 15545 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:59:42.329497 15545 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:59:42.329913 15545 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:59:42.329973 15545 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:42.330014 15545 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:59:42.330063 15545 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:42.337832 15545 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.2:39241
I20260811 00:59:42.337874 15756 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.2:39241 every 8 connection(s)
I20260811 00:59:42.338325 15545 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-1/data/info.pb
I20260811 00:59:42.343695 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 15545
I20260811 00:59:42.343843 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-1/wal/instance
I20260811 00:59:42.344099 15640 external_mini_cluster.cc:1428] Setting key feeea04dd324fe5684947a1db0c94fe5
I20260811 00:59:42.345307 15323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:42.339430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.2:60935 (local address 127.15.70.62:45413)
0811 00:59:42.339505 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:42.339507 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:42.339802 (+ 295us) server_negotiation.cc:407] Connection header received
0811 00:59:42.340509 (+ 707us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:42.340510 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:42.340524 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:42.340593 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:42.341494 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:42.342079 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:42.343345 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:42.343556 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:42.343628 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:42.344964 (+ 1336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:42.344966 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:42.344967 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:59:42.344973 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:42.344995 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:59:42.345000 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:42.345055 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:42.345169 (+ 114us) server_negotiation.cc:299] Negotiation successful
0811 00:59:42.345207 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 00:59:42.345451 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.70.3:0
--local_ip_for_outbound_sockets=127.15.70.3
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:45413
--builtin_ntp_servers=127.15.70.20:43997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 00:59:42.345609 15760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:42.339419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:45413 (local address 127.15.70.2:60935)
0811 00:59:42.339637 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:42.339681 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:42.340356 (+ 675us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:42.340708 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:42.340712 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:42.340722 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:59:42.341378 (+ 656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:42.341383 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:42.342196 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:42.342197 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:42.343235 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:42.343238 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:42.343662 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:42.343663 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:42.343860 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:42.344705 (+ 845us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:59:42.344705 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:59:42.344742 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:59:42.344773 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:59:42.345067 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:59:42.345074 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:59:42.345077 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:59:42.345172 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 00:59:42.345317 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":109,"threads_started":1}
I20260811 00:59:42.346343 15757 heartbeater.cc:347] Connected to a master server at 127.15.70.62:45413
I20260811 00:59:42.346498 15757 heartbeater.cc:464] Registering TS with master...
I20260811 00:59:42.346737 15757 heartbeater.cc:511] Master 127.15.70.62:45413 requested a full tablet report, sending...
I20260811 00:59:42.347385 15263 ts_manager.cc:194] Registered new tserver with Master: 5170d214df984ed8b319d513bb302c5f (127.15.70.2:39241)
I20260811 00:59:42.347990 15263 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.70.2:60935
W20260811 00:59:42.447817 15761 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:59:42.448082 15761 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:59:42.448108 15761 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:59:42.449373 15761 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:59:42.449421 15761 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:59:42.449448 15761 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.70.3
I20260811 00:59:42.450888 15761 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:43997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.70.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.70.3
--webserver_port=0
--tserver_master_addrs=127.15.70.62:45413
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15761
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.70.3
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:59:42.451231 15761 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:59:42.451610 15761 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:59:42.457746 15777 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:42.457716 15773 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:42.457697 15774 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:42.457964 15761 server_base.cc:1034] running on GCE node
I20260811 00:59:42.458276 15761 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:59:42.458520 15761 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:59:42.459659 15761 hybrid_clock.cc:648] HybridClock initialized: now 1786409982459636 us; error 39 us; skew 500 ppm
I20260811 00:59:42.461155 15761 webserver.cc:460] Webserver started at http://127.15.70.3:43241/ using document root <none> and password file <none>
I20260811 00:59:42.461436 15761 fs_manager.cc:359] Metadata directory not provided
I20260811 00:59:42.461503 15761 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:59:42.461676 15761 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:59:42.462917 15761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-2/data/instance:
uuid: "858e3f70fce64f39b03b4a04a13d534e"
format_stamp: "Formatted at 2026-08-11 00:59:42 on dist-test-slave-h3ft"
server_key: "c2b9ee564c08e4039de1e62b1208cec9"
server_key_iv: "155ecfa642af6ea8c78ffb2ee46ae126"
server_key_version: "encryptionkey@0"
I20260811 00:59:42.463438 15761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance:
uuid: "858e3f70fce64f39b03b4a04a13d534e"
format_stamp: "Formatted at 2026-08-11 00:59:42 on dist-test-slave-h3ft"
server_key: "c2b9ee564c08e4039de1e62b1208cec9"
server_key_iv: "155ecfa642af6ea8c78ffb2ee46ae126"
server_key_version: "encryptionkey@0"
I20260811 00:59:42.465176 15761 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 00:59:42.466054 15785 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:42.466249 15761 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:59:42.466360 15761 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-2/wal
uuid: "858e3f70fce64f39b03b4a04a13d534e"
format_stamp: "Formatted at 2026-08-11 00:59:42 on dist-test-slave-h3ft"
server_key: "c2b9ee564c08e4039de1e62b1208cec9"
server_key_iv: "155ecfa642af6ea8c78ffb2ee46ae126"
server_key_version: "encryptionkey@0"
I20260811 00:59:42.466446 15761 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:59:42.479748 15761 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:59:42.480135 15761 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:59:42.480309 15761 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:59:42.480615 15761 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:59:42.481048 15761 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:59:42.481112 15761 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:42.481160 15761 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:59:42.481189 15761 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:42.488399 15761 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.3:35525
I20260811 00:59:42.488603 15954 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.3:35525 every 8 connection(s)
I20260811 00:59:42.488993 15761 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-2/data/info.pb
I20260811 00:59:42.493769 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 15761
I20260811 00:59:42.493892 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-2/wal/instance
I20260811 00:59:42.494083 15640 external_mini_cluster.cc:1428] Setting key e893c47c6622ce29b7cbcc013822e4e3
I20260811 00:59:42.495771 15323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:42.490021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.3:37317 (local address 127.15.70.62:45413)
0811 00:59:42.490117 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:42.490120 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:42.490452 (+ 332us) server_negotiation.cc:407] Connection header received
0811 00:59:42.491201 (+ 749us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:42.491204 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:42.491222 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:42.491308 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:42.492136 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:42.492713 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:42.493822 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:42.494110 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:42.494201 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:42.495499 (+ 1298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:42.495501 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:42.495501 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:59:42.495507 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:42.495526 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:59:42.495530 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:42.495575 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:42.495662 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 00:59:42.495690 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 00:59:42.496017 15960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:42.489994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:45413 (local address 127.15.70.3:37317)
0811 00:59:42.490324 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:42.490359 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:42.490957 (+ 598us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:42.491406 (+ 449us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:42.491410 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:42.491419 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:59:42.492015 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:42.492020 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:42.492816 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:42.492817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:42.493705 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:42.493709 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:42.494228 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:42.494231 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:42.494434 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:42.495320 (+ 886us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:59:42.495321 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:59:42.495364 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:59:42.495405 (+ 41us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:59:42.495585 (+ 180us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:59:42.495588 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:59:42.495591 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:59:42.495643 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 00:59:42.495750 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":101,"threads_started":1}
I20260811 00:59:42.496826 15958 heartbeater.cc:347] Connected to a master server at 127.15.70.62:45413
I20260811 00:59:42.496935 15958 heartbeater.cc:464] Registering TS with master...
I20260811 00:59:42.497188 15958 heartbeater.cc:511] Master 127.15.70.62:45413 requested a full tablet report, sending...
I20260811 00:59:42.497716 15263 ts_manager.cc:194] Registered new tserver with Master: 858e3f70fce64f39b03b4a04a13d534e (127.15.70.3:35525)
I20260811 00:59:42.498167 15263 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.70.3:37317
I20260811 00:59:42.506760 15640 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 00:59:42.512312 15323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:42.508756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35448 (local address 127.15.70.62:45413)
0811 00:59:42.508837 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:42.508839 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:42.509021 (+ 182us) server_negotiation.cc:407] Connection header received
0811 00:59:42.509054 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:42.509055 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:42.509067 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:42.509154 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:42.509433 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:42.510016 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:42.510899 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:42.511225 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:42.511290 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:42.512029 (+ 739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:42.512031 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:42.512031 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:59:42.512036 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:42.512054 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:59:42.512058 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:42.512107 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:42.512207 (+ 100us) server_negotiation.cc:299] Negotiation successful
0811 00:59:42.512232 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 00:59:42.514533 15263 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35448:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:59:42.516626 15263 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:59:42.525053 15978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:42.520334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56708 (local address 127.15.70.3:35525)
0811 00:59:42.520767 (+ 433us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:42.520774 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:42.520787 (+ 13us) server_negotiation.cc:407] Connection header received
0811 00:59:42.520834 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:42.520836 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:42.520853 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:42.520940 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:59:42.521212 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:42.522186 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:42.523741 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:42.524504 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:42.524586 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:42.524693 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:42.524876 (+ 183us) server_negotiation.cc:299] Negotiation successful
0811 00:59:42.524939 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":210,"threads_started":1}
I20260811 00:59:42.525044 15977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:42.520170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:35525 (local address 127.0.0.1:56708)
0811 00:59:42.520494 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:42.520503 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:42.520581 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:42.520974 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:42.520978 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:42.520982 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:59:42.521102 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:42.521105 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:42.522283 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:42.522285 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:42.523631 (+ 1346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:42.523635 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:42.524618 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:42.524619 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:42.524738 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:42.524754 (+ 16us) client_negotiation.cc:769] Sending connection context
0811 00:59:42.524842 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 00:59:42.524919 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":64,"threads_started":1}
I20260811 00:59:42.525254 15979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:42.520669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38164 (local address 127.15.70.2:39241)
0811 00:59:42.520888 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:42.520894 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:42.520908 (+ 14us) server_negotiation.cc:407] Connection header received
0811 00:59:42.520969 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:42.520972 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:42.520990 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:42.521122 (+ 132us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:59:42.521382 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:42.522661 (+ 1279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:42.523974 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:42.524633 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:42.524720 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:42.524836 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:42.525091 (+ 255us) server_negotiation.cc:299] Negotiation successful
0811 00:59:42.525141 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":127,"threads_started":1}
I20260811 00:59:42.525496 15974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:42.520152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.2:39241 (local address 127.0.0.1:38164)
0811 00:59:42.520360 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:42.520415 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:42.520539 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:42.521151 (+ 612us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:42.521153 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:42.521156 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:59:42.521244 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:42.521247 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:42.522776 (+ 1529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:42.522777 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:42.523870 (+ 1093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:42.523872 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:42.524881 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:42.524881 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:42.524943 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:42.524948 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 00:59:42.524998 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 00:59:42.525043 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":87,"threads_started":1}
I20260811 00:59:42.525499 15975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:42.520395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:39809 (local address 127.0.0.1:57010)
0811 00:59:42.520723 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:42.520735 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:42.520780 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:42.521580 (+ 800us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:42.521581 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:42.521584 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:59:42.521625 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:42.521627 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:42.522960 (+ 1333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:42.522961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:42.524085 (+ 1124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:42.524088 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:42.525169 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:42.525171 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:42.525246 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:42.525252 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 00:59:42.525283 (+ 31us) client_negotiation.cc:240] Negotiation successful
0811 00:59:42.525371 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":50,"threads_started":1}
I20260811 00:59:42.525903 15980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:42.520949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57010 (local address 127.15.70.1:39809)
0811 00:59:42.521378 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:42.521383 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:42.521397 (+ 14us) server_negotiation.cc:407] Connection header received
0811 00:59:42.521447 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:42.521449 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:42.521466 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:42.521775 (+ 309us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:59:42.521849 (+ 74us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:42.522874 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:42.524208 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:42.525048 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:42.525573 (+ 525us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:42.525689 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:42.525733 (+ 44us) server_negotiation.cc:299] Negotiation successful
0811 00:59:42.525788 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":162,"threads_started":1}
I20260811 00:59:42.526588 15652 tablet_service.cc:1467] Processing CreateTablet for tablet e5ac13aef472470fb406576236e31613 (DEFAULT_TABLE table=test-table [id=c2ec4d8aee5a454cb396c05c9b1f180d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:59:42.526675 15855 tablet_service.cc:1467] Processing CreateTablet for tablet e5ac13aef472470fb406576236e31613 (DEFAULT_TABLE table=test-table [id=c2ec4d8aee5a454cb396c05c9b1f180d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:59:42.527192 15855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5ac13aef472470fb406576236e31613. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:59:42.527602 15442 tablet_service.cc:1467] Processing CreateTablet for tablet e5ac13aef472470fb406576236e31613 (DEFAULT_TABLE table=test-table [id=c2ec4d8aee5a454cb396c05c9b1f180d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:59:42.528012 15442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5ac13aef472470fb406576236e31613. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:59:42.530771 15982 tablet_bootstrap.cc:492] T e5ac13aef472470fb406576236e31613 P 858e3f70fce64f39b03b4a04a13d534e: Bootstrap starting.
I20260811 00:59:42.531420 15983 tablet_bootstrap.cc:492] T e5ac13aef472470fb406576236e31613 P 9f4524f2c51a48e4aa7b854993e12814: Bootstrap starting.
I20260811 00:59:42.531519 15652 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5ac13aef472470fb406576236e31613. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:59:42.531877 15982 tablet_bootstrap.cc:654] T e5ac13aef472470fb406576236e31613 P 858e3f70fce64f39b03b4a04a13d534e: Neither blocks nor log segments found. Creating new log.
I20260811 00:59:42.532249 15982 log.cc:824] T e5ac13aef472470fb406576236e31613 P 858e3f70fce64f39b03b4a04a13d534e: Log is configured to *not* fsync() on all Append() calls
I20260811 00:59:42.532393 15983 tablet_bootstrap.cc:654] T e5ac13aef472470fb406576236e31613 P 9f4524f2c51a48e4aa7b854993e12814: Neither blocks nor log segments found. Creating new log.
I20260811 00:59:42.532907 15983 log.cc:824] T e5ac13aef472470fb406576236e31613 P 9f4524f2c51a48e4aa7b854993e12814: Log is configured to *not* fsync() on all Append() calls
I20260811 00:59:42.534031 15983 tablet_bootstrap.cc:492] T e5ac13aef472470fb406576236e31613 P 9f4524f2c51a48e4aa7b854993e12814: No bootstrap required, opened a new log
I20260811 00:59:42.534126 15983 ts_tablet_manager.cc:1397] T e5ac13aef472470fb406576236e31613 P 9f4524f2c51a48e4aa7b854993e12814: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 00:59:42.535743 15982 tablet_bootstrap.cc:492] T e5ac13aef472470fb406576236e31613 P 858e3f70fce64f39b03b4a04a13d534e: No bootstrap required, opened a new log
I20260811 00:59:42.535862 15982 ts_tablet_manager.cc:1397] T e5ac13aef472470fb406576236e31613 P 858e3f70fce64f39b03b4a04a13d534e: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260811 00:59:42.536845 15983 raft_consensus.cc:348] T e5ac13aef472470fb406576236e31613 P 9f4524f2c51a48e4aa7b854993e12814 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5170d214df984ed8b319d513bb302c5f" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39241 } } peers { permanent_uuid: "858e3f70fce64f39b03b4a04a13d534e" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35525 } } peers { permanent_uuid: "9f4524f2c51a48e4aa7b854993e12814" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39809 } }
I20260811 00:59:42.537014 15983 raft_consensus.cc:374] T e5ac13aef472470fb406576236e31613 P 9f4524f2c51a48e4aa7b854993e12814 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:59:42.537037 15983 raft_consensus.cc:729] T e5ac13aef472470fb406576236e31613 P 9f4524f2c51a48e4aa7b854993e12814 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f4524f2c51a48e4aa7b854993e12814, State: Initialized, Role: FOLLOWER
I20260811 00:59:42.537163 15983 consensus_queue.cc:260] T e5ac13aef472470fb406576236e31613 P 9f4524f2c51a48e4aa7b854993e12814 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5170d214df984ed8b319d513bb302c5f" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39241 } } peers { permanent_uuid: "858e3f70fce64f39b03b4a04a13d534e" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35525 } } peers { permanent_uuid: "9f4524f2c51a48e4aa7b854993e12814" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39809 } }
I20260811 00:59:42.537478 15983 ts_tablet_manager.cc:1428] T e5ac13aef472470fb406576236e31613 P 9f4524f2c51a48e4aa7b854993e12814: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 00:59:42.537516 15541 heartbeater.cc:503] Master 127.15.70.62:45413 was elected leader, sending a full tablet report...
I20260811 00:59:42.537775 15988 tablet_bootstrap.cc:492] T e5ac13aef472470fb406576236e31613 P 5170d214df984ed8b319d513bb302c5f: Bootstrap starting.
I20260811 00:59:42.538576 15988 tablet_bootstrap.cc:654] T e5ac13aef472470fb406576236e31613 P 5170d214df984ed8b319d513bb302c5f: Neither blocks nor log segments found. Creating new log.
I20260811 00:59:42.538954 15988 log.cc:824] T e5ac13aef472470fb406576236e31613 P 5170d214df984ed8b319d513bb302c5f: Log is configured to *not* fsync() on all Append() calls
I20260811 00:59:42.538836 15982 raft_consensus.cc:348] T e5ac13aef472470fb406576236e31613 P 858e3f70fce64f39b03b4a04a13d534e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5170d214df984ed8b319d513bb302c5f" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39241 } } peers { permanent_uuid: "858e3f70fce64f39b03b4a04a13d534e" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35525 } } peers { permanent_uuid: "9f4524f2c51a48e4aa7b854993e12814" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39809 } }
I20260811 00:59:42.539111 15982 raft_consensus.cc:374] T e5ac13aef472470fb406576236e31613 P 858e3f70fce64f39b03b4a04a13d534e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:59:42.539161 15982 raft_consensus.cc:729] T e5ac13aef472470fb406576236e31613 P 858e3f70fce64f39b03b4a04a13d534e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858e3f70fce64f39b03b4a04a13d534e, State: Initialized, Role: FOLLOWER
I20260811 00:59:42.539325 15982 consensus_queue.cc:260] T e5ac13aef472470fb406576236e31613 P 858e3f70fce64f39b03b4a04a13d534e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5170d214df984ed8b319d513bb302c5f" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39241 } } peers { permanent_uuid: "858e3f70fce64f39b03b4a04a13d534e" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35525 } } peers { permanent_uuid: "9f4524f2c51a48e4aa7b854993e12814" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39809 } }
I20260811 00:59:42.539705 15982 ts_tablet_manager.cc:1428] T e5ac13aef472470fb406576236e31613 P 858e3f70fce64f39b03b4a04a13d534e: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260811 00:59:42.539958 15958 heartbeater.cc:503] Master 127.15.70.62:45413 was elected leader, sending a full tablet report...
I20260811 00:59:42.540091 15988 tablet_bootstrap.cc:492] T e5ac13aef472470fb406576236e31613 P 5170d214df984ed8b319d513bb302c5f: No bootstrap required, opened a new log
I20260811 00:59:42.540182 15988 ts_tablet_manager.cc:1397] T e5ac13aef472470fb406576236e31613 P 5170d214df984ed8b319d513bb302c5f: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 00:59:42.542382 15988 raft_consensus.cc:348] T e5ac13aef472470fb406576236e31613 P 5170d214df984ed8b319d513bb302c5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5170d214df984ed8b319d513bb302c5f" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39241 } } peers { permanent_uuid: "858e3f70fce64f39b03b4a04a13d534e" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35525 } } peers { permanent_uuid: "9f4524f2c51a48e4aa7b854993e12814" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39809 } }
I20260811 00:59:42.542577 15988 raft_consensus.cc:374] T e5ac13aef472470fb406576236e31613 P 5170d214df984ed8b319d513bb302c5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:59:42.542624 15988 raft_consensus.cc:729] T e5ac13aef472470fb406576236e31613 P 5170d214df984ed8b319d513bb302c5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5170d214df984ed8b319d513bb302c5f, State: Initialized, Role: FOLLOWER
I20260811 00:59:42.542812 15988 consensus_queue.cc:260] T e5ac13aef472470fb406576236e31613 P 5170d214df984ed8b319d513bb302c5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5170d214df984ed8b319d513bb302c5f" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39241 } } peers { permanent_uuid: "858e3f70fce64f39b03b4a04a13d534e" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35525 } } peers { permanent_uuid: "9f4524f2c51a48e4aa7b854993e12814" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39809 } }
I20260811 00:59:42.543191 15988 ts_tablet_manager.cc:1428] T e5ac13aef472470fb406576236e31613 P 5170d214df984ed8b319d513bb302c5f: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 00:59:42.543309 15757 heartbeater.cc:503] Master 127.15.70.62:45413 was elected leader, sending a full tablet report...
W20260811 00:59:42.589020 15758 tablet.cc:2369] T e5ac13aef472470fb406576236e31613 P 5170d214df984ed8b319d513bb302c5f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 00:59:42.624975 15990 raft_consensus.cc:482] T e5ac13aef472470fb406576236e31613 P 9f4524f2c51a48e4aa7b854993e12814 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:59:42.625187 15990 raft_consensus.cc:504] T e5ac13aef472470fb406576236e31613 P 9f4524f2c51a48e4aa7b854993e12814 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5170d214df984ed8b319d513bb302c5f" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39241 } } peers { permanent_uuid: "858e3f70fce64f39b03b4a04a13d534e" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35525 } } peers { permanent_uuid: "9f4524f2c51a48e4aa7b854993e12814" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39809 } }
I20260811 00:59:42.625696 15990 leader_election.cc:288] T e5ac13aef472470fb406576236e31613 P 9f4524f2c51a48e4aa7b854993e12814 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5170d214df984ed8b319d513bb302c5f (127.15.70.2:39241), 858e3f70fce64f39b03b4a04a13d534e (127.15.70.3:35525)
I20260811 00:59:42.630389 15979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:42.626065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:44963 (local address 127.15.70.2:39241)
0811 00:59:42.626112 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:42.626115 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:42.626161 (+ 46us) server_negotiation.cc:407] Connection header received
0811 00:59:42.626286 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:42.626289 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:42.626316 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:42.626394 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:59:42.626673 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:42.627550 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:42.629196 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:42.629855 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:42.629937 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:42.629949 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:42.630235 (+ 286us) server_negotiation.cc:299] Negotiation successful
0811 00:59:42.630292 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 00:59:42.630389 15978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:42.626166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.70.1:33449 (local address 127.15.70.3:35525)
0811 00:59:42.626245 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:42.626248 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:42.626482 (+ 234us) server_negotiation.cc:407] Connection header received
0811 00:59:42.626524 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:42.626525 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:42.626537 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:42.626587 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:59:42.626833 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:42.627573 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:42.629179 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:42.629816 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:42.629917 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:42.629939 (+ 22us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:42.630235 (+ 296us) server_negotiation.cc:299] Negotiation successful
0811 00:59:42.630292 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 00:59:42.630370 15544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:42.626006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.2:39241 (local address 127.15.70.1:44963)
0811 00:59:42.626106 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:42.626119 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:42.626182 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:42.626433 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:42.626434 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:42.626436 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:59:42.626542 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:42.626544 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:42.627648 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:42.627649 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:42.629031 (+ 1382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:42.629034 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:42.629969 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:42.629970 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:42.630076 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:42.630087 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 00:59:42.630191 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 00:59:42.630236 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65,"mutex_wait_us":84}
I20260811 00:59:42.630376 15996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:42.626064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.3:35525 (local address 127.15.70.1:33449)
0811 00:59:42.626356 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:42.626366 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:59:42.626454 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:59:42.626622 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:59:42.626623 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:59:42.626624 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:59:42.626748 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:42.626749 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:42.627721 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:42.627722 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:42.629033 (+ 1311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:59:42.629034 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:59:42.629969 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:59:42.629970 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:59:42.630076 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:42.630088 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 00:59:42.630177 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 00:59:42.630233 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"mutex_wait_us":17,"thread_start_us":174,"threads_started":1}
I20260811 00:59:42.631009 15686 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ac13aef472470fb406576236e31613" candidate_uuid: "9f4524f2c51a48e4aa7b854993e12814" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5170d214df984ed8b319d513bb302c5f" is_pre_election: true
I20260811 00:59:42.631090 15886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ac13aef472470fb406576236e31613" candidate_uuid: "9f4524f2c51a48e4aa7b854993e12814" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858e3f70fce64f39b03b4a04a13d534e" is_pre_election: true
I20260811 00:59:42.631270 15686 raft_consensus.cc:2454] T e5ac13aef472470fb406576236e31613 P 5170d214df984ed8b319d513bb302c5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f4524f2c51a48e4aa7b854993e12814 in term 0.
I20260811 00:59:42.631305 15886 raft_consensus.cc:2454] T e5ac13aef472470fb406576236e31613 P 858e3f70fce64f39b03b4a04a13d534e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f4524f2c51a48e4aa7b854993e12814 in term 0.
I20260811 00:59:42.631605 15376 leader_election.cc:302] T e5ac13aef472470fb406576236e31613 P 9f4524f2c51a48e4aa7b854993e12814 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5170d214df984ed8b319d513bb302c5f, 9f4524f2c51a48e4aa7b854993e12814; no voters:
I20260811 00:59:42.631819 15990 raft_consensus.cc:2781] T e5ac13aef472470fb406576236e31613 P 9f4524f2c51a48e4aa7b854993e12814 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:59:42.631901 15990 raft_consensus.cc:482] T e5ac13aef472470fb406576236e31613 P 9f4524f2c51a48e4aa7b854993e12814 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:59:42.631928 15990 raft_consensus.cc:3037] T e5ac13aef472470fb406576236e31613 P 9f4524f2c51a48e4aa7b854993e12814 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:59:42.632721 15990 raft_consensus.cc:504] T e5ac13aef472470fb406576236e31613 P 9f4524f2c51a48e4aa7b854993e12814 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5170d214df984ed8b319d513bb302c5f" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39241 } } peers { permanent_uuid: "858e3f70fce64f39b03b4a04a13d534e" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35525 } } peers { permanent_uuid: "9f4524f2c51a48e4aa7b854993e12814" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39809 } }
I20260811 00:59:42.632901 15990 leader_election.cc:288] T e5ac13aef472470fb406576236e31613 P 9f4524f2c51a48e4aa7b854993e12814 [CANDIDATE]: Term 1 election: Requested vote from peers 5170d214df984ed8b319d513bb302c5f (127.15.70.2:39241), 858e3f70fce64f39b03b4a04a13d534e (127.15.70.3:35525)
I20260811 00:59:42.633105 15686 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ac13aef472470fb406576236e31613" candidate_uuid: "9f4524f2c51a48e4aa7b854993e12814" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5170d214df984ed8b319d513bb302c5f"
I20260811 00:59:42.633186 15886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ac13aef472470fb406576236e31613" candidate_uuid: "9f4524f2c51a48e4aa7b854993e12814" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858e3f70fce64f39b03b4a04a13d534e"
I20260811 00:59:42.633227 15686 raft_consensus.cc:3037] T e5ac13aef472470fb406576236e31613 P 5170d214df984ed8b319d513bb302c5f [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:59:42.633265 15886 raft_consensus.cc:3037] T e5ac13aef472470fb406576236e31613 P 858e3f70fce64f39b03b4a04a13d534e [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:59:42.634018 15686 raft_consensus.cc:2454] T e5ac13aef472470fb406576236e31613 P 5170d214df984ed8b319d513bb302c5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f4524f2c51a48e4aa7b854993e12814 in term 1.
I20260811 00:59:42.634270 15376 leader_election.cc:302] T e5ac13aef472470fb406576236e31613 P 9f4524f2c51a48e4aa7b854993e12814 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5170d214df984ed8b319d513bb302c5f, 9f4524f2c51a48e4aa7b854993e12814; no voters:
I20260811 00:59:42.634383 15990 raft_consensus.cc:2781] T e5ac13aef472470fb406576236e31613 P 9f4524f2c51a48e4aa7b854993e12814 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:59:42.634445 15886 raft_consensus.cc:2454] T e5ac13aef472470fb406576236e31613 P 858e3f70fce64f39b03b4a04a13d534e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f4524f2c51a48e4aa7b854993e12814 in term 1.
I20260811 00:59:42.634590 15990 raft_consensus.cc:686] T e5ac13aef472470fb406576236e31613 P 9f4524f2c51a48e4aa7b854993e12814 [term 1 LEADER]: Becoming Leader. State: Replica: 9f4524f2c51a48e4aa7b854993e12814, State: Running, Role: LEADER
I20260811 00:59:42.634719 15990 consensus_queue.cc:237] T e5ac13aef472470fb406576236e31613 P 9f4524f2c51a48e4aa7b854993e12814 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5170d214df984ed8b319d513bb302c5f" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39241 } } peers { permanent_uuid: "858e3f70fce64f39b03b4a04a13d534e" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35525 } } peers { permanent_uuid: "9f4524f2c51a48e4aa7b854993e12814" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39809 } }
I20260811 00:59:42.635794 15263 catalog_manager.cc:5495] T e5ac13aef472470fb406576236e31613 P 9f4524f2c51a48e4aa7b854993e12814 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f4524f2c51a48e4aa7b854993e12814 (127.15.70.1). New cstate: current_term: 1 leader_uuid: "9f4524f2c51a48e4aa7b854993e12814" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5170d214df984ed8b319d513bb302c5f" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "858e3f70fce64f39b03b4a04a13d534e" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f4524f2c51a48e4aa7b854993e12814" member_type: VOTER last_known_addr { host: "127.15.70.1" port: 39809 } health_report { overall_health: HEALTHY } } }
I20260811 00:59:42.645292 15980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:42.641706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57012 (local address 127.15.70.1:39809)
0811 00:59:42.641783 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:42.641785 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:42.641803 (+ 18us) server_negotiation.cc:407] Connection header received
0811 00:59:42.641891 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:42.641892 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:42.641916 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:42.641989 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:59:42.642133 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:42.642654 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:42.644044 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:42.644387 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:42.644470 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:42.644816 (+ 346us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:59:42.644940 (+ 124us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:59:42.645025 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:42.645148 (+ 123us) server_negotiation.cc:299] Negotiation successful
0811 00:59:42.645182 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 00:59:42.647799 15686 raft_consensus.cc:1261] T e5ac13aef472470fb406576236e31613 P 5170d214df984ed8b319d513bb302c5f [term 1 FOLLOWER]: Refusing update from remote peer 9f4524f2c51a48e4aa7b854993e12814: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:59:42.647886 15886 raft_consensus.cc:1261] T e5ac13aef472470fb406576236e31613 P 858e3f70fce64f39b03b4a04a13d534e [term 1 FOLLOWER]: Refusing update from remote peer 9f4524f2c51a48e4aa7b854993e12814: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:59:42.648258 15990 consensus_queue.cc:1035] T e5ac13aef472470fb406576236e31613 P 9f4524f2c51a48e4aa7b854993e12814 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5170d214df984ed8b319d513bb302c5f" member_type: VOTER last_known_addr { host: "127.15.70.2" port: 39241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:59:42.648479 15997 consensus_queue.cc:1035] T e5ac13aef472470fb406576236e31613 P 9f4524f2c51a48e4aa7b854993e12814 [LEADER]: Connected to new peer: Peer: permanent_uuid: "858e3f70fce64f39b03b4a04a13d534e" member_type: VOTER last_known_addr { host: "127.15.70.3" port: 35525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:59:42.651593 16002 mvcc.cc:205] Tried to move back new op lower bound from 7317135288920858624 to 7317135288872644608. Current Snapshot: MvccSnapshot[applied={T|T < 7317135288920858624}]
I20260811 00:59:42.652158 16003 mvcc.cc:205] Tried to move back new op lower bound from 7317135288920858624 to 7317135288872644608. Current Snapshot: MvccSnapshot[applied={T|T < 7317135288920858624}]
I20260811 00:59:42.652050 16006 mvcc.cc:205] Tried to move back new op lower bound from 7317135288920858624 to 7317135288872644608. Current Snapshot: MvccSnapshot[applied={T|T < 7317135288920858624}]
I20260811 00:59:42.654668 15263 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35448:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:59:42.654781 15263 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35448:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:59:42.656030 15263 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a09094334b7442ca91854ed820dc95b4: Sending DeleteTablet for 3 replicas of tablet e5ac13aef472470fb406576236e31613
I20260811 00:59:42.656454 15652 tablet_service.cc:1514] Processing DeleteTablet for tablet e5ac13aef472470fb406576236e31613 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:59:42 UTC) from {username='slave'} at 127.0.0.1:38164
I20260811 00:59:42.656463 15855 tablet_service.cc:1514] Processing DeleteTablet for tablet e5ac13aef472470fb406576236e31613 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:59:42 UTC) from {username='slave'} at 127.0.0.1:56708
I20260811 00:59:42.656744 16016 tablet_replica.cc:330] T e5ac13aef472470fb406576236e31613 P 5170d214df984ed8b319d513bb302c5f: stopping tablet replica
I20260811 00:59:42.656740 15442 tablet_service.cc:1514] Processing DeleteTablet for tablet e5ac13aef472470fb406576236e31613 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:59:42 UTC) from {username='slave'} at 127.0.0.1:57010
I20260811 00:59:42.656883 16016 raft_consensus.cc:2229] T e5ac13aef472470fb406576236e31613 P 5170d214df984ed8b319d513bb302c5f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:59:42.657028 16016 raft_consensus.cc:2258] T e5ac13aef472470fb406576236e31613 P 5170d214df984ed8b319d513bb302c5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:59:42.657063 16020 tablet_replica.cc:330] T e5ac13aef472470fb406576236e31613 P 9f4524f2c51a48e4aa7b854993e12814: stopping tablet replica
I20260811 00:59:42.657326 16020 raft_consensus.cc:2229] T e5ac13aef472470fb406576236e31613 P 9f4524f2c51a48e4aa7b854993e12814 [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:59:42.657390 16019 tablet_replica.cc:330] T e5ac13aef472470fb406576236e31613 P 858e3f70fce64f39b03b4a04a13d534e: stopping tablet replica
I20260811 00:59:42.657507 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 15352
I20260811 00:59:42.657536 16019 raft_consensus.cc:2229] T e5ac13aef472470fb406576236e31613 P 858e3f70fce64f39b03b4a04a13d534e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:59:42.657630 16020 raft_consensus.cc:2258] T e5ac13aef472470fb406576236e31613 P 9f4524f2c51a48e4aa7b854993e12814 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:59:42.657647 16019 raft_consensus.cc:2258] T e5ac13aef472470fb406576236e31613 P 858e3f70fce64f39b03b4a04a13d534e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:59:42.662079 16019 ts_tablet_manager.cc:1905] T e5ac13aef472470fb406576236e31613 P 858e3f70fce64f39b03b4a04a13d534e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:59:42.664824 16019 ts_tablet_manager.cc:1918] T e5ac13aef472470fb406576236e31613 P 858e3f70fce64f39b03b4a04a13d534e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:59:42.664925 16019 log.cc:1196] T e5ac13aef472470fb406576236e31613 P 858e3f70fce64f39b03b4a04a13d534e: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-2/wal/wals/e5ac13aef472470fb406576236e31613
I20260811 00:59:42.665175 16019 ts_tablet_manager.cc:1939] T e5ac13aef472470fb406576236e31613 P 858e3f70fce64f39b03b4a04a13d534e: Deleting consensus metadata
I20260811 00:59:42.665791 15238 catalog_manager.cc:4841] TS 858e3f70fce64f39b03b4a04a13d534e (127.15.70.3:35525): tablet e5ac13aef472470fb406576236e31613 (table test-table [id=c2ec4d8aee5a454cb396c05c9b1f180d]) successfully deleted
I20260811 00:59:42.668534 16016 ts_tablet_manager.cc:1905] T e5ac13aef472470fb406576236e31613 P 5170d214df984ed8b319d513bb302c5f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:59:42.671159 16016 ts_tablet_manager.cc:1918] T e5ac13aef472470fb406576236e31613 P 5170d214df984ed8b319d513bb302c5f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:59:42.671273 16016 log.cc:1196] T e5ac13aef472470fb406576236e31613 P 5170d214df984ed8b319d513bb302c5f: Deleting WAL directory at /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409704606556-15640-0/minicluster-data/ts-1/wal/wals/e5ac13aef472470fb406576236e31613
I20260811 00:59:42.671537 16016 ts_tablet_manager.cc:1939] T e5ac13aef472470fb406576236e31613 P 5170d214df984ed8b319d513bb302c5f: Deleting consensus metadata
I20260811 00:59:42.672152 15239 catalog_manager.cc:4841] TS 5170d214df984ed8b319d513bb302c5f (127.15.70.2:39241): tablet e5ac13aef472470fb406576236e31613 (table test-table [id=c2ec4d8aee5a454cb396c05c9b1f180d]) successfully deleted
W20260811 00:59:42.684906 15238 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.70.1:39809 (error 108)
I20260811 00:59:42.685762 15974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:42.685567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.1:39809 (local address 127.0.0.1:57028)
0811 00:59:42.685668 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0811 00:59:42.685723 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.1:39809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260811 00:59:42.685765 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 15545
W20260811 00:59:42.685925 15238 catalog_manager.cc:4584] TS 9f4524f2c51a48e4aa7b854993e12814 (127.15.70.1:39809): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e5ac13aef472470fb406576236e31613: Network error: Client connection negotiation failed: client connection to 127.15.70.1:39809: connect: Connection refused (error 111)
I20260811 00:59:42.725046 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 15761
I20260811 00:59:42.738327 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 15213
2026-08-11T00:59:42Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (967 ms)
[----------] 6 tests from EncryptionPolicyTest (10389 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409704606556-15640-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:59:42 dist-test-slave-h3ft krb5kdc[16026](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:59:42 dist-test-slave-h3ft krb5kdc[16026](info): set up 2 sockets
Aug 11 00:59:42 dist-test-slave-h3ft krb5kdc[16026](info): commencing operation
krb5kdc: starting...
W20260811 00:59:44.079746 15640 mini_kdc.cc:121] Time spent starting KDC: real 1.310s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Aug 11 00:59:44 dist-test-slave-h3ft krb5kdc[16026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409984, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:59:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:59:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 00:59:44.231329 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41805
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43965
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41805
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:59:44.328052 16043 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:59:44.328378 16043 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:59:44.328430 16043 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:59:44.329687 16043 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:59:44.329769 16043 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:59:44.329795 16043 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:59:44.329818 16043 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:59:44.329846 16043 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:59:44.331487 16043 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43965
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41805
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41805
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16043
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:59:44.331808 16043 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:59:44.332093 16043 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:59:44.338011 16052 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:44.338032 16055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:44.338023 16053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:44.338326 16043 server_base.cc:1034] running on GCE node
I20260811 00:59:44.338668 16043 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:59:44.339138 16043 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:59:44.340301 16043 hybrid_clock.cc:648] HybridClock initialized: now 1786409984340282 us; error 45 us; skew 500 ppm
Aug 11 00:59:44 dist-test-slave-h3ft krb5kdc[16026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409984, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:59:44.343474 16043 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 00:59:44.344151 16043 webserver.cc:460] Webserver started at http://127.0.0.1:44447/ using document root <none> and password file <none>
I20260811 00:59:44.344441 16043 fs_manager.cc:359] Metadata directory not provided
I20260811 00:59:44.344523 16043 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:59:44.344704 16043 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:59:44.346168 16043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "51e1148e9a6843608c72d6aa5b15350c"
format_stamp: "Formatted at 2026-08-11 00:59:44 on dist-test-slave-h3ft"
server_key: "a9ded14d9af6336c3b03d18539a30218"
server_key_iv: "58eb8e1648179e3afaf1f2625d242032"
server_key_version: "encryptionkey@0"
I20260811 00:59:44.346623 16043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "51e1148e9a6843608c72d6aa5b15350c"
format_stamp: "Formatted at 2026-08-11 00:59:44 on dist-test-slave-h3ft"
server_key: "a9ded14d9af6336c3b03d18539a30218"
server_key_iv: "58eb8e1648179e3afaf1f2625d242032"
server_key_version: "encryptionkey@0"
I20260811 00:59:44.348407 16043 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260811 00:59:44.349349 16064 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:44.349592 16043 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:59:44.349738 16043 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "51e1148e9a6843608c72d6aa5b15350c"
format_stamp: "Formatted at 2026-08-11 00:59:44 on dist-test-slave-h3ft"
server_key: "a9ded14d9af6336c3b03d18539a30218"
server_key_iv: "58eb8e1648179e3afaf1f2625d242032"
server_key_version: "encryptionkey@0"
I20260811 00:59:44.349848 16043 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:59:44.372566 16043 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:59:44.375169 16043 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:59:44.375365 16043 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:59:44.381019 16043 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41805
I20260811 00:59:44.381085 16155 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41805 every 8 connection(s)
I20260811 00:59:44.381546 16043 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:59:44.382678 16156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:59:44.385421 16156 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51e1148e9a6843608c72d6aa5b15350c: Bootstrap starting.
I20260811 00:59:44.386092 16156 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 51e1148e9a6843608c72d6aa5b15350c: Neither blocks nor log segments found. Creating new log.
I20260811 00:59:44.386394 16156 log.cc:824] T 00000000000000000000000000000000 P 51e1148e9a6843608c72d6aa5b15350c: Log is configured to *not* fsync() on all Append() calls
I20260811 00:59:44.387344 16156 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51e1148e9a6843608c72d6aa5b15350c: No bootstrap required, opened a new log
I20260811 00:59:44.389153 16156 raft_consensus.cc:348] T 00000000000000000000000000000000 P 51e1148e9a6843608c72d6aa5b15350c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51e1148e9a6843608c72d6aa5b15350c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41805 } }
I20260811 00:59:44.389323 16156 raft_consensus.cc:374] T 00000000000000000000000000000000 P 51e1148e9a6843608c72d6aa5b15350c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:59:44.389377 16156 raft_consensus.cc:729] T 00000000000000000000000000000000 P 51e1148e9a6843608c72d6aa5b15350c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e1148e9a6843608c72d6aa5b15350c, State: Initialized, Role: FOLLOWER
I20260811 00:59:44.389561 16156 consensus_queue.cc:260] T 00000000000000000000000000000000 P 51e1148e9a6843608c72d6aa5b15350c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51e1148e9a6843608c72d6aa5b15350c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41805 } }
I20260811 00:59:44.389667 16156 raft_consensus.cc:388] T 00000000000000000000000000000000 P 51e1148e9a6843608c72d6aa5b15350c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:59:44.389647 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 16043
I20260811 00:59:44.389703 16156 raft_consensus.cc:482] T 00000000000000000000000000000000 P 51e1148e9a6843608c72d6aa5b15350c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:59:44.389765 16156 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 51e1148e9a6843608c72d6aa5b15350c [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:59:44.389775 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 00:59:44.390007 15640 external_mini_cluster.cc:1428] Setting key 83f4fb67b0dc19461129fbaf13892832
I20260811 00:59:44.390610 16156 raft_consensus.cc:504] T 00000000000000000000000000000000 P 51e1148e9a6843608c72d6aa5b15350c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51e1148e9a6843608c72d6aa5b15350c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41805 } }
I20260811 00:59:44.390772 16156 leader_election.cc:302] T 00000000000000000000000000000000 P 51e1148e9a6843608c72d6aa5b15350c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 51e1148e9a6843608c72d6aa5b15350c; no voters:
I20260811 00:59:44.391045 16156 leader_election.cc:288] T 00000000000000000000000000000000 P 51e1148e9a6843608c72d6aa5b15350c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:59:44.391067 16163 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 51e1148e9a6843608c72d6aa5b15350c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:59:44.391304 16163 raft_consensus.cc:686] T 00000000000000000000000000000000 P 51e1148e9a6843608c72d6aa5b15350c [term 1 LEADER]: Becoming Leader. State: Replica: 51e1148e9a6843608c72d6aa5b15350c, State: Running, Role: LEADER
I20260811 00:59:44.391356 16156 sys_catalog.cc:564] T 00000000000000000000000000000000 P 51e1148e9a6843608c72d6aa5b15350c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:59:44.391494 16163 consensus_queue.cc:237] T 00000000000000000000000000000000 P 51e1148e9a6843608c72d6aa5b15350c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51e1148e9a6843608c72d6aa5b15350c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41805 } }
I20260811 00:59:44.392215 16165 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51e1148e9a6843608c72d6aa5b15350c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "51e1148e9a6843608c72d6aa5b15350c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51e1148e9a6843608c72d6aa5b15350c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41805 } } }
I20260811 00:59:44.392310 16165 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51e1148e9a6843608c72d6aa5b15350c [sys.catalog]: This master's current role is: LEADER
I20260811 00:59:44.392550 16166 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51e1148e9a6843608c72d6aa5b15350c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 51e1148e9a6843608c72d6aa5b15350c. Latest consensus state: current_term: 1 leader_uuid: "51e1148e9a6843608c72d6aa5b15350c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51e1148e9a6843608c72d6aa5b15350c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41805 } } }
I20260811 00:59:44.392795 16166 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51e1148e9a6843608c72d6aa5b15350c [sys.catalog]: This master's current role is: LEADER
I20260811 00:59:44.393005 16185 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:59:44.393635 16185 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:59:44.395534 16185 catalog_manager.cc:1347] Generated new cluster ID: 4430173c9a304ca7bf2a4815268dea3f
I20260811 00:59:44.395592 16185 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 00:59:44 dist-test-slave-h3ft krb5kdc[16026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409984, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 00:59:44.404173 16162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:44.390650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55425 (local address 127.0.0.1:41805)
0811 00:59:44.390868 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:44.390880 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:44.390921 (+ 41us) server_negotiation.cc:407] Connection header received
0811 00:59:44.391094 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:44.391102 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:44.391171 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:44.392308 (+ 1137us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:44.392467 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:44.394056 (+ 1589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:44.395041 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:44.395689 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:44.395803 (+ 114us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:44.399071 (+ 3268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:44.399076 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:44.399076 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:59:44.399091 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:44.402082 (+ 2991us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:44.402589 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:44.402593 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:44.402593 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:44.402736 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:44.403022 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:44.403023 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:44.403023 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:44.403444 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:44.403645 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:44.403770 (+ 125us) server_negotiation.cc:299] Negotiation successful
0811 00:59:44.403898 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":99,"threads_started":1}
I20260811 00:59:44.404994 16185 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:59:44.405603 16185 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:59:44.406051 15640 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 00:59:44.416141 16185 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 51e1148e9a6843608c72d6aa5b15350c: Generated new TSK 0
I20260811 00:59:44.416392 16185 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:59:44.416790 16162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:44.408005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52051 (local address 127.0.0.1:41805)
0811 00:59:44.408048 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:44.408051 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:44.408150 (+ 99us) server_negotiation.cc:407] Connection header received
0811 00:59:44.408205 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:44.408206 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:44.408218 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:44.408287 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:44.409079 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:44.409951 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:44.411063 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:44.411405 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:44.411484 (+ 79us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:44.413119 (+ 1635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:44.413121 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:44.413121 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:59:44.413130 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:44.414899 (+ 1769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:44.415381 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:44.415382 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:44.415383 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:44.415452 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:44.415958 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:44.415960 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:44.415960 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:44.416112 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:44.416233 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:44.416658 (+ 425us) server_negotiation.cc:299] Negotiation successful
0811 00:59:44.416723 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 00:59:44.419634 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 16043
W20260811 00:59:44.440809 16022 connection.cc:535] client connection to 127.0.0.1:41805 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41805): Connection reset by peer (error 104)
2026-08-11T00:59:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1685 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409704606556-15640-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:59:44 dist-test-slave-h3ft krb5kdc[16209](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:59:44 dist-test-slave-h3ft krb5kdc[16209](info): set up 2 sockets
Aug 11 00:59:44 dist-test-slave-h3ft krb5kdc[16209](info): commencing operation
krb5kdc: starting...
W20260811 00:59:45.767311 15640 mini_kdc.cc:121] Time spent starting KDC: real 1.312s user 0.003s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Aug 11 00:59:45 dist-test-slave-h3ft krb5kdc[16209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409985, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:59:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:59:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 00:59:45.923378 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40215
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41663
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40215
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:59:46.024722 16233 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:59:46.025079 16233 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:59:46.025126 16233 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:59:46.026585 16233 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:59:46.026670 16233 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:59:46.026698 16233 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:59:46.026731 16233 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:59:46.026762 16233 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:59:46.028584 16233 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41663
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40215
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40215
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16233
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:59:46.028941 16233 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:59:46.029237 16233 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:59:46.035573 16242 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:46.035583 16238 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:46.035594 16240 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:46.036914 16233 server_base.cc:1034] running on GCE node
I20260811 00:59:46.037283 16233 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:59:46.037770 16233 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:59:46.039031 16233 hybrid_clock.cc:648] HybridClock initialized: now 1786409986038974 us; error 57 us; skew 500 ppm
Aug 11 00:59:46 dist-test-slave-h3ft krb5kdc[16209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409986, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:59:46.042447 16233 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 00:59:46.043202 16233 webserver.cc:460] Webserver started at http://127.0.0.1:45735/ using document root <none> and password file <none>
I20260811 00:59:46.043476 16233 fs_manager.cc:359] Metadata directory not provided
I20260811 00:59:46.043526 16233 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:59:46.043706 16233 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:59:46.045027 16233 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "273638c652b14ad4b1856a21d55120ab"
format_stamp: "Formatted at 2026-08-11 00:59:46 on dist-test-slave-h3ft"
server_key: "1e49ea73ab3fe5be6897bcba5ddd10e8"
server_key_iv: "3c663b972680e9309db8a8fd19cfca87"
server_key_version: "encryptionkey@0"
I20260811 00:59:46.045462 16233 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "273638c652b14ad4b1856a21d55120ab"
format_stamp: "Formatted at 2026-08-11 00:59:46 on dist-test-slave-h3ft"
server_key: "1e49ea73ab3fe5be6897bcba5ddd10e8"
server_key_iv: "3c663b972680e9309db8a8fd19cfca87"
server_key_version: "encryptionkey@0"
I20260811 00:59:46.047222 16233 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260811 00:59:46.048257 16249 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:46.048504 16233 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:59:46.048638 16233 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "273638c652b14ad4b1856a21d55120ab"
format_stamp: "Formatted at 2026-08-11 00:59:46 on dist-test-slave-h3ft"
server_key: "1e49ea73ab3fe5be6897bcba5ddd10e8"
server_key_iv: "3c663b972680e9309db8a8fd19cfca87"
server_key_version: "encryptionkey@0"
I20260811 00:59:46.048729 16233 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:59:46.065955 16233 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:59:46.069265 16233 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:59:46.069485 16233 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:59:46.075031 16233 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40215
I20260811 00:59:46.075085 16332 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40215 every 8 connection(s)
I20260811 00:59:46.075549 16233 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:59:46.076761 16333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:59:46.079980 16333 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 273638c652b14ad4b1856a21d55120ab: Bootstrap starting.
I20260811 00:59:46.080813 16333 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 273638c652b14ad4b1856a21d55120ab: Neither blocks nor log segments found. Creating new log.
I20260811 00:59:46.081182 16333 log.cc:824] T 00000000000000000000000000000000 P 273638c652b14ad4b1856a21d55120ab: Log is configured to *not* fsync() on all Append() calls
I20260811 00:59:46.081806 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 16233
I20260811 00:59:46.081943 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 00:59:46.082185 15640 external_mini_cluster.cc:1428] Setting key 3463c0598115cf9442bd969077f73ac2
I20260811 00:59:46.082293 16333 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 273638c652b14ad4b1856a21d55120ab: No bootstrap required, opened a new log
I20260811 00:59:46.085594 16333 raft_consensus.cc:348] T 00000000000000000000000000000000 P 273638c652b14ad4b1856a21d55120ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "273638c652b14ad4b1856a21d55120ab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40215 } }
I20260811 00:59:46.085837 16333 raft_consensus.cc:374] T 00000000000000000000000000000000 P 273638c652b14ad4b1856a21d55120ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:59:46.085886 16333 raft_consensus.cc:729] T 00000000000000000000000000000000 P 273638c652b14ad4b1856a21d55120ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 273638c652b14ad4b1856a21d55120ab, State: Initialized, Role: FOLLOWER
I20260811 00:59:46.086036 16333 consensus_queue.cc:260] T 00000000000000000000000000000000 P 273638c652b14ad4b1856a21d55120ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "273638c652b14ad4b1856a21d55120ab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40215 } }
I20260811 00:59:46.086130 16333 raft_consensus.cc:388] T 00000000000000000000000000000000 P 273638c652b14ad4b1856a21d55120ab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:59:46.086167 16333 raft_consensus.cc:482] T 00000000000000000000000000000000 P 273638c652b14ad4b1856a21d55120ab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:59:46.086220 16333 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 273638c652b14ad4b1856a21d55120ab [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:59:46.087284 16333 raft_consensus.cc:504] T 00000000000000000000000000000000 P 273638c652b14ad4b1856a21d55120ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "273638c652b14ad4b1856a21d55120ab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40215 } }
I20260811 00:59:46.087436 16333 leader_election.cc:302] T 00000000000000000000000000000000 P 273638c652b14ad4b1856a21d55120ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 273638c652b14ad4b1856a21d55120ab; no voters:
I20260811 00:59:46.087677 16333 leader_election.cc:288] T 00000000000000000000000000000000 P 273638c652b14ad4b1856a21d55120ab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:59:46.087713 16342 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 273638c652b14ad4b1856a21d55120ab [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:59:46.087883 16342 raft_consensus.cc:686] T 00000000000000000000000000000000 P 273638c652b14ad4b1856a21d55120ab [term 1 LEADER]: Becoming Leader. State: Replica: 273638c652b14ad4b1856a21d55120ab, State: Running, Role: LEADER
I20260811 00:59:46.087981 16342 consensus_queue.cc:237] T 00000000000000000000000000000000 P 273638c652b14ad4b1856a21d55120ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "273638c652b14ad4b1856a21d55120ab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40215 } }
I20260811 00:59:46.088047 16333 sys_catalog.cc:564] T 00000000000000000000000000000000 P 273638c652b14ad4b1856a21d55120ab [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:59:46.088372 16342 sys_catalog.cc:455] T 00000000000000000000000000000000 P 273638c652b14ad4b1856a21d55120ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 273638c652b14ad4b1856a21d55120ab. Latest consensus state: current_term: 1 leader_uuid: "273638c652b14ad4b1856a21d55120ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "273638c652b14ad4b1856a21d55120ab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40215 } } }
I20260811 00:59:46.088454 16342 sys_catalog.cc:458] T 00000000000000000000000000000000 P 273638c652b14ad4b1856a21d55120ab [sys.catalog]: This master's current role is: LEADER
I20260811 00:59:46.088392 16343 sys_catalog.cc:455] T 00000000000000000000000000000000 P 273638c652b14ad4b1856a21d55120ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "273638c652b14ad4b1856a21d55120ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "273638c652b14ad4b1856a21d55120ab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40215 } } }
I20260811 00:59:46.088642 16343 sys_catalog.cc:458] T 00000000000000000000000000000000 P 273638c652b14ad4b1856a21d55120ab [sys.catalog]: This master's current role is: LEADER
I20260811 00:59:46.089283 16348 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:59:46.089331 16341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:46.082921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34805 (local address 127.0.0.1:40215)
0811 00:59:46.083182 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:46.083191 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:46.083223 (+ 32us) server_negotiation.cc:407] Connection header received
0811 00:59:46.084091 (+ 868us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:46.084101 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:46.084166 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:46.084314 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:46.084634 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:46.085641 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:46.086765 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:46.087348 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:46.087484 (+ 136us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:46.088419 (+ 935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:46.088423 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:46.088424 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:59:46.088699 (+ 275us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:46.088751 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:59:46.088768 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:46.088837 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:46.089022 (+ 185us) server_negotiation.cc:299] Negotiation successful
0811 00:59:46.089056 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":140,"threads_started":1}
I20260811 00:59:46.090562 16348 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:59:46.090569 15640 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 00:59:46.092656 16348 catalog_manager.cc:1347] Generated new cluster ID: 087b79b8dfbf405a9a2ef70043d714f2
I20260811 00:59:46.092721 16348 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:59:46.096935 16341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:46.092979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53611 (local address 127.0.0.1:40215)
0811 00:59:46.093050 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:46.093052 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:46.093063 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:59:46.093088 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:46.093089 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:46.093101 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:46.093169 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:46.093371 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:46.094143 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:46.095314 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:46.095662 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:46.095747 (+ 85us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:46.096629 (+ 882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:46.096631 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:46.096631 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:59:46.096637 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:46.096661 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:59:46.096668 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:46.096737 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:46.096812 (+ 75us) server_negotiation.cc:299] Negotiation successful
0811 00:59:46.096825 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 00:59:46.125723 16348 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:59:46.126608 16348 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:59:46.130513 16348 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 273638c652b14ad4b1856a21d55120ab: Generated new TSK 0
I20260811 00:59:46.130774 16348 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:59:46.140048 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 16233
W20260811 00:59:46.158803 16206 connection.cc:535] client connection to 127.0.0.1:40215 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40215): Connection reset by peer (error 104)
2026-08-11T00:59:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1718 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409704606556-15640-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:59:46 dist-test-slave-h3ft krb5kdc[16385](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:59:46 dist-test-slave-h3ft krb5kdc[16385](info): set up 2 sockets
Aug 11 00:59:46 dist-test-slave-h3ft krb5kdc[16385](info): commencing operation
krb5kdc: starting...
W20260811 00:59:47.506373 15640 mini_kdc.cc:121] Time spent starting KDC: real 1.333s user 0.003s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Aug 11 00:59:47 dist-test-slave-h3ft krb5kdc[16385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409987, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:59:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:59:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 00:59:47.663219 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39091
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35265
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39091
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:59:47.756896 16402 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:59:47.757177 16402 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:59:47.757220 16402 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:59:47.758383 16402 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:59:47.758460 16402 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:59:47.758487 16402 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:59:47.758520 16402 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:59:47.758546 16402 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:59:47.760183 16402 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35265
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39091
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39091
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16402
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:59:47.760490 16402 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:59:47.760752 16402 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:59:47.766381 16409 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:47.766386 16408 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:47.766425 16412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:47.766637 16402 server_base.cc:1034] running on GCE node
I20260811 00:59:47.767130 16402 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:59:47.767516 16402 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:59:47.768757 16402 hybrid_clock.cc:648] HybridClock initialized: now 1786409987768739 us; error 43 us; skew 500 ppm
Aug 11 00:59:47 dist-test-slave-h3ft krb5kdc[16385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409987, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:59:47.771652 16402 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 00:59:47.772159 16402 webserver.cc:460] Webserver started at http://127.0.0.1:33863/ using document root <none> and password file <none>
I20260811 00:59:47.772428 16402 fs_manager.cc:359] Metadata directory not provided
I20260811 00:59:47.772506 16402 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:59:47.772668 16402 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:59:47.773769 16402 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "b220d41e0ae142c6acf627542a02d652"
format_stamp: "Formatted at 2026-08-11 00:59:47 on dist-test-slave-h3ft"
server_key: "177ff6e3746bad43c40eb685247a961e"
server_key_iv: "3a40c79f7728279614ea9674dca7d517"
server_key_version: "encryptionkey@0"
I20260811 00:59:47.774094 16402 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "b220d41e0ae142c6acf627542a02d652"
format_stamp: "Formatted at 2026-08-11 00:59:47 on dist-test-slave-h3ft"
server_key: "177ff6e3746bad43c40eb685247a961e"
server_key_iv: "3a40c79f7728279614ea9674dca7d517"
server_key_version: "encryptionkey@0"
I20260811 00:59:47.775674 16402 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 00:59:47.776593 16425 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:47.776892 16402 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:59:47.776998 16402 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "b220d41e0ae142c6acf627542a02d652"
format_stamp: "Formatted at 2026-08-11 00:59:47 on dist-test-slave-h3ft"
server_key: "177ff6e3746bad43c40eb685247a961e"
server_key_iv: "3a40c79f7728279614ea9674dca7d517"
server_key_version: "encryptionkey@0"
I20260811 00:59:47.777071 16402 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:59:47.780788 16402 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:59:47.783464 16402 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:59:47.783589 16402 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:59:47.788542 16402 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39091
I20260811 00:59:47.788641 16514 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39091 every 8 connection(s)
I20260811 00:59:47.788998 16402 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:59:47.790287 16515 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:59:47.791412 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 16402
I20260811 00:59:47.791589 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 00:59:47.791827 15640 external_mini_cluster.cc:1428] Setting key 3d55dcc95e418769ee249caf0e50bc34
I20260811 00:59:47.794698 16515 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b220d41e0ae142c6acf627542a02d652: Bootstrap starting.
I20260811 00:59:47.794963 16526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:47.792559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32991 (local address 127.0.0.1:39091)
0811 00:59:47.792816 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:47.792825 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:47.792857 (+ 32us) server_negotiation.cc:407] Connection header received
0811 00:59:47.793456 (+ 599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:47.793464 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:47.793490 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:47.793625 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:47.794404 (+ 779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:47.794408 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:47.794408 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:59:47.794412 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:47.794455 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:59:47.794466 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:47.794530 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:47.794635 (+ 105us) server_negotiation.cc:299] Negotiation successful
0811 00:59:47.794676 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":155,"threads_started":1}
I20260811 00:59:47.795708 16515 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b220d41e0ae142c6acf627542a02d652: Neither blocks nor log segments found. Creating new log.
I20260811 00:59:47.796139 16515 log.cc:824] T 00000000000000000000000000000000 P b220d41e0ae142c6acf627542a02d652: Log is configured to *not* fsync() on all Append() calls
I20260811 00:59:47.796398 15640 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 00:59:47.797024 16515 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b220d41e0ae142c6acf627542a02d652: No bootstrap required, opened a new log
I20260811 00:59:47.799531 16526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:47.798235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47717 (local address 127.0.0.1:39091)
0811 00:59:47.798287 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:47.798289 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:47.798396 (+ 107us) server_negotiation.cc:407] Connection header received
0811 00:59:47.798476 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:47.798477 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:47.798484 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:47.798542 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:47.799305 (+ 763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:47.799306 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:47.799307 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:59:47.799311 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:47.799325 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:59:47.799330 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:47.799383 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:47.799443 (+ 60us) server_negotiation.cc:299] Negotiation successful
0811 00:59:47.799456 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 00:59:47.799796 16515 raft_consensus.cc:348] T 00000000000000000000000000000000 P b220d41e0ae142c6acf627542a02d652 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b220d41e0ae142c6acf627542a02d652" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39091 } }
I20260811 00:59:47.800006 16515 raft_consensus.cc:374] T 00000000000000000000000000000000 P b220d41e0ae142c6acf627542a02d652 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:59:47.800061 16515 raft_consensus.cc:729] T 00000000000000000000000000000000 P b220d41e0ae142c6acf627542a02d652 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b220d41e0ae142c6acf627542a02d652, State: Initialized, Role: FOLLOWER
I20260811 00:59:47.800211 16515 consensus_queue.cc:260] T 00000000000000000000000000000000 P b220d41e0ae142c6acf627542a02d652 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b220d41e0ae142c6acf627542a02d652" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39091 } }
I20260811 00:59:47.800300 16515 raft_consensus.cc:388] T 00000000000000000000000000000000 P b220d41e0ae142c6acf627542a02d652 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:59:47.800325 16515 raft_consensus.cc:482] T 00000000000000000000000000000000 P b220d41e0ae142c6acf627542a02d652 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:59:47.800405 16515 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b220d41e0ae142c6acf627542a02d652 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:59:47.801151 16515 raft_consensus.cc:504] T 00000000000000000000000000000000 P b220d41e0ae142c6acf627542a02d652 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b220d41e0ae142c6acf627542a02d652" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39091 } }
I20260811 00:59:47.801254 16515 leader_election.cc:302] T 00000000000000000000000000000000 P b220d41e0ae142c6acf627542a02d652 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b220d41e0ae142c6acf627542a02d652; no voters:
I20260811 00:59:47.801477 16515 leader_election.cc:288] T 00000000000000000000000000000000 P b220d41e0ae142c6acf627542a02d652 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:59:47.801555 16536 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b220d41e0ae142c6acf627542a02d652 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:59:47.801803 16515 sys_catalog.cc:564] T 00000000000000000000000000000000 P b220d41e0ae142c6acf627542a02d652 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:59:47.801800 16536 raft_consensus.cc:686] T 00000000000000000000000000000000 P b220d41e0ae142c6acf627542a02d652 [term 1 LEADER]: Becoming Leader. State: Replica: b220d41e0ae142c6acf627542a02d652, State: Running, Role: LEADER
I20260811 00:59:47.802032 16536 consensus_queue.cc:237] T 00000000000000000000000000000000 P b220d41e0ae142c6acf627542a02d652 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b220d41e0ae142c6acf627542a02d652" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39091 } }
I20260811 00:59:47.802874 16537 sys_catalog.cc:455] T 00000000000000000000000000000000 P b220d41e0ae142c6acf627542a02d652 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b220d41e0ae142c6acf627542a02d652" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b220d41e0ae142c6acf627542a02d652" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39091 } } }
I20260811 00:59:47.802995 16537 sys_catalog.cc:458] T 00000000000000000000000000000000 P b220d41e0ae142c6acf627542a02d652 [sys.catalog]: This master's current role is: LEADER
I20260811 00:59:47.803224 16538 sys_catalog.cc:455] T 00000000000000000000000000000000 P b220d41e0ae142c6acf627542a02d652 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b220d41e0ae142c6acf627542a02d652. Latest consensus state: current_term: 1 leader_uuid: "b220d41e0ae142c6acf627542a02d652" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b220d41e0ae142c6acf627542a02d652" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39091 } } }
I20260811 00:59:47.803310 16538 sys_catalog.cc:458] T 00000000000000000000000000000000 P b220d41e0ae142c6acf627542a02d652 [sys.catalog]: This master's current role is: LEADER
W20260811 00:59:47.804157 16558 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b220d41e0ae142c6acf627542a02d652: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 00:59:47.804219 16558 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 00:59:47.804319 16549 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:59:47.804576 16549 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:59:47.806442 16549 catalog_manager.cc:1347] Generated new cluster ID: 91108f6b72c54994ac8c58989222d274
I20260811 00:59:47.806514 16549 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:59:47.821748 16549 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:59:47.822045 16549 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:59:47.830183 16549 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b220d41e0ae142c6acf627542a02d652: Generated new TSK 0
I20260811 00:59:47.830461 16549 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:59:47.839293 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 16402
2026-08-11T00:59:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1695 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409704606556-15640-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:59:47 dist-test-slave-h3ft krb5kdc[16563](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:59:47 dist-test-slave-h3ft krb5kdc[16563](info): set up 2 sockets
Aug 11 00:59:47 dist-test-slave-h3ft krb5kdc[16563](info): commencing operation
krb5kdc: starting...
W20260811 00:59:49.194348 15640 mini_kdc.cc:121] Time spent starting KDC: real 1.325s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Aug 11 00:59:49 dist-test-slave-h3ft krb5kdc[16563](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:59:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:59:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 00:59:49.351640 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42693
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42693
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:59:49.448843 16586 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:59:49.449129 16586 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:59:49.449158 16586 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:59:49.450426 16586 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:59:49.450484 16586 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:59:49.450497 16586 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:59:49.450510 16586 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:59:49.450523 16586 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:59:49.452219 16586 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42693
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42693
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16586
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:59:49.452548 16586 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:59:49.453018 16586 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:59:49.459028 16599 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:49.458943 16593 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:49.458945 16597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:49.459501 16586 server_base.cc:1034] running on GCE node
I20260811 00:59:49.459807 16586 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:59:49.460143 16586 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:59:49.461344 16586 hybrid_clock.cc:648] HybridClock initialized: now 1786409989461329 us; error 63 us; skew 500 ppm
Aug 11 00:59:49 dist-test-slave-h3ft krb5kdc[16563](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409989, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:59:49.464730 16586 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 00:59:49.465265 16586 webserver.cc:460] Webserver started at http://127.0.0.1:39377/ using document root <none> and password file <none>
I20260811 00:59:49.465552 16586 fs_manager.cc:359] Metadata directory not provided
I20260811 00:59:49.465629 16586 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:59:49.465796 16586 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:59:49.467115 16586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "1df84d80bb6f4b5b89d7284912b6b9d3"
format_stamp: "Formatted at 2026-08-11 00:59:49 on dist-test-slave-h3ft"
server_key: "7de55129482f95f636327649961ddb8d"
server_key_iv: "cb944ccc01f227f1ce9f033d16f617ba"
server_key_version: "encryptionkey@0"
I20260811 00:59:49.467555 16586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "1df84d80bb6f4b5b89d7284912b6b9d3"
format_stamp: "Formatted at 2026-08-11 00:59:49 on dist-test-slave-h3ft"
server_key: "7de55129482f95f636327649961ddb8d"
server_key_iv: "cb944ccc01f227f1ce9f033d16f617ba"
server_key_version: "encryptionkey@0"
I20260811 00:59:49.469197 16586 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 00:59:49.470089 16609 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:49.470315 16586 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:59:49.470427 16586 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "1df84d80bb6f4b5b89d7284912b6b9d3"
format_stamp: "Formatted at 2026-08-11 00:59:49 on dist-test-slave-h3ft"
server_key: "7de55129482f95f636327649961ddb8d"
server_key_iv: "cb944ccc01f227f1ce9f033d16f617ba"
server_key_version: "encryptionkey@0"
I20260811 00:59:49.470510 16586 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:59:49.483850 16586 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:59:49.486543 16586 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:59:49.486750 16586 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:59:49.492121 16586 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42693
I20260811 00:59:49.492203 16696 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42693 every 8 connection(s)
I20260811 00:59:49.492645 16586 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:59:49.493757 16697 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:59:49.496583 16697 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1df84d80bb6f4b5b89d7284912b6b9d3: Bootstrap starting.
I20260811 00:59:49.497289 16697 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1df84d80bb6f4b5b89d7284912b6b9d3: Neither blocks nor log segments found. Creating new log.
I20260811 00:59:49.497573 16697 log.cc:824] T 00000000000000000000000000000000 P 1df84d80bb6f4b5b89d7284912b6b9d3: Log is configured to *not* fsync() on all Append() calls
I20260811 00:59:49.498396 16697 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1df84d80bb6f4b5b89d7284912b6b9d3: No bootstrap required, opened a new log
I20260811 00:59:49.499765 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 16586
I20260811 00:59:49.499897 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 00:59:49.500121 15640 external_mini_cluster.cc:1428] Setting key 57cf7b036205bfdc1c185c63bc37f1a7
I20260811 00:59:49.500465 16697 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1df84d80bb6f4b5b89d7284912b6b9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1df84d80bb6f4b5b89d7284912b6b9d3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42693 } }
I20260811 00:59:49.500723 16697 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1df84d80bb6f4b5b89d7284912b6b9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:59:49.500808 16697 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1df84d80bb6f4b5b89d7284912b6b9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1df84d80bb6f4b5b89d7284912b6b9d3, State: Initialized, Role: FOLLOWER
I20260811 00:59:49.501003 16697 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1df84d80bb6f4b5b89d7284912b6b9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1df84d80bb6f4b5b89d7284912b6b9d3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42693 } }
I20260811 00:59:49.501109 16697 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1df84d80bb6f4b5b89d7284912b6b9d3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:59:49.501137 16697 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1df84d80bb6f4b5b89d7284912b6b9d3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:59:49.501216 16697 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1df84d80bb6f4b5b89d7284912b6b9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:59:49.502149 16697 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1df84d80bb6f4b5b89d7284912b6b9d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1df84d80bb6f4b5b89d7284912b6b9d3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42693 } }
I20260811 00:59:49.502283 16697 leader_election.cc:302] T 00000000000000000000000000000000 P 1df84d80bb6f4b5b89d7284912b6b9d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1df84d80bb6f4b5b89d7284912b6b9d3; no voters:
I20260811 00:59:49.502489 16697 leader_election.cc:288] T 00000000000000000000000000000000 P 1df84d80bb6f4b5b89d7284912b6b9d3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:59:49.502523 16703 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1df84d80bb6f4b5b89d7284912b6b9d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:59:49.502669 16703 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1df84d80bb6f4b5b89d7284912b6b9d3 [term 1 LEADER]: Becoming Leader. State: Replica: 1df84d80bb6f4b5b89d7284912b6b9d3, State: Running, Role: LEADER
I20260811 00:59:49.502823 16703 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1df84d80bb6f4b5b89d7284912b6b9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1df84d80bb6f4b5b89d7284912b6b9d3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42693 } }
I20260811 00:59:49.502885 16697 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1df84d80bb6f4b5b89d7284912b6b9d3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:59:49.503384 16704 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1df84d80bb6f4b5b89d7284912b6b9d3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1df84d80bb6f4b5b89d7284912b6b9d3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1df84d80bb6f4b5b89d7284912b6b9d3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42693 } } }
I20260811 00:59:49.503472 16704 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1df84d80bb6f4b5b89d7284912b6b9d3 [sys.catalog]: This master's current role is: LEADER
I20260811 00:59:49.503693 16705 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1df84d80bb6f4b5b89d7284912b6b9d3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1df84d80bb6f4b5b89d7284912b6b9d3. Latest consensus state: current_term: 1 leader_uuid: "1df84d80bb6f4b5b89d7284912b6b9d3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1df84d80bb6f4b5b89d7284912b6b9d3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42693 } } }
I20260811 00:59:49.503809 16705 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1df84d80bb6f4b5b89d7284912b6b9d3 [sys.catalog]: This master's current role is: LEADER
I20260811 00:59:49.504007 16709 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:59:49.504660 16709 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:59:49.506520 16709 catalog_manager.cc:1347] Generated new cluster ID: 42f5584393b9458f81dc3a0833da9359
I20260811 00:59:49.506582 16709 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 00:59:49 dist-test-slave-h3ft krb5kdc[16563](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 00:59:49.512868 16702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:49.500817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59399 (local address 127.0.0.1:42693)
0811 00:59:49.501032 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:49.501042 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:49.501072 (+ 30us) server_negotiation.cc:407] Connection header received
0811 00:59:49.501266 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:49.501275 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:49.501344 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:49.501473 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:49.502404 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:49.504006 (+ 1602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:49.505252 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:49.505786 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:49.505913 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:49.509062 (+ 3149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:49.509067 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:49.509067 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:59:49.509088 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:49.510964 (+ 1876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:49.511444 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:49.511448 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:49.511448 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:49.511567 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:49.511798 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:49.511799 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:49.511800 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:49.512088 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:49.512327 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:49.512399 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 00:59:49.512689 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":115,"threads_started":1}
I20260811 00:59:49.513970 15640 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 00:59:49.515622 16709 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:59:49.516216 16709 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:59:49.522161 16709 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1df84d80bb6f4b5b89d7284912b6b9d3: Generated new TSK 0
I20260811 00:59:49.522384 16709 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:59:49.527531 16702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:49.515807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54227 (local address 127.0.0.1:42693)
0811 00:59:49.515848 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:49.515850 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:49.519319 (+ 3469us) server_negotiation.cc:407] Connection header received
0811 00:59:49.519419 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:49.519420 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:49.519434 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:49.519499 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:49.520271 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:49.521050 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:49.522196 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:49.522515 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:49.522590 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:49.524370 (+ 1780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:49.524371 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:49.524371 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:59:49.524385 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:49.526084 (+ 1699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:49.526561 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:49.526562 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:49.526563 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:49.526626 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:49.526873 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:49.526874 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:49.526875 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:49.527117 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:49.527212 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:49.527353 (+ 141us) server_negotiation.cc:299] Negotiation successful
0811 00:59:49.527449 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 00:59:49.530458 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 16586
2026-08-11T00:59:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1694 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409704606556-15640-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:59:49 dist-test-slave-h3ft krb5kdc[16747](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:59:49 dist-test-slave-h3ft krb5kdc[16747](info): set up 2 sockets
Aug 11 00:59:49 dist-test-slave-h3ft krb5kdc[16747](info): commencing operation
krb5kdc: starting...
W20260811 00:59:50.895378 15640 mini_kdc.cc:121] Time spent starting KDC: real 1.331s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Aug 11 00:59:50 dist-test-slave-h3ft krb5kdc[16747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409990, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:59:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:59:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 00:59:51.055500 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42737
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39551
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42737
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:59:51.156695 16766 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:59:51.156983 16766 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:59:51.157011 16766 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:59:51.158218 16766 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:59:51.158265 16766 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:59:51.158281 16766 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:59:51.158294 16766 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:59:51.158308 16766 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:59:51.160094 16766 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39551
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42737
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42737
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16766
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:59:51.160387 16766 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:59:51.160625 16766 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:59:51.166663 16777 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:51.166668 16782 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:51.166668 16779 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:51.167430 16766 server_base.cc:1034] running on GCE node
I20260811 00:59:51.167932 16766 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:59:51.168336 16766 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:59:51.169536 16766 hybrid_clock.cc:648] HybridClock initialized: now 1786409991169517 us; error 43 us; skew 500 ppm
Aug 11 00:59:51 dist-test-slave-h3ft krb5kdc[16747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409991, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:59:51.172928 16766 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 00:59:51.173554 16766 webserver.cc:460] Webserver started at http://127.0.0.1:34817/ using document root <none> and password file <none>
I20260811 00:59:51.173846 16766 fs_manager.cc:359] Metadata directory not provided
I20260811 00:59:51.173929 16766 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:59:51.174104 16766 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:59:51.175484 16766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "8a849234a87b47ff94819e1b590911c2"
format_stamp: "Formatted at 2026-08-11 00:59:51 on dist-test-slave-h3ft"
server_key: "c1e651b530397ccd777dbcccdd708d34"
server_key_iv: "ec607a12a0f3a10c29047234155bfe7e"
server_key_version: "encryptionkey@0"
I20260811 00:59:51.175917 16766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "8a849234a87b47ff94819e1b590911c2"
format_stamp: "Formatted at 2026-08-11 00:59:51 on dist-test-slave-h3ft"
server_key: "c1e651b530397ccd777dbcccdd708d34"
server_key_iv: "ec607a12a0f3a10c29047234155bfe7e"
server_key_version: "encryptionkey@0"
I20260811 00:59:51.177628 16766 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 00:59:51.178721 16794 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:51.179093 16766 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:59:51.179221 16766 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "8a849234a87b47ff94819e1b590911c2"
format_stamp: "Formatted at 2026-08-11 00:59:51 on dist-test-slave-h3ft"
server_key: "c1e651b530397ccd777dbcccdd708d34"
server_key_iv: "ec607a12a0f3a10c29047234155bfe7e"
server_key_version: "encryptionkey@0"
I20260811 00:59:51.179308 16766 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:59:51.199734 16766 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:59:51.202570 16766 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:59:51.202797 16766 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:59:51.208890 16766 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42737
I20260811 00:59:51.208958 16874 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42737 every 8 connection(s)
I20260811 00:59:51.209517 16766 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:59:51.210762 16875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:59:51.213495 16875 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a849234a87b47ff94819e1b590911c2: Bootstrap starting.
I20260811 00:59:51.213721 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 16766
I20260811 00:59:51.213897 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 00:59:51.214131 15640 external_mini_cluster.cc:1428] Setting key ebcc7b9f1a1356e75d5796e6f75aa71e
I20260811 00:59:51.214357 16875 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8a849234a87b47ff94819e1b590911c2: Neither blocks nor log segments found. Creating new log.
I20260811 00:59:51.214771 16875 log.cc:824] T 00000000000000000000000000000000 P 8a849234a87b47ff94819e1b590911c2: Log is configured to *not* fsync() on all Append() calls
I20260811 00:59:51.215988 16875 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a849234a87b47ff94819e1b590911c2: No bootstrap required, opened a new log
I20260811 00:59:51.218851 16875 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8a849234a87b47ff94819e1b590911c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a849234a87b47ff94819e1b590911c2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42737 } }
I20260811 00:59:51.219173 16875 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8a849234a87b47ff94819e1b590911c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:59:51.219208 16875 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8a849234a87b47ff94819e1b590911c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a849234a87b47ff94819e1b590911c2, State: Initialized, Role: FOLLOWER
I20260811 00:59:51.219398 16875 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a849234a87b47ff94819e1b590911c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a849234a87b47ff94819e1b590911c2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42737 } }
I20260811 00:59:51.219493 16875 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8a849234a87b47ff94819e1b590911c2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:59:51.219520 16875 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8a849234a87b47ff94819e1b590911c2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:59:51.219592 16875 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8a849234a87b47ff94819e1b590911c2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:59:51.220755 16875 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8a849234a87b47ff94819e1b590911c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a849234a87b47ff94819e1b590911c2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42737 } }
I20260811 00:59:51.220880 16875 leader_election.cc:302] T 00000000000000000000000000000000 P 8a849234a87b47ff94819e1b590911c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8a849234a87b47ff94819e1b590911c2; no voters:
I20260811 00:59:51.221148 16875 leader_election.cc:288] T 00000000000000000000000000000000 P 8a849234a87b47ff94819e1b590911c2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:59:51.221271 16883 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8a849234a87b47ff94819e1b590911c2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:59:51.221580 16883 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8a849234a87b47ff94819e1b590911c2 [term 1 LEADER]: Becoming Leader. State: Replica: 8a849234a87b47ff94819e1b590911c2, State: Running, Role: LEADER
I20260811 00:59:51.221634 16875 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8a849234a87b47ff94819e1b590911c2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:59:51.221863 16881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:51.214957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43939 (local address 127.0.0.1:42737)
0811 00:59:51.215339 (+ 382us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:51.215348 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:51.215377 (+ 29us) server_negotiation.cc:407] Connection header received
0811 00:59:51.215889 (+ 512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:51.215897 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:51.215952 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:51.216147 (+ 195us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:51.216501 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:51.217512 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:51.218890 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:51.219699 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:51.219827 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:51.220709 (+ 882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:51.220713 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:51.220713 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:59:51.221018 (+ 305us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:51.221078 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:59:51.221093 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:51.221192 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:51.221375 (+ 183us) server_negotiation.cc:299] Negotiation successful
0811 00:59:51.221543 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":216,"threads_started":1}
I20260811 00:59:51.221791 16883 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8a849234a87b47ff94819e1b590911c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a849234a87b47ff94819e1b590911c2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42737 } }
I20260811 00:59:51.222236 16883 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a849234a87b47ff94819e1b590911c2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8a849234a87b47ff94819e1b590911c2. Latest consensus state: current_term: 1 leader_uuid: "8a849234a87b47ff94819e1b590911c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a849234a87b47ff94819e1b590911c2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42737 } } }
I20260811 00:59:51.222250 16887 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a849234a87b47ff94819e1b590911c2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8a849234a87b47ff94819e1b590911c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a849234a87b47ff94819e1b590911c2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42737 } } }
I20260811 00:59:51.222469 16887 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a849234a87b47ff94819e1b590911c2 [sys.catalog]: This master's current role is: LEADER
I20260811 00:59:51.222738 16883 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a849234a87b47ff94819e1b590911c2 [sys.catalog]: This master's current role is: LEADER
I20260811 00:59:51.222923 16896 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:59:51.222986 15640 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 00:59:51.223599 16896 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:59:51.226033 16896 catalog_manager.cc:1347] Generated new cluster ID: f5cc08746c1742f58a8613a3360207f5
I20260811 00:59:51.226115 16896 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:59:51.229408 16881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:51.225229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46621 (local address 127.0.0.1:42737)
0811 00:59:51.225282 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:51.225284 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:51.225468 (+ 184us) server_negotiation.cc:407] Connection header received
0811 00:59:51.225502 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:51.225503 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:51.225516 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:51.225614 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:51.225816 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:51.226598 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:51.227771 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:51.228095 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:51.228194 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:51.229112 (+ 918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:51.229113 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:51.229114 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:59:51.229119 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:51.229142 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:59:51.229146 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:51.229217 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:51.229286 (+ 69us) server_negotiation.cc:299] Negotiation successful
0811 00:59:51.229313 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 00:59:51.240509 16896 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:59:51.241473 16896 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:59:51.246767 16896 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8a849234a87b47ff94819e1b590911c2: Generated new TSK 0
I20260811 00:59:51.247057 16896 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:59:51.251610 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 16766
2026-08-11T00:59:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1719 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409704606556-15640-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:59:51 dist-test-slave-h3ft krb5kdc[16931](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:59:51 dist-test-slave-h3ft krb5kdc[16931](info): set up 2 sockets
Aug 11 00:59:51 dist-test-slave-h3ft krb5kdc[16931](info): commencing operation
krb5kdc: starting...
W20260811 00:59:52.583863 15640 mini_kdc.cc:121] Time spent starting KDC: real 1.299s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Aug 11 00:59:52 dist-test-slave-h3ft krb5kdc[16931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409992, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:59:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:59:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 00:59:52.735882 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34959
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34959
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:59:52.833678 16950 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:59:52.833968 16950 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:59:52.833997 16950 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:59:52.835387 16950 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:59:52.835446 16950 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:59:52.835464 16950 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:59:52.835476 16950 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:59:52.835489 16950 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:59:52.837203 16950 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34959
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34959
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16950
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:59:52.837482 16950 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:59:52.837729 16950 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:59:52.843791 16957 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:52.843811 16956 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:52.844131 16950 server_base.cc:1034] running on GCE node
W20260811 00:59:52.844280 16960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:52.844650 16950 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:59:52.845103 16950 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:59:52.846241 16950 hybrid_clock.cc:648] HybridClock initialized: now 1786409992846200 us; error 56 us; skew 500 ppm
Aug 11 00:59:52 dist-test-slave-h3ft krb5kdc[16931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409992, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:59:52.855604 16950 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 00:59:52.856195 16950 webserver.cc:460] Webserver started at http://127.0.0.1:36753/ using document root <none> and password file <none>
I20260811 00:59:52.856485 16950 fs_manager.cc:359] Metadata directory not provided
I20260811 00:59:52.856559 16950 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:59:52.856736 16950 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:59:52.858083 16950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "d65e09c5fc7142a399ed2476983c4962"
format_stamp: "Formatted at 2026-08-11 00:59:52 on dist-test-slave-h3ft"
server_key: "c885165f55b26582ec9d0668b4380ecd"
server_key_iv: "e1f6f5c24d53b9d33e81ce9895a6679d"
server_key_version: "encryptionkey@0"
I20260811 00:59:52.858528 16950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "d65e09c5fc7142a399ed2476983c4962"
format_stamp: "Formatted at 2026-08-11 00:59:52 on dist-test-slave-h3ft"
server_key: "c885165f55b26582ec9d0668b4380ecd"
server_key_iv: "e1f6f5c24d53b9d33e81ce9895a6679d"
server_key_version: "encryptionkey@0"
I20260811 00:59:52.860291 16950 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260811 00:59:52.861176 16969 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:52.861377 16950 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:59:52.861500 16950 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "d65e09c5fc7142a399ed2476983c4962"
format_stamp: "Formatted at 2026-08-11 00:59:52 on dist-test-slave-h3ft"
server_key: "c885165f55b26582ec9d0668b4380ecd"
server_key_iv: "e1f6f5c24d53b9d33e81ce9895a6679d"
server_key_version: "encryptionkey@0"
I20260811 00:59:52.861581 16950 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:59:52.865468 16950 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:59:52.867771 16950 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:59:52.867949 16950 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:59:52.872969 16950 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34959
I20260811 00:59:52.873013 17052 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34959 every 8 connection(s)
I20260811 00:59:52.873486 16950 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:59:52.874819 17054 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:59:52.877964 17054 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d65e09c5fc7142a399ed2476983c4962: Bootstrap starting.
I20260811 00:59:52.878760 17054 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d65e09c5fc7142a399ed2476983c4962: Neither blocks nor log segments found. Creating new log.
I20260811 00:59:52.879199 17054 log.cc:824] T 00000000000000000000000000000000 P d65e09c5fc7142a399ed2476983c4962: Log is configured to *not* fsync() on all Append() calls
I20260811 00:59:52.880193 17054 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d65e09c5fc7142a399ed2476983c4962: No bootstrap required, opened a new log
I20260811 00:59:52.882148 17054 raft_consensus.cc:348] T 00000000000000000000000000000000 P d65e09c5fc7142a399ed2476983c4962 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d65e09c5fc7142a399ed2476983c4962" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34959 } }
I20260811 00:59:52.882331 17054 raft_consensus.cc:374] T 00000000000000000000000000000000 P d65e09c5fc7142a399ed2476983c4962 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:59:52.882359 17054 raft_consensus.cc:729] T 00000000000000000000000000000000 P d65e09c5fc7142a399ed2476983c4962 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d65e09c5fc7142a399ed2476983c4962, State: Initialized, Role: FOLLOWER
I20260811 00:59:52.882608 17054 consensus_queue.cc:260] T 00000000000000000000000000000000 P d65e09c5fc7142a399ed2476983c4962 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d65e09c5fc7142a399ed2476983c4962" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34959 } }
I20260811 00:59:52.882689 17054 raft_consensus.cc:388] T 00000000000000000000000000000000 P d65e09c5fc7142a399ed2476983c4962 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:59:52.882714 17054 raft_consensus.cc:482] T 00000000000000000000000000000000 P d65e09c5fc7142a399ed2476983c4962 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:59:52.882771 17054 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d65e09c5fc7142a399ed2476983c4962 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:59:52.883534 17054 raft_consensus.cc:504] T 00000000000000000000000000000000 P d65e09c5fc7142a399ed2476983c4962 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d65e09c5fc7142a399ed2476983c4962" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34959 } }
I20260811 00:59:52.883670 17054 leader_election.cc:302] T 00000000000000000000000000000000 P d65e09c5fc7142a399ed2476983c4962 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d65e09c5fc7142a399ed2476983c4962; no voters:
I20260811 00:59:52.883708 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 16950
I20260811 00:59:52.883908 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 00:59:52.883912 17054 leader_election.cc:288] T 00000000000000000000000000000000 P d65e09c5fc7142a399ed2476983c4962 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:59:52.883975 17057 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d65e09c5fc7142a399ed2476983c4962 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:59:52.884145 15640 external_mini_cluster.cc:1428] Setting key e2af3c757f984fa8c6b72c429e1224e7
I20260811 00:59:52.884167 17057 raft_consensus.cc:686] T 00000000000000000000000000000000 P d65e09c5fc7142a399ed2476983c4962 [term 1 LEADER]: Becoming Leader. State: Replica: d65e09c5fc7142a399ed2476983c4962, State: Running, Role: LEADER
I20260811 00:59:52.884254 17054 sys_catalog.cc:564] T 00000000000000000000000000000000 P d65e09c5fc7142a399ed2476983c4962 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:59:52.884267 17057 consensus_queue.cc:237] T 00000000000000000000000000000000 P d65e09c5fc7142a399ed2476983c4962 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d65e09c5fc7142a399ed2476983c4962" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34959 } }
I20260811 00:59:52.884881 17058 sys_catalog.cc:455] T 00000000000000000000000000000000 P d65e09c5fc7142a399ed2476983c4962 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d65e09c5fc7142a399ed2476983c4962" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d65e09c5fc7142a399ed2476983c4962" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34959 } } }
I20260811 00:59:52.885006 17058 sys_catalog.cc:458] T 00000000000000000000000000000000 P d65e09c5fc7142a399ed2476983c4962 [sys.catalog]: This master's current role is: LEADER
I20260811 00:59:52.885351 17059 sys_catalog.cc:455] T 00000000000000000000000000000000 P d65e09c5fc7142a399ed2476983c4962 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d65e09c5fc7142a399ed2476983c4962. Latest consensus state: current_term: 1 leader_uuid: "d65e09c5fc7142a399ed2476983c4962" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d65e09c5fc7142a399ed2476983c4962" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34959 } } }
I20260811 00:59:52.885437 17059 sys_catalog.cc:458] T 00000000000000000000000000000000 P d65e09c5fc7142a399ed2476983c4962 [sys.catalog]: This master's current role is: LEADER
I20260811 00:59:52.885823 17066 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:59:52.886641 17066 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:59:52.887399 17068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:52.885167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57403 (local address 127.0.0.1:34959)
0811 00:59:52.885342 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:52.885351 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:52.885383 (+ 32us) server_negotiation.cc:407] Connection header received
0811 00:59:52.885539 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:52.885547 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:52.885602 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:52.885804 (+ 202us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:52.886762 (+ 958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:52.886767 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:52.886767 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:59:52.886773 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:52.886824 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:59:52.886840 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:52.886916 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:52.887148 (+ 232us) server_negotiation.cc:299] Negotiation successful
0811 00:59:52.887196 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":79,"threads_started":1}
I20260811 00:59:52.888681 15640 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 00:59:52.888936 17066 catalog_manager.cc:1347] Generated new cluster ID: 920563aa61284a8dac8fae51b3247fb8
I20260811 00:59:52.888986 17066 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:59:52.891673 17068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:52.890515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59659 (local address 127.0.0.1:34959)
0811 00:59:52.890550 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:52.890552 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:52.890668 (+ 116us) server_negotiation.cc:407] Connection header received
0811 00:59:52.890724 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:52.890725 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:52.890731 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:52.890788 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:52.891452 (+ 664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:52.891454 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:52.891454 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:59:52.891458 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:52.891474 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:59:52.891478 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:52.891532 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:52.891597 (+ 65us) server_negotiation.cc:299] Negotiation successful
0811 00:59:52.891609 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 00:59:52.903417 17066 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:59:52.903664 17066 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:59:52.906227 17066 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d65e09c5fc7142a399ed2476983c4962: Generated new TSK 0
I20260811 00:59:52.906435 17066 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:59:52.913342 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 16950
2026-08-11T00:59:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1668 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409704606556-15640-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:59:53 dist-test-slave-h3ft krb5kdc[17100](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:59:53 dist-test-slave-h3ft krb5kdc[17100](info): set up 2 sockets
Aug 11 00:59:53 dist-test-slave-h3ft krb5kdc[17100](info): commencing operation
krb5kdc: starting...
W20260811 00:59:54.250409 15640 mini_kdc.cc:121] Time spent starting KDC: real 1.297s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Aug 11 00:59:54 dist-test-slave-h3ft krb5kdc[17100](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409994, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:59:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:59:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 00:59:54.400525 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40721
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40721
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:59:54.497996 17125 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:59:54.498260 17125 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:59:54.498286 17125 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:59:54.499567 17125 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:59:54.499619 17125 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:59:54.499634 17125 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:59:54.499646 17125 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:59:54.499706 17125 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:59:54.501293 17125 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40721
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40721
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17125
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:59:54.501603 17125 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:59:54.501892 17125 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:59:54.507543 17132 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:54.507573 17136 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:54.507741 17131 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:54.508292 17125 server_base.cc:1034] running on GCE node
I20260811 00:59:54.508626 17125 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:59:54.508968 17125 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:59:54.510129 17125 hybrid_clock.cc:648] HybridClock initialized: now 1786409994510088 us; error 57 us; skew 500 ppm
Aug 11 00:59:54 dist-test-slave-h3ft krb5kdc[17100](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409994, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:59:54.519179 17125 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 00:59:54.519798 17125 webserver.cc:460] Webserver started at http://127.0.0.1:43901/ using document root <none> and password file <none>
I20260811 00:59:54.520129 17125 fs_manager.cc:359] Metadata directory not provided
I20260811 00:59:54.520222 17125 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:59:54.520406 17125 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:59:54.521692 17125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "fd723962519942db8fcc9459c1d4fa66"
format_stamp: "Formatted at 2026-08-11 00:59:54 on dist-test-slave-h3ft"
server_key: "638987fcb86b36fa5ac66f906bffb27a"
server_key_iv: "2c7d2b6b92972857e59a869536642dcc"
server_key_version: "encryptionkey@0"
I20260811 00:59:54.522119 17125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "fd723962519942db8fcc9459c1d4fa66"
format_stamp: "Formatted at 2026-08-11 00:59:54 on dist-test-slave-h3ft"
server_key: "638987fcb86b36fa5ac66f906bffb27a"
server_key_iv: "2c7d2b6b92972857e59a869536642dcc"
server_key_version: "encryptionkey@0"
I20260811 00:59:54.523862 17125 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260811 00:59:54.525151 17145 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:54.525549 17125 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:59:54.525724 17125 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "fd723962519942db8fcc9459c1d4fa66"
format_stamp: "Formatted at 2026-08-11 00:59:54 on dist-test-slave-h3ft"
server_key: "638987fcb86b36fa5ac66f906bffb27a"
server_key_iv: "2c7d2b6b92972857e59a869536642dcc"
server_key_version: "encryptionkey@0"
I20260811 00:59:54.525838 17125 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:59:54.546662 17125 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:59:54.549151 17125 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:59:54.549396 17125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:59:54.554746 17125 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40721
I20260811 00:59:54.554844 17222 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40721 every 8 connection(s)
I20260811 00:59:54.555284 17125 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:59:54.556459 17223 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:59:54.558209 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 17125
I20260811 00:59:54.558324 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 00:59:54.558563 15640 external_mini_cluster.cc:1428] Setting key 49a3add692411cd070ec45ba41d59850
I20260811 00:59:54.559927 17223 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd723962519942db8fcc9459c1d4fa66: Bootstrap starting.
I20260811 00:59:54.560820 17223 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fd723962519942db8fcc9459c1d4fa66: Neither blocks nor log segments found. Creating new log.
I20260811 00:59:54.561219 17223 log.cc:824] T 00000000000000000000000000000000 P fd723962519942db8fcc9459c1d4fa66: Log is configured to *not* fsync() on all Append() calls
I20260811 00:59:54.562045 17223 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd723962519942db8fcc9459c1d4fa66: No bootstrap required, opened a new log
I20260811 00:59:54.564196 17223 raft_consensus.cc:348] T 00000000000000000000000000000000 P fd723962519942db8fcc9459c1d4fa66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd723962519942db8fcc9459c1d4fa66" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40721 } }
I20260811 00:59:54.564384 17223 raft_consensus.cc:374] T 00000000000000000000000000000000 P fd723962519942db8fcc9459c1d4fa66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:59:54.564440 17223 raft_consensus.cc:729] T 00000000000000000000000000000000 P fd723962519942db8fcc9459c1d4fa66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd723962519942db8fcc9459c1d4fa66, State: Initialized, Role: FOLLOWER
I20260811 00:59:54.564630 17223 consensus_queue.cc:260] T 00000000000000000000000000000000 P fd723962519942db8fcc9459c1d4fa66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd723962519942db8fcc9459c1d4fa66" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40721 } }
I20260811 00:59:54.564741 17223 raft_consensus.cc:388] T 00000000000000000000000000000000 P fd723962519942db8fcc9459c1d4fa66 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:59:54.564791 17223 raft_consensus.cc:482] T 00000000000000000000000000000000 P fd723962519942db8fcc9459c1d4fa66 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:59:54.564836 17223 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fd723962519942db8fcc9459c1d4fa66 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:59:54.565593 17223 raft_consensus.cc:504] T 00000000000000000000000000000000 P fd723962519942db8fcc9459c1d4fa66 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd723962519942db8fcc9459c1d4fa66" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40721 } }
I20260811 00:59:54.565696 17223 leader_election.cc:302] T 00000000000000000000000000000000 P fd723962519942db8fcc9459c1d4fa66 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fd723962519942db8fcc9459c1d4fa66; no voters:
I20260811 00:59:54.565934 17223 leader_election.cc:288] T 00000000000000000000000000000000 P fd723962519942db8fcc9459c1d4fa66 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:59:54.565964 17230 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fd723962519942db8fcc9459c1d4fa66 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:59:54.566114 17230 raft_consensus.cc:686] T 00000000000000000000000000000000 P fd723962519942db8fcc9459c1d4fa66 [term 1 LEADER]: Becoming Leader. State: Replica: fd723962519942db8fcc9459c1d4fa66, State: Running, Role: LEADER
I20260811 00:59:54.566286 17230 consensus_queue.cc:237] T 00000000000000000000000000000000 P fd723962519942db8fcc9459c1d4fa66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd723962519942db8fcc9459c1d4fa66" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40721 } }
Aug 11 00:59:54 dist-test-slave-h3ft krb5kdc[17100](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409994, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 00:59:54.566288 17223 sys_catalog.cc:564] T 00000000000000000000000000000000 P fd723962519942db8fcc9459c1d4fa66 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:59:54.567858 17231 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd723962519942db8fcc9459c1d4fa66 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fd723962519942db8fcc9459c1d4fa66. Latest consensus state: current_term: 1 leader_uuid: "fd723962519942db8fcc9459c1d4fa66" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd723962519942db8fcc9459c1d4fa66" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40721 } } }
I20260811 00:59:54.567957 17231 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd723962519942db8fcc9459c1d4fa66 [sys.catalog]: This master's current role is: LEADER
W20260811 00:59:54.569067 17253 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fd723962519942db8fcc9459c1d4fa66: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 00:59:54.569144 17253 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 00:59:54.569211 17233 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd723962519942db8fcc9459c1d4fa66 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fd723962519942db8fcc9459c1d4fa66" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd723962519942db8fcc9459c1d4fa66" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40721 } } }
I20260811 00:59:54.569286 17233 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd723962519942db8fcc9459c1d4fa66 [sys.catalog]: This master's current role is: LEADER
I20260811 00:59:54.569342 17251 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:59:54.569593 17251 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:59:54.571655 17251 catalog_manager.cc:1347] Generated new cluster ID: 6fd8f64e9b2a462d8ecba91dd2ef8017
I20260811 00:59:54.571724 17251 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:59:54.572077 17227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:54.559473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.166:59843 (local address 127.0.0.1:40721)
0811 00:59:54.559720 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:54.559733 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:54.559774 (+ 41us) server_negotiation.cc:407] Connection header received
0811 00:59:54.560435 (+ 661us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:54.560445 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:54.560524 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:54.560729 (+ 205us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:54.561573 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:54.562687 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:54.563520 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:54.563964 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:54.564087 (+ 123us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:54.567195 (+ 3108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:54.567201 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:54.567201 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:59:54.567218 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:54.569711 (+ 2493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:54.570272 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:54.570276 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:54.570276 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:54.570411 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:54.570733 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:54.570735 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:54.570735 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:54.571171 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:54.571368 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:54.571565 (+ 197us) server_negotiation.cc:299] Negotiation successful
0811 00:59:54.571848 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":103,"threads_started":1}
I20260811 00:59:54.573426 15640 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 00:59:54.584282 17227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:54.575600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.166:59581 (local address 127.0.0.1:40721)
0811 00:59:54.575660 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:54.575663 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:54.575961 (+ 298us) server_negotiation.cc:407] Connection header received
0811 00:59:54.576041 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:54.576042 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:54.576054 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:54.576108 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:54.576823 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:54.577637 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:54.578724 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:54.579078 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:54.579150 (+ 72us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:54.580715 (+ 1565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:54.580717 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:54.580717 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:59:54.580723 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:54.582701 (+ 1978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:54.583280 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:54.583281 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:54.583282 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:54.583351 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:54.583647 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:54.583648 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:54.583648 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:54.583788 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:54.583896 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:54.584101 (+ 205us) server_negotiation.cc:299] Negotiation successful
0811 00:59:54.584175 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 00:59:54.586894 17251 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:59:54.587510 17251 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:59:54.590411 17251 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fd723962519942db8fcc9459c1d4fa66: Generated new TSK 0
I20260811 00:59:54.590617 17251 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:59:54.595952 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 17125
W20260811 00:59:54.612162 17097 connection.cc:535] client connection to 127.0.0.1:40721 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40721): Connection reset by peer (error 104)
2026-08-11T00:59:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1673 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409704606556-15640-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:59:54 dist-test-slave-h3ft krb5kdc[17272](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:59:54 dist-test-slave-h3ft krb5kdc[17272](info): set up 2 sockets
Aug 11 00:59:54 dist-test-slave-h3ft krb5kdc[17272](info): commencing operation
krb5kdc: starting...
W20260811 00:59:55.957388 15640 mini_kdc.cc:121] Time spent starting KDC: real 1.331s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Aug 11 00:59:56 dist-test-slave-h3ft krb5kdc[17272](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409996, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:59:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:59:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 00:59:56.120451 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40823
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40823
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:59:56.220026 17290 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:59:56.220351 17290 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:59:56.220403 17290 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:59:56.222223 17290 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:59:56.222308 17290 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:59:56.222332 17290 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:59:56.222352 17290 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:59:56.222369 17290 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:59:56.224222 17290 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40823
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40823
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17290
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:59:56.224501 17290 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:59:56.224722 17290 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:59:56.230708 17299 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:56.230669 17305 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:56.230685 17298 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:56.231047 17290 server_base.cc:1034] running on GCE node
I20260811 00:59:56.231547 17290 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:59:56.231952 17290 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:59:56.233160 17290 hybrid_clock.cc:648] HybridClock initialized: now 1786409996233135 us; error 44 us; skew 500 ppm
Aug 11 00:59:56 dist-test-slave-h3ft krb5kdc[17272](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409996, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:59:56.236367 17290 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 00:59:56.236956 17290 webserver.cc:460] Webserver started at http://127.0.0.1:44319/ using document root <none> and password file <none>
I20260811 00:59:56.237228 17290 fs_manager.cc:359] Metadata directory not provided
I20260811 00:59:56.237306 17290 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:59:56.237480 17290 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:59:56.238813 17290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "4968966c4a2642c39fb765ac06f4b61c"
format_stamp: "Formatted at 2026-08-11 00:59:56 on dist-test-slave-h3ft"
server_key: "a165a9af85f74503ce08a7171e59e913"
server_key_iv: "5f5a4da3580cbabda5783bda069a9cff"
server_key_version: "encryptionkey@0"
I20260811 00:59:56.239269 17290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "4968966c4a2642c39fb765ac06f4b61c"
format_stamp: "Formatted at 2026-08-11 00:59:56 on dist-test-slave-h3ft"
server_key: "a165a9af85f74503ce08a7171e59e913"
server_key_iv: "5f5a4da3580cbabda5783bda069a9cff"
server_key_version: "encryptionkey@0"
I20260811 00:59:56.240988 17290 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 00:59:56.242043 17316 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:56.242419 17290 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260811 00:59:56.242586 17290 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "4968966c4a2642c39fb765ac06f4b61c"
format_stamp: "Formatted at 2026-08-11 00:59:56 on dist-test-slave-h3ft"
server_key: "a165a9af85f74503ce08a7171e59e913"
server_key_iv: "5f5a4da3580cbabda5783bda069a9cff"
server_key_version: "encryptionkey@0"
I20260811 00:59:56.242689 17290 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:59:56.259618 17290 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:59:56.262578 17290 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:59:56.262797 17290 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:59:56.268353 17290 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40823
I20260811 00:59:56.268392 17395 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40823 every 8 connection(s)
I20260811 00:59:56.268874 17290 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:59:56.270033 17396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:59:56.273033 17396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4968966c4a2642c39fb765ac06f4b61c: Bootstrap starting.
I20260811 00:59:56.273803 17396 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4968966c4a2642c39fb765ac06f4b61c: Neither blocks nor log segments found. Creating new log.
I20260811 00:59:56.274150 17396 log.cc:824] T 00000000000000000000000000000000 P 4968966c4a2642c39fb765ac06f4b61c: Log is configured to *not* fsync() on all Append() calls
I20260811 00:59:56.275043 17396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4968966c4a2642c39fb765ac06f4b61c: No bootstrap required, opened a new log
I20260811 00:59:56.276847 17396 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4968966c4a2642c39fb765ac06f4b61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4968966c4a2642c39fb765ac06f4b61c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40823 } }
I20260811 00:59:56.277009 17396 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4968966c4a2642c39fb765ac06f4b61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:59:56.277034 17396 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4968966c4a2642c39fb765ac06f4b61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4968966c4a2642c39fb765ac06f4b61c, State: Initialized, Role: FOLLOWER
I20260811 00:59:56.277221 17396 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4968966c4a2642c39fb765ac06f4b61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4968966c4a2642c39fb765ac06f4b61c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40823 } }
I20260811 00:59:56.277318 17396 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4968966c4a2642c39fb765ac06f4b61c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:59:56.277364 17396 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4968966c4a2642c39fb765ac06f4b61c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:59:56.277424 17396 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4968966c4a2642c39fb765ac06f4b61c [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:59:56.278024 17396 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4968966c4a2642c39fb765ac06f4b61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4968966c4a2642c39fb765ac06f4b61c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40823 } }
I20260811 00:59:56.278123 17396 leader_election.cc:302] T 00000000000000000000000000000000 P 4968966c4a2642c39fb765ac06f4b61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4968966c4a2642c39fb765ac06f4b61c; no voters:
I20260811 00:59:56.278329 17396 leader_election.cc:288] T 00000000000000000000000000000000 P 4968966c4a2642c39fb765ac06f4b61c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:59:56.278446 17402 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4968966c4a2642c39fb765ac06f4b61c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:59:56.278647 17402 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4968966c4a2642c39fb765ac06f4b61c [term 1 LEADER]: Becoming Leader. State: Replica: 4968966c4a2642c39fb765ac06f4b61c, State: Running, Role: LEADER
I20260811 00:59:56.278729 17396 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4968966c4a2642c39fb765ac06f4b61c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:59:56.278817 17402 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4968966c4a2642c39fb765ac06f4b61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4968966c4a2642c39fb765ac06f4b61c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40823 } }
I20260811 00:59:56.279052 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 17290
I20260811 00:59:56.279217 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 00:59:56.279496 15640 external_mini_cluster.cc:1428] Setting key 8b4f8385afdd6f29e4228d3d3473c339
I20260811 00:59:56.279440 17403 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4968966c4a2642c39fb765ac06f4b61c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4968966c4a2642c39fb765ac06f4b61c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4968966c4a2642c39fb765ac06f4b61c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40823 } } }
I20260811 00:59:56.279568 17403 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4968966c4a2642c39fb765ac06f4b61c [sys.catalog]: This master's current role is: LEADER
I20260811 00:59:56.279434 17404 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4968966c4a2642c39fb765ac06f4b61c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4968966c4a2642c39fb765ac06f4b61c. Latest consensus state: current_term: 1 leader_uuid: "4968966c4a2642c39fb765ac06f4b61c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4968966c4a2642c39fb765ac06f4b61c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40823 } } }
I20260811 00:59:56.279753 17404 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4968966c4a2642c39fb765ac06f4b61c [sys.catalog]: This master's current role is: LEADER
I20260811 00:59:56.280194 17408 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:59:56.281167 17408 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:59:56.283201 17408 catalog_manager.cc:1347] Generated new cluster ID: db383e87cbfd4da389a5df03b549fd33
I20260811 00:59:56.283267 17408 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:59:56.287213 17419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:56.280406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.166:33917 (local address 127.0.0.1:40823)
0811 00:59:56.280785 (+ 379us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:56.280798 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:56.280843 (+ 45us) server_negotiation.cc:407] Connection header received
0811 00:59:56.280998 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:56.281007 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:56.281093 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:56.281655 (+ 562us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:56.281760 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:56.283332 (+ 1572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:56.284610 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:56.285305 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:56.285432 (+ 127us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:56.286369 (+ 937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:56.286374 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:56.286374 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:59:56.286634 (+ 260us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:56.286679 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:59:56.286695 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:56.286782 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:56.286897 (+ 115us) server_negotiation.cc:299] Negotiation successful
0811 00:59:56.286928 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":228,"threads_started":1}
I20260811 00:59:56.288365 15640 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 00:59:56.294235 17419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:56.290206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.166:37505 (local address 127.0.0.1:40823)
0811 00:59:56.290247 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:56.290249 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:56.290360 (+ 111us) server_negotiation.cc:407] Connection header received
0811 00:59:56.290415 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:56.290415 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:56.290427 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:56.290499 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:56.290648 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:56.291508 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:56.292620 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:56.292966 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:56.293035 (+ 69us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:56.293938 (+ 903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:56.293940 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:56.293940 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:59:56.293946 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:56.293964 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:59:56.293969 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:56.294030 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:56.294117 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 00:59:56.294132 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":19}
I20260811 00:59:56.310209 17408 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:59:56.310941 17408 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:59:56.322593 17408 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4968966c4a2642c39fb765ac06f4b61c: Generated new TSK 0
I20260811 00:59:56.322908 17408 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:59:56.329583 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 17290
W20260811 00:59:56.349776 17270 connection.cc:535] client connection to 127.0.0.1:40823 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40823): Connection reset by peer (error 104)
2026-08-11T00:59:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1737 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409704606556-15640-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:59:56 dist-test-slave-h3ft krb5kdc[17443](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:59:56 dist-test-slave-h3ft krb5kdc[17443](info): set up 2 sockets
Aug 11 00:59:56 dist-test-slave-h3ft krb5kdc[17443](info): commencing operation
krb5kdc: starting...
W20260811 00:59:57.673055 15640 mini_kdc.cc:121] Time spent starting KDC: real 1.308s user 0.001s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Aug 11 00:59:57 dist-test-slave-h3ft krb5kdc[17443](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409997, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:59:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:59:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 00:59:57.827106 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43007
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43007
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:59:57.925482 17461 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:59:57.925820 17461 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:59:57.925863 17461 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:59:57.927198 17461 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:59:57.927284 17461 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:59:57.927309 17461 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:59:57.927330 17461 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:59:57.927386 17461 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:59:57.929198 17461 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43007
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43007
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17461
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:59:57.929574 17461 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:59:57.929878 17461 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:59:57.936224 17483 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:57.936226 17476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:57.936224 17472 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:57.936580 17461 server_base.cc:1034] running on GCE node
I20260811 00:59:57.936968 17461 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:59:57.937337 17461 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:59:57.938567 17461 hybrid_clock.cc:648] HybridClock initialized: now 1786409997938542 us; error 38 us; skew 500 ppm
Aug 11 00:59:57 dist-test-slave-h3ft krb5kdc[17443](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409997, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:59:57.945714 17461 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 00:59:57.946434 17461 webserver.cc:460] Webserver started at http://127.0.0.1:46727/ using document root <none> and password file <none>
I20260811 00:59:57.946768 17461 fs_manager.cc:359] Metadata directory not provided
I20260811 00:59:57.946830 17461 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:59:57.947069 17461 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:59:57.948529 17461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "9d0d00c4a7894bbda790323bda602a27"
format_stamp: "Formatted at 2026-08-11 00:59:57 on dist-test-slave-h3ft"
server_key: "37071021fec044b134e39e7fa77b15a8"
server_key_iv: "d0e48a69fb935a9e05a01aaf3a92f09f"
server_key_version: "encryptionkey@0"
I20260811 00:59:57.949024 17461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "9d0d00c4a7894bbda790323bda602a27"
format_stamp: "Formatted at 2026-08-11 00:59:57 on dist-test-slave-h3ft"
server_key: "37071021fec044b134e39e7fa77b15a8"
server_key_iv: "d0e48a69fb935a9e05a01aaf3a92f09f"
server_key_version: "encryptionkey@0"
I20260811 00:59:57.950826 17461 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.001s
I20260811 00:59:57.952076 17491 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:57.952325 17461 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:59:57.952467 17461 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "9d0d00c4a7894bbda790323bda602a27"
format_stamp: "Formatted at 2026-08-11 00:59:57 on dist-test-slave-h3ft"
server_key: "37071021fec044b134e39e7fa77b15a8"
server_key_iv: "d0e48a69fb935a9e05a01aaf3a92f09f"
server_key_version: "encryptionkey@0"
I20260811 00:59:57.952566 17461 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:59:57.956797 17461 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:59:57.959744 17461 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:59:57.959951 17461 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:59:57.965773 17461 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43007
I20260811 00:59:57.965813 17577 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43007 every 8 connection(s)
I20260811 00:59:57.966368 17461 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:59:57.967795 17578 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:59:57.970639 17578 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d0d00c4a7894bbda790323bda602a27: Bootstrap starting.
I20260811 00:59:57.971453 17578 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9d0d00c4a7894bbda790323bda602a27: Neither blocks nor log segments found. Creating new log.
I20260811 00:59:57.971805 17578 log.cc:824] T 00000000000000000000000000000000 P 9d0d00c4a7894bbda790323bda602a27: Log is configured to *not* fsync() on all Append() calls
I20260811 00:59:57.972726 17578 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d0d00c4a7894bbda790323bda602a27: No bootstrap required, opened a new log
I20260811 00:59:57.974602 17578 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9d0d00c4a7894bbda790323bda602a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d0d00c4a7894bbda790323bda602a27" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43007 } }
I20260811 00:59:57.974773 17578 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9d0d00c4a7894bbda790323bda602a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:59:57.974797 17578 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9d0d00c4a7894bbda790323bda602a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d0d00c4a7894bbda790323bda602a27, State: Initialized, Role: FOLLOWER
I20260811 00:59:57.974987 17578 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9d0d00c4a7894bbda790323bda602a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d0d00c4a7894bbda790323bda602a27" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43007 } }
I20260811 00:59:57.975152 17578 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9d0d00c4a7894bbda790323bda602a27 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:59:57.975200 17578 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9d0d00c4a7894bbda790323bda602a27 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:59:57.975272 17578 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9d0d00c4a7894bbda790323bda602a27 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:59:57.975312 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 17461
I20260811 00:59:57.975499 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 00:59:57.975754 15640 external_mini_cluster.cc:1428] Setting key 1d2d3a0bd4ea6e9b1ec9b4558d513f82
I20260811 00:59:57.976135 17578 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9d0d00c4a7894bbda790323bda602a27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d0d00c4a7894bbda790323bda602a27" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43007 } }
I20260811 00:59:57.976282 17578 leader_election.cc:302] T 00000000000000000000000000000000 P 9d0d00c4a7894bbda790323bda602a27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9d0d00c4a7894bbda790323bda602a27; no voters:
I20260811 00:59:57.976526 17578 leader_election.cc:288] T 00000000000000000000000000000000 P 9d0d00c4a7894bbda790323bda602a27 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:59:57.976548 17582 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9d0d00c4a7894bbda790323bda602a27 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:59:57.976780 17582 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9d0d00c4a7894bbda790323bda602a27 [term 1 LEADER]: Becoming Leader. State: Replica: 9d0d00c4a7894bbda790323bda602a27, State: Running, Role: LEADER
I20260811 00:59:57.976930 17578 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9d0d00c4a7894bbda790323bda602a27 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:59:57.976954 17582 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9d0d00c4a7894bbda790323bda602a27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d0d00c4a7894bbda790323bda602a27" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43007 } }
I20260811 00:59:57.977340 17582 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d0d00c4a7894bbda790323bda602a27 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9d0d00c4a7894bbda790323bda602a27" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d0d00c4a7894bbda790323bda602a27" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43007 } } }
I20260811 00:59:57.977432 17582 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d0d00c4a7894bbda790323bda602a27 [sys.catalog]: This master's current role is: LEADER
I20260811 00:59:57.977581 17582 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d0d00c4a7894bbda790323bda602a27 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d0d00c4a7894bbda790323bda602a27. Latest consensus state: current_term: 1 leader_uuid: "9d0d00c4a7894bbda790323bda602a27" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d0d00c4a7894bbda790323bda602a27" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43007 } } }
I20260811 00:59:57.977633 17582 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d0d00c4a7894bbda790323bda602a27 [sys.catalog]: This master's current role is: LEADER
I20260811 00:59:57.978504 17594 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:59:57.979204 17590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:57.976704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.166:55139 (local address 127.0.0.1:43007)
0811 00:59:57.976994 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:57.977008 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:57.977056 (+ 48us) server_negotiation.cc:407] Connection header received
0811 00:59:57.977220 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:57.977228 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:57.977259 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:57.977807 (+ 548us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:57.978404 (+ 597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:57.978408 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:57.978409 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:59:57.978427 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:57.978490 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:59:57.978511 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:57.978839 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:57.978878 (+ 39us) server_negotiation.cc:299] Negotiation successful
0811 00:59:57.978933 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":102,"threads_started":1}
I20260811 00:59:57.979302 17594 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:59:57.980489 15640 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 00:59:57.982287 17594 catalog_manager.cc:1347] Generated new cluster ID: 999f9847e4244d27ac5fab179af2cb06
I20260811 00:59:57.982354 17594 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:59:57.984376 17590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:57.982639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.166:40179 (local address 127.0.0.1:43007)
0811 00:59:57.982702 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:57.982705 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:57.983263 (+ 558us) server_negotiation.cc:407] Connection header received
0811 00:59:57.983320 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:57.983321 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:57.983328 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:57.983403 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:57.984114 (+ 711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:57.984115 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:57.984116 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:59:57.984120 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:57.984141 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:59:57.984146 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:57.984216 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:57.984273 (+ 57us) server_negotiation.cc:299] Negotiation successful
0811 00:59:57.984291 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 00:59:57.990882 17594 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:59:57.991122 17594 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:59:58.000272 17594 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9d0d00c4a7894bbda790323bda602a27: Generated new TSK 0
I20260811 00:59:58.000548 17594 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:59:58.003712 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 17461
2026-08-11T00:59:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1682 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409704606556-15640-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:59:58 dist-test-slave-h3ft krb5kdc[17628](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:59:58 dist-test-slave-h3ft krb5kdc[17628](info): set up 2 sockets
Aug 11 00:59:58 dist-test-slave-h3ft krb5kdc[17628](info): commencing operation
krb5kdc: starting...
W20260811 00:59:59.359813 15640 mini_kdc.cc:121] Time spent starting KDC: real 1.312s user 0.003s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Aug 11 00:59:59 dist-test-slave-h3ft krb5kdc[17628](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409999, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:59:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:59:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 00:59:59.515338 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39591
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39591
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:59:59.610941 17646 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:59:59.611231 17646 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:59:59.611258 17646 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:59:59.612565 17646 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:59:59.612629 17646 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:59:59.612644 17646 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:59:59.612658 17646 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:59:59.612670 17646 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:59:59.614245 17646 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39591
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39591
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17646
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:59:59.614506 17646 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:59:59.614737 17646 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:59:59.620864 17657 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:59.620992 17660 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:59:59.620864 17655 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:59:59.621105 17646 server_base.cc:1034] running on GCE node
I20260811 00:59:59.621495 17646 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:59:59.621862 17646 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:59:59.623093 17646 hybrid_clock.cc:648] HybridClock initialized: now 1786409999623064 us; error 63 us; skew 500 ppm
Aug 11 00:59:59 dist-test-slave-h3ft krb5kdc[17628](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409999, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:59:59.626278 17646 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 00:59:59.626816 17646 webserver.cc:460] Webserver started at http://127.0.0.1:39257/ using document root <none> and password file <none>
I20260811 00:59:59.627168 17646 fs_manager.cc:359] Metadata directory not provided
I20260811 00:59:59.627241 17646 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:59:59.627419 17646 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:59:59.628685 17646 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "20cb9e9fb0d54458995130178971e742"
format_stamp: "Formatted at 2026-08-11 00:59:59 on dist-test-slave-h3ft"
server_key: "00bf60c23bcca145931db7881d621288"
server_key_iv: "222a1ba85687bd58dae617892aff8b34"
server_key_version: "encryptionkey@0"
I20260811 00:59:59.629097 17646 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "20cb9e9fb0d54458995130178971e742"
format_stamp: "Formatted at 2026-08-11 00:59:59 on dist-test-slave-h3ft"
server_key: "00bf60c23bcca145931db7881d621288"
server_key_iv: "222a1ba85687bd58dae617892aff8b34"
server_key_version: "encryptionkey@0"
I20260811 00:59:59.630605 17646 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 00:59:59.631521 17673 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:59:59.631734 17646 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 00:59:59.631851 17646 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "20cb9e9fb0d54458995130178971e742"
format_stamp: "Formatted at 2026-08-11 00:59:59 on dist-test-slave-h3ft"
server_key: "00bf60c23bcca145931db7881d621288"
server_key_iv: "222a1ba85687bd58dae617892aff8b34"
server_key_version: "encryptionkey@0"
I20260811 00:59:59.631932 17646 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:59:59.650137 17646 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:59:59.652751 17646 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:59:59.652949 17646 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:59:59.658376 17646 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39591
I20260811 00:59:59.658420 17747 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39591 every 8 connection(s)
I20260811 00:59:59.658871 17646 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 00:59:59.660046 17749 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:59:59.662966 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 17646
I20260811 00:59:59.663054 17749 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 20cb9e9fb0d54458995130178971e742: Bootstrap starting.
I20260811 00:59:59.663120 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 00:59:59.663348 15640 external_mini_cluster.cc:1428] Setting key 2a954ae811e68b6fb9379da2374838a2
I20260811 00:59:59.663915 17749 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 20cb9e9fb0d54458995130178971e742: Neither blocks nor log segments found. Creating new log.
I20260811 00:59:59.664361 17749 log.cc:824] T 00000000000000000000000000000000 P 20cb9e9fb0d54458995130178971e742: Log is configured to *not* fsync() on all Append() calls
I20260811 00:59:59.665383 17749 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 20cb9e9fb0d54458995130178971e742: No bootstrap required, opened a new log
I20260811 00:59:59.668186 17749 raft_consensus.cc:348] T 00000000000000000000000000000000 P 20cb9e9fb0d54458995130178971e742 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20cb9e9fb0d54458995130178971e742" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39591 } }
I20260811 00:59:59.668381 17749 raft_consensus.cc:374] T 00000000000000000000000000000000 P 20cb9e9fb0d54458995130178971e742 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:59:59.668417 17749 raft_consensus.cc:729] T 00000000000000000000000000000000 P 20cb9e9fb0d54458995130178971e742 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20cb9e9fb0d54458995130178971e742, State: Initialized, Role: FOLLOWER
I20260811 00:59:59.668566 17749 consensus_queue.cc:260] T 00000000000000000000000000000000 P 20cb9e9fb0d54458995130178971e742 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20cb9e9fb0d54458995130178971e742" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39591 } }
I20260811 00:59:59.668668 17749 raft_consensus.cc:388] T 00000000000000000000000000000000 P 20cb9e9fb0d54458995130178971e742 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:59:59.668720 17749 raft_consensus.cc:482] T 00000000000000000000000000000000 P 20cb9e9fb0d54458995130178971e742 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:59:59.668776 17749 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 20cb9e9fb0d54458995130178971e742 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:59:59.669598 17749 raft_consensus.cc:504] T 00000000000000000000000000000000 P 20cb9e9fb0d54458995130178971e742 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20cb9e9fb0d54458995130178971e742" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39591 } }
I20260811 00:59:59.669746 17749 leader_election.cc:302] T 00000000000000000000000000000000 P 20cb9e9fb0d54458995130178971e742 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 20cb9e9fb0d54458995130178971e742; no voters:
I20260811 00:59:59.669967 17749 leader_election.cc:288] T 00000000000000000000000000000000 P 20cb9e9fb0d54458995130178971e742 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:59:59.670022 17756 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 20cb9e9fb0d54458995130178971e742 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:59:59.670224 17756 raft_consensus.cc:686] T 00000000000000000000000000000000 P 20cb9e9fb0d54458995130178971e742 [term 1 LEADER]: Becoming Leader. State: Replica: 20cb9e9fb0d54458995130178971e742, State: Running, Role: LEADER
I20260811 00:59:59.670305 17749 sys_catalog.cc:564] T 00000000000000000000000000000000 P 20cb9e9fb0d54458995130178971e742 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:59:59.670418 17756 consensus_queue.cc:237] T 00000000000000000000000000000000 P 20cb9e9fb0d54458995130178971e742 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20cb9e9fb0d54458995130178971e742" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39591 } }
I20260811 00:59:59.670904 17757 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20cb9e9fb0d54458995130178971e742 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "20cb9e9fb0d54458995130178971e742" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20cb9e9fb0d54458995130178971e742" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39591 } } }
I20260811 00:59:59.670884 17759 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20cb9e9fb0d54458995130178971e742 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 20cb9e9fb0d54458995130178971e742. Latest consensus state: current_term: 1 leader_uuid: "20cb9e9fb0d54458995130178971e742" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20cb9e9fb0d54458995130178971e742" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39591 } } }
I20260811 00:59:59.670992 17757 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20cb9e9fb0d54458995130178971e742 [sys.catalog]: This master's current role is: LEADER
I20260811 00:59:59.671027 17759 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20cb9e9fb0d54458995130178971e742 [sys.catalog]: This master's current role is: LEADER
I20260811 00:59:59.671881 17769 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 11 00:59:59 dist-test-slave-h3ft krb5kdc[17628](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409999, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 00:59:59.672468 17769 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:59:59.674474 17769 catalog_manager.cc:1347] Generated new cluster ID: 0290162b0aff4e279b1c965205144c93
I20260811 00:59:59.674530 17769 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:59:59.677218 17754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:59.664044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.166:48971 (local address 127.0.0.1:39591)
0811 00:59:59.664276 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:59.664292 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:59.664322 (+ 30us) server_negotiation.cc:407] Connection header received
0811 00:59:59.665059 (+ 737us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:59.665067 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:59.665127 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:59.665269 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:59.666309 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:59.667421 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:59.668574 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:59.669133 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:59.669233 (+ 100us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:59.672896 (+ 3663us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:59.672900 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:59.672901 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:59:59.672915 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:59.675336 (+ 2421us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:59.675834 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:59.675837 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:59.675838 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:59.675954 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:59.676221 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:59.676221 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:59.676222 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:59.676535 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:59.676700 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:59.676849 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 00:59:59.676955 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":109,"threads_started":1}
I20260811 00:59:59.678268 15640 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 00:59:59.684340 17769 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:59:59.684914 17769 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:59:59.688764 17754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:59:59.680279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.166:39775 (local address 127.0.0.1:39591)
0811 00:59:59.680316 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 00:59:59.680318 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:59:59.680330 (+ 12us) server_negotiation.cc:407] Connection header received
0811 00:59:59.680424 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:59:59.680425 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:59:59.680436 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:59:59.680490 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:59:59.681185 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:59.681994 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:59.683104 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:59:59.683415 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:59:59.683488 (+ 73us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:59:59.685129 (+ 1641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:59:59.685131 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:59:59.685131 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:59:59.685138 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:59:59.687186 (+ 2048us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:59.687700 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:59.687701 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:59.687702 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:59.687773 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:59:59.688023 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:59:59.688023 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:59:59.688024 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:59:59.688166 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:59:59.688277 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 00:59:59.688451 (+ 174us) server_negotiation.cc:299] Negotiation successful
0811 00:59:59.688523 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":18}
I20260811 00:59:59.692751 17769 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 20cb9e9fb0d54458995130178971e742: Generated new TSK 0
I20260811 00:59:59.693032 17769 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:59:59.701102 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 17646
W20260811 00:59:59.724721 17624 connection.cc:535] client connection to 127.0.0.1:39591 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39591): Connection reset by peer (error 104)
2026-08-11T00:59:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1692 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409704606556-15640-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:59:59 dist-test-slave-h3ft krb5kdc[17796](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:59:59 dist-test-slave-h3ft krb5kdc[17796](info): set up 2 sockets
Aug 11 00:59:59 dist-test-slave-h3ft krb5kdc[17796](info): commencing operation
krb5kdc: starting...
W20260811 01:00:01.078064 15640 mini_kdc.cc:121] Time spent starting KDC: real 1.338s user 0.007s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Aug 11 01:00:01 dist-test-slave-h3ft krb5kdc[17796](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410001, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:00:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:00:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 01:00:01.245739 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41919
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41919
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:01.346921 17817 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:01.347276 17817 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:01.347321 17817 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:01.348631 17817 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:00:01.348714 17817 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:01.348740 17817 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:01.348762 17817 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:00:01.348791 17817 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:00:01.350580 17817 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41919
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41919
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17817
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:01.350944 17817 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:01.351276 17817 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 01:00:01.357733 17817 server_base.cc:1034] running on GCE node
W20260811 01:00:01.357710 17826 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:01.357710 17825 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:01.357697 17833 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:01.358402 17817 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:01.358781 17817 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:01.360157 17817 hybrid_clock.cc:648] HybridClock initialized: now 1786410001360133 us; error 48 us; skew 500 ppm
Aug 11 01:00:01 dist-test-slave-h3ft krb5kdc[17796](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410001, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:01.363720 17817 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 01:00:01.364351 17817 webserver.cc:460] Webserver started at http://127.0.0.1:36447/ using document root <none> and password file <none>
I20260811 01:00:01.364662 17817 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:01.364737 17817 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:01.364953 17817 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:01.366376 17817 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "0d155c40e95047aaa7ce70dbd4f95e03"
format_stamp: "Formatted at 2026-08-11 01:00:01 on dist-test-slave-h3ft"
server_key: "ae1bebeec39965b722b6e48084ebf7ab"
server_key_iv: "e52b97f8dd8761170243db880d3d7315"
server_key_version: "encryptionkey@0"
I20260811 01:00:01.366807 17817 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "0d155c40e95047aaa7ce70dbd4f95e03"
format_stamp: "Formatted at 2026-08-11 01:00:01 on dist-test-slave-h3ft"
server_key: "ae1bebeec39965b722b6e48084ebf7ab"
server_key_iv: "e52b97f8dd8761170243db880d3d7315"
server_key_version: "encryptionkey@0"
I20260811 01:00:01.368696 17817 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.001s
I20260811 01:00:01.369956 17846 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:01.370239 17817 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260811 01:00:01.370376 17817 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "0d155c40e95047aaa7ce70dbd4f95e03"
format_stamp: "Formatted at 2026-08-11 01:00:01 on dist-test-slave-h3ft"
server_key: "ae1bebeec39965b722b6e48084ebf7ab"
server_key_iv: "e52b97f8dd8761170243db880d3d7315"
server_key_version: "encryptionkey@0"
I20260811 01:00:01.370505 17817 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:01.382650 17817 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:01.385717 17817 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:01.385947 17817 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:01.391467 17817 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41919
I20260811 01:00:01.391570 17923 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41919 every 8 connection(s)
I20260811 01:00:01.392009 17817 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 01:00:01.393224 17924 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:01.394897 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 17817
I20260811 01:00:01.395114 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 01:00:01.395401 15640 external_mini_cluster.cc:1428] Setting key 8431c1c4e9b34f9d089cceaaaec1dd81
I20260811 01:00:01.397184 17924 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0d155c40e95047aaa7ce70dbd4f95e03: Bootstrap starting.
I20260811 01:00:01.398080 17924 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0d155c40e95047aaa7ce70dbd4f95e03: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:01.398452 17924 log.cc:824] T 00000000000000000000000000000000 P 0d155c40e95047aaa7ce70dbd4f95e03: Log is configured to *not* fsync() on all Append() calls
I20260811 01:00:01.399497 17924 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0d155c40e95047aaa7ce70dbd4f95e03: No bootstrap required, opened a new log
I20260811 01:00:01.401808 17924 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0d155c40e95047aaa7ce70dbd4f95e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d155c40e95047aaa7ce70dbd4f95e03" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41919 } }
I20260811 01:00:01.402011 17924 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0d155c40e95047aaa7ce70dbd4f95e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:01.402040 17924 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0d155c40e95047aaa7ce70dbd4f95e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d155c40e95047aaa7ce70dbd4f95e03, State: Initialized, Role: FOLLOWER
I20260811 01:00:01.402201 17924 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0d155c40e95047aaa7ce70dbd4f95e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d155c40e95047aaa7ce70dbd4f95e03" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41919 } }
I20260811 01:00:01.402318 17924 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0d155c40e95047aaa7ce70dbd4f95e03 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:00:01.402415 17924 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0d155c40e95047aaa7ce70dbd4f95e03 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:00:01.402508 17924 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0d155c40e95047aaa7ce70dbd4f95e03 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:01.402915 17932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:01.396152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.166:49391 (local address 127.0.0.1:41919)
0811 01:00:01.396386 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:01.396396 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:01.396429 (+ 33us) server_negotiation.cc:407] Connection header received
0811 01:00:01.396936 (+ 507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:01.396944 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:01.397017 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:01.397175 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:01.397496 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:01.398681 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:01.399901 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:01.400424 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:01.400529 (+ 105us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:01.401806 (+ 1277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:01.401811 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:01.401811 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:00:01.402176 (+ 365us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:01.402232 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:00:01.402251 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:01.402381 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:01.402674 (+ 293us) server_negotiation.cc:299] Negotiation successful
0811 01:00:01.402707 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":124,"threads_started":1}
I20260811 01:00:01.403559 17924 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0d155c40e95047aaa7ce70dbd4f95e03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d155c40e95047aaa7ce70dbd4f95e03" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41919 } }
I20260811 01:00:01.403726 17924 leader_election.cc:302] T 00000000000000000000000000000000 P 0d155c40e95047aaa7ce70dbd4f95e03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0d155c40e95047aaa7ce70dbd4f95e03; no voters:
I20260811 01:00:01.404029 17924 leader_election.cc:288] T 00000000000000000000000000000000 P 0d155c40e95047aaa7ce70dbd4f95e03 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:00:01.404157 17934 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0d155c40e95047aaa7ce70dbd4f95e03 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:00:01.404440 17934 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0d155c40e95047aaa7ce70dbd4f95e03 [term 1 LEADER]: Becoming Leader. State: Replica: 0d155c40e95047aaa7ce70dbd4f95e03, State: Running, Role: LEADER
I20260811 01:00:01.404474 15640 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:00:01.404482 17924 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0d155c40e95047aaa7ce70dbd4f95e03 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:00:01.404634 17934 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0d155c40e95047aaa7ce70dbd4f95e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d155c40e95047aaa7ce70dbd4f95e03" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41919 } }
I20260811 01:00:01.405179 17935 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d155c40e95047aaa7ce70dbd4f95e03 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0d155c40e95047aaa7ce70dbd4f95e03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d155c40e95047aaa7ce70dbd4f95e03" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41919 } } }
I20260811 01:00:01.405151 17936 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d155c40e95047aaa7ce70dbd4f95e03 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0d155c40e95047aaa7ce70dbd4f95e03. Latest consensus state: current_term: 1 leader_uuid: "0d155c40e95047aaa7ce70dbd4f95e03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d155c40e95047aaa7ce70dbd4f95e03" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41919 } } }
I20260811 01:00:01.405305 17936 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d155c40e95047aaa7ce70dbd4f95e03 [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:01.405303 17935 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d155c40e95047aaa7ce70dbd4f95e03 [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:01.406463 17943 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:00:01.407342 17943 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:00:01.409694 17943 catalog_manager.cc:1347] Generated new cluster ID: f263252c8c2f40a08c39c40dee25cbeb
I20260811 01:00:01.409775 17943 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:00:01.411507 17932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:01.406726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.166:42335 (local address 127.0.0.1:41919)
0811 01:00:01.406775 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:01.406777 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:01.407232 (+ 455us) server_negotiation.cc:407] Connection header received
0811 01:00:01.407318 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:01.407320 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:01.407336 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:01.407425 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:01.407664 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:01.408455 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:01.409651 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:01.410017 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:01.410092 (+ 75us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:01.411174 (+ 1082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:01.411175 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:01.411176 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:00:01.411183 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:01.411223 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:00:01.411228 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:01.411262 (+ 34us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:01.411398 (+ 136us) server_negotiation.cc:299] Negotiation successful
0811 01:00:01.411414 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 01:00:01.419713 17943 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:00:01.420411 17943 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:00:01.422531 17943 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0d155c40e95047aaa7ce70dbd4f95e03: Generated new TSK 0
I20260811 01:00:01.422811 17943 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:00:01.433117 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 17817
W20260811 01:00:01.467432 17794 connection.cc:535] client connection to 127.0.0.1:41919 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41919): Connection reset by peer (error 104)
2026-08-11T01:00:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1742 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409704606556-15640-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:00:01 dist-test-slave-h3ft krb5kdc[17969](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:00:01 dist-test-slave-h3ft krb5kdc[17969](info): set up 2 sockets
Aug 11 01:00:01 dist-test-slave-h3ft krb5kdc[17969](info): commencing operation
krb5kdc: starting...
W20260811 01:00:02.815917 15640 mini_kdc.cc:121] Time spent starting KDC: real 1.333s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Aug 11 01:00:02 dist-test-slave-h3ft krb5kdc[17969](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410002, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:00:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:00:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 01:00:02.979274 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40145
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40145
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:03.082693 17989 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:03.083112 17989 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:03.083238 17989 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:03.084926 17989 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:00:03.084997 17989 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:03.085019 17989 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:03.085034 17989 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:00:03.085047 17989 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:00:03.087196 17989 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40145
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409704606556-15640-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40145
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17989
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:03.087598 17989 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:03.087922 17989 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:03.094554 18000 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:03.094558 17998 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:03.094587 17997 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:03.094887 17989 server_base.cc:1034] running on GCE node
I20260811 01:00:03.095414 17989 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:03.095857 17989 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:03.097126 17989 hybrid_clock.cc:648] HybridClock initialized: now 1786410003097103 us; error 46 us; skew 500 ppm
Aug 11 01:00:03 dist-test-slave-h3ft krb5kdc[17969](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410003, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:03.108822 17989 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 01:00:03.109663 17989 webserver.cc:460] Webserver started at http://127.0.0.1:37073/ using document root <none> and password file <none>
I20260811 01:00:03.110018 17989 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:03.110102 17989 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:03.110293 17989 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:03.112020 17989 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "b8344f6bc1d849b596505e1331305861"
format_stamp: "Formatted at 2026-08-11 01:00:03 on dist-test-slave-h3ft"
server_key: "b05028d67d89ed8c1457074f100d011a"
server_key_iv: "40bb9368e814b894726a84e81f4e3eca"
server_key_version: "encryptionkey@0"
I20260811 01:00:03.112499 17989 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "b8344f6bc1d849b596505e1331305861"
format_stamp: "Formatted at 2026-08-11 01:00:03 on dist-test-slave-h3ft"
server_key: "b05028d67d89ed8c1457074f100d011a"
server_key_iv: "40bb9368e814b894726a84e81f4e3eca"
server_key_version: "encryptionkey@0"
I20260811 01:00:03.114291 17989 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260811 01:00:03.115578 18013 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:03.115861 17989 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 01:00:03.115976 17989 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "b8344f6bc1d849b596505e1331305861"
format_stamp: "Formatted at 2026-08-11 01:00:03 on dist-test-slave-h3ft"
server_key: "b05028d67d89ed8c1457074f100d011a"
server_key_iv: "40bb9368e814b894726a84e81f4e3eca"
server_key_version: "encryptionkey@0"
I20260811 01:00:03.116050 17989 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:03.120473 17989 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:03.123512 17989 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:03.123755 17989 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:03.130744 17989 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40145
I20260811 01:00:03.130792 18093 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40145 every 8 connection(s)
I20260811 01:00:03.131325 17989 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 01:00:03.132776 18096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:03.135761 18096 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8344f6bc1d849b596505e1331305861: Bootstrap starting.
I20260811 01:00:03.136507 18096 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b8344f6bc1d849b596505e1331305861: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:03.136852 18096 log.cc:824] T 00000000000000000000000000000000 P b8344f6bc1d849b596505e1331305861: Log is configured to *not* fsync() on all Append() calls
I20260811 01:00:03.137739 18096 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8344f6bc1d849b596505e1331305861: No bootstrap required, opened a new log
I20260811 01:00:03.138131 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 17989
I20260811 01:00:03.138309 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 01:00:03.138571 15640 external_mini_cluster.cc:1428] Setting key 9a7a02fc57a3c7a63e7d2d653a272b30
I20260811 01:00:03.140178 18096 raft_consensus.cc:348] T 00000000000000000000000000000000 P b8344f6bc1d849b596505e1331305861 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8344f6bc1d849b596505e1331305861" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40145 } }
I20260811 01:00:03.140370 18096 raft_consensus.cc:374] T 00000000000000000000000000000000 P b8344f6bc1d849b596505e1331305861 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:03.140440 18096 raft_consensus.cc:729] T 00000000000000000000000000000000 P b8344f6bc1d849b596505e1331305861 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8344f6bc1d849b596505e1331305861, State: Initialized, Role: FOLLOWER
I20260811 01:00:03.140650 18096 consensus_queue.cc:260] T 00000000000000000000000000000000 P b8344f6bc1d849b596505e1331305861 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8344f6bc1d849b596505e1331305861" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40145 } }
I20260811 01:00:03.141129 18096 raft_consensus.cc:388] T 00000000000000000000000000000000 P b8344f6bc1d849b596505e1331305861 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:00:03.141198 18096 raft_consensus.cc:482] T 00000000000000000000000000000000 P b8344f6bc1d849b596505e1331305861 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:00:03.141300 18096 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b8344f6bc1d849b596505e1331305861 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:03.141932 18101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:03.139365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.166:60107 (local address 127.0.0.1:40145)
0811 01:00:03.139658 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:03.139685 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:03.139768 (+ 83us) server_negotiation.cc:407] Connection header received
0811 01:00:03.140150 (+ 382us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:03.140158 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:03.140191 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:03.140361 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:03.141288 (+ 927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:03.141293 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:03.141293 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:00:03.141299 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:03.141358 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:00:03.141377 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:03.141469 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:03.141619 (+ 150us) server_negotiation.cc:299] Negotiation successful
0811 01:00:03.141673 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":100,"threads_started":1}
I20260811 01:00:03.142277 18096 raft_consensus.cc:504] T 00000000000000000000000000000000 P b8344f6bc1d849b596505e1331305861 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8344f6bc1d849b596505e1331305861" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40145 } }
I20260811 01:00:03.142452 18096 leader_election.cc:302] T 00000000000000000000000000000000 P b8344f6bc1d849b596505e1331305861 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b8344f6bc1d849b596505e1331305861; no voters:
I20260811 01:00:03.142679 18096 leader_election.cc:288] T 00000000000000000000000000000000 P b8344f6bc1d849b596505e1331305861 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:00:03.142951 18103 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b8344f6bc1d849b596505e1331305861 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:00:03.143055 18096 sys_catalog.cc:564] T 00000000000000000000000000000000 P b8344f6bc1d849b596505e1331305861 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:00:03.143255 15640 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:00:03.144802 18103 raft_consensus.cc:686] T 00000000000000000000000000000000 P b8344f6bc1d849b596505e1331305861 [term 1 LEADER]: Becoming Leader. State: Replica: b8344f6bc1d849b596505e1331305861, State: Running, Role: LEADER
I20260811 01:00:03.144960 18103 consensus_queue.cc:237] T 00000000000000000000000000000000 P b8344f6bc1d849b596505e1331305861 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8344f6bc1d849b596505e1331305861" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40145 } }
I20260811 01:00:03.145439 18103 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8344f6bc1d849b596505e1331305861 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b8344f6bc1d849b596505e1331305861. Latest consensus state: current_term: 1 leader_uuid: "b8344f6bc1d849b596505e1331305861" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8344f6bc1d849b596505e1331305861" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40145 } } }
I20260811 01:00:03.145536 18103 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8344f6bc1d849b596505e1331305861 [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:03.145754 18131 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:00:03.145761 18105 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8344f6bc1d849b596505e1331305861 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b8344f6bc1d849b596505e1331305861" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8344f6bc1d849b596505e1331305861" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40145 } } }
I20260811 01:00:03.145893 18105 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8344f6bc1d849b596505e1331305861 [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:03.146557 18131 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:00:03.147174 18101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:03.145034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.166:46007 (local address 127.0.0.1:40145)
0811 01:00:03.145123 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:03.145126 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:03.145292 (+ 166us) server_negotiation.cc:407] Connection header received
0811 01:00:03.145390 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:03.145391 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:03.145400 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:03.145472 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:03.146821 (+ 1349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:03.146823 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:03.146823 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:00:03.146828 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:03.146846 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:00:03.146851 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:03.146906 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:03.146987 (+ 81us) server_negotiation.cc:299] Negotiation successful
0811 01:00:03.147118 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 01:00:03.148733 18131 catalog_manager.cc:1347] Generated new cluster ID: 8af55e7545f64da48f54ac0a31b0be0f
I20260811 01:00:03.148801 18131 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:00:03.164456 18131 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:00:03.164719 18131 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:00:03.173208 18131 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b8344f6bc1d849b596505e1331305861: Generated new TSK 0
I20260811 01:00:03.173523 18131 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:00:03.182588 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 17989
2026-08-11T01:00:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1736 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409704606556-15640-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:00:03 dist-test-slave-h3ft krb5kdc[18145](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:00:03 dist-test-slave-h3ft krb5kdc[18145](info): set up 2 sockets
Aug 11 01:00:03 dist-test-slave-h3ft krb5kdc[18145](info): commencing operation
krb5kdc: starting...
W20260811 01:00:04.524467 15640 mini_kdc.cc:121] Time spent starting KDC: real 1.304s user 0.007s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Aug 11 01:00:04 dist-test-slave-h3ft krb5kdc[18145](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410004, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:00:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:00:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.70.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
I20260811 01:00:04.699222 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:37403
--webserver_interface=127.15.70.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:43923
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:37403
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:04.814648 18166 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:04.815196 18166 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:04.815268 18166 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:04.818653 18166 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:00:04.818756 18166 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:04.818784 18166 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:04.818809 18166 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:00:04.818833 18166 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:00:04.821863 18166 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:43923
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:37403
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:37403
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18166
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:04.822355 18166 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:04.822788 18166 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:04.832188 18172 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:04.832450 18166 server_base.cc:1034] running on GCE node
W20260811 01:00:04.832219 18171 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:04.832188 18178 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:04.833137 18166 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:04.833767 18166 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:04.835137 18166 hybrid_clock.cc:648] HybridClock initialized: now 1786410004835107 us; error 54 us; skew 500 ppm
Aug 11 01:00:04 dist-test-slave-h3ft krb5kdc[18145](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410004, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:04.839141 18166 init.cc:377] Logged in from keytab as kudu/127.15.70.62@KRBTEST.COM (short username kudu)
I20260811 01:00:04.839887 18166 webserver.cc:460] Webserver started at http://127.15.70.62:34329/ using document root <none> and password file <none>
I20260811 01:00:04.840248 18166 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:04.840328 18166 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:04.840520 18166 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:04.842407 18166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "327ba83201a7497393fa8382723163c8"
format_stamp: "Formatted at 2026-08-11 01:00:04 on dist-test-slave-h3ft"
server_key: "e10cef5882947ab4d39f099580346abc"
server_key_iv: "e41fb69cdea10cfab5d073cee5097234"
server_key_version: "encryptionkey@0"
I20260811 01:00:04.843057 18166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "327ba83201a7497393fa8382723163c8"
format_stamp: "Formatted at 2026-08-11 01:00:04 on dist-test-slave-h3ft"
server_key: "e10cef5882947ab4d39f099580346abc"
server_key_iv: "e41fb69cdea10cfab5d073cee5097234"
server_key_version: "encryptionkey@0"
I20260811 01:00:04.845518 18166 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.001s
I20260811 01:00:04.847150 18189 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:04.847410 18166 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:00:04.847533 18166 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "327ba83201a7497393fa8382723163c8"
format_stamp: "Formatted at 2026-08-11 01:00:04 on dist-test-slave-h3ft"
server_key: "e10cef5882947ab4d39f099580346abc"
server_key_iv: "e41fb69cdea10cfab5d073cee5097234"
server_key_version: "encryptionkey@0"
I20260811 01:00:04.847651 18166 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:04.864670 18166 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:04.867931 18166 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:04.868165 18166 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:04.873931 18166 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:37403
I20260811 01:00:04.873997 18275 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:37403 every 8 connection(s)
I20260811 01:00:04.874504 18166 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 01:00:04.875888 18276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:04.878954 18276 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 327ba83201a7497393fa8382723163c8: Bootstrap starting.
I20260811 01:00:04.879796 18276 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 327ba83201a7497393fa8382723163c8: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:04.880173 18276 log.cc:824] T 00000000000000000000000000000000 P 327ba83201a7497393fa8382723163c8: Log is configured to *not* fsync() on all Append() calls
I20260811 01:00:04.881204 18276 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 327ba83201a7497393fa8382723163c8: No bootstrap required, opened a new log
I20260811 01:00:04.882388 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 18166
I20260811 01:00:04.882529 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 01:00:04.882740 15640 external_mini_cluster.cc:1428] Setting key cb26c572a8be509ef9b523bfaa1e4096
I20260811 01:00:04.883949 18276 raft_consensus.cc:348] T 00000000000000000000000000000000 P 327ba83201a7497393fa8382723163c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "327ba83201a7497393fa8382723163c8" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 37403 } }
I20260811 01:00:04.884152 18276 raft_consensus.cc:374] T 00000000000000000000000000000000 P 327ba83201a7497393fa8382723163c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:04.884194 18276 raft_consensus.cc:729] T 00000000000000000000000000000000 P 327ba83201a7497393fa8382723163c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 327ba83201a7497393fa8382723163c8, State: Initialized, Role: FOLLOWER
I20260811 01:00:04.884348 18276 consensus_queue.cc:260] T 00000000000000000000000000000000 P 327ba83201a7497393fa8382723163c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "327ba83201a7497393fa8382723163c8" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 37403 } }
I20260811 01:00:04.884451 18276 raft_consensus.cc:388] T 00000000000000000000000000000000 P 327ba83201a7497393fa8382723163c8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:00:04.884490 18276 raft_consensus.cc:482] T 00000000000000000000000000000000 P 327ba83201a7497393fa8382723163c8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:00:04.884547 18276 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 327ba83201a7497393fa8382723163c8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:04.885788 18276 raft_consensus.cc:504] T 00000000000000000000000000000000 P 327ba83201a7497393fa8382723163c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "327ba83201a7497393fa8382723163c8" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 37403 } }
I20260811 01:00:04.885926 18276 leader_election.cc:302] T 00000000000000000000000000000000 P 327ba83201a7497393fa8382723163c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 327ba83201a7497393fa8382723163c8; no voters:
I20260811 01:00:04.886138 18276 leader_election.cc:288] T 00000000000000000000000000000000 P 327ba83201a7497393fa8382723163c8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:00:04.886189 18288 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 327ba83201a7497393fa8382723163c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:00:04.886363 18288 raft_consensus.cc:686] T 00000000000000000000000000000000 P 327ba83201a7497393fa8382723163c8 [term 1 LEADER]: Becoming Leader. State: Replica: 327ba83201a7497393fa8382723163c8, State: Running, Role: LEADER
I20260811 01:00:04.886473 18276 sys_catalog.cc:564] T 00000000000000000000000000000000 P 327ba83201a7497393fa8382723163c8 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:00:04.886479 18288 consensus_queue.cc:237] T 00000000000000000000000000000000 P 327ba83201a7497393fa8382723163c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "327ba83201a7497393fa8382723163c8" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 37403 } }
I20260811 01:00:04.886915 18288 sys_catalog.cc:455] T 00000000000000000000000000000000 P 327ba83201a7497393fa8382723163c8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 327ba83201a7497393fa8382723163c8. Latest consensus state: current_term: 1 leader_uuid: "327ba83201a7497393fa8382723163c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "327ba83201a7497393fa8382723163c8" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 37403 } } }
I20260811 01:00:04.887038 18288 sys_catalog.cc:458] T 00000000000000000000000000000000 P 327ba83201a7497393fa8382723163c8 [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:04.887401 18291 sys_catalog.cc:455] T 00000000000000000000000000000000 P 327ba83201a7497393fa8382723163c8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "327ba83201a7497393fa8382723163c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "327ba83201a7497393fa8382723163c8" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 37403 } } }
I20260811 01:00:04.887490 18291 sys_catalog.cc:458] T 00000000000000000000000000000000 P 327ba83201a7497393fa8382723163c8 [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:04.887629 18298 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:00:04.888247 18298 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:00:04.890095 18298 catalog_manager.cc:1347] Generated new cluster ID: 4c33d777e1724f13a84ab5ef2b232790
I20260811 01:00:04.890151 18298 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 01:00:04 dist-test-slave-h3ft krb5kdc[18145](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410004, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 01:00:04.896431 18285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:04.883527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35751 (local address 127.15.70.62:37403)
0811 01:00:04.883763 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:04.883773 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:04.883803 (+ 30us) server_negotiation.cc:407] Connection header received
0811 01:00:04.883924 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:04.883930 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:04.883980 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:04.884117 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:04.885114 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:04.886320 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:04.887511 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:04.888187 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:04.888309 (+ 122us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:04.891781 (+ 3472us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:04.891786 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:04.891786 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:04.891803 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:04.894205 (+ 2402us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:04.894768 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:04.894773 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:04.894773 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:04.894955 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:04.895248 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:04.895249 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:04.895249 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:04.895694 (+ 445us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:04.895925 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:04.896025 (+ 100us) server_negotiation.cc:299] Negotiation successful
0811 01:00:04.896159 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":134,"threads_started":1}
I20260811 01:00:04.898250 15640 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:00:04.909240 18285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:04.900292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51591 (local address 127.15.70.62:37403)
0811 01:00:04.900355 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:04.900358 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:04.900573 (+ 215us) server_negotiation.cc:407] Connection header received
0811 01:00:04.900681 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:04.900682 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:04.900695 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:04.900732 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:04.901561 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:04.902428 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:04.903555 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:04.903933 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:04.904019 (+ 86us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:04.905787 (+ 1768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:04.905789 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:04.905789 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:04.905798 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:04.907716 (+ 1918us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:04.908216 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:04.908218 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:04.908218 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:04.908295 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:04.908605 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:04.908606 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:04.908607 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:04.908775 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:04.908916 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:04.909032 (+ 116us) server_negotiation.cc:299] Negotiation successful
0811 01:00:04.909114 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 01:00:04.913483 18298 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:00:04.914297 18298 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:00:04.920506 18298 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 327ba83201a7497393fa8382723163c8: Generated new TSK 0
I20260811 01:00:04.920835 18298 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:00:04.927027 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 18166
W20260811 01:00:04.946673 18138 connection.cc:535] client connection to 127.15.70.62:37403 recv error: Network error: failed to read from TLS socket (remote: 127.15.70.62:37403): Connection reset by peer (error 104)
2026-08-11T01:00:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1743 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409704606556-15640-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:00:05 dist-test-slave-h3ft krb5kdc[18328](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:00:05 dist-test-slave-h3ft krb5kdc[18328](info): set up 2 sockets
Aug 11 01:00:05 dist-test-slave-h3ft krb5kdc[18328](info): commencing operation
krb5kdc: starting...
W20260811 01:00:06.338054 15640 mini_kdc.cc:121] Time spent starting KDC: real 1.375s user 0.004s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Aug 11 01:00:06 dist-test-slave-h3ft krb5kdc[18328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410006, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:00:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:00:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.70.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
I20260811 01:00:06.516592 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:46777
--webserver_interface=127.15.70.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:46193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:46777
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:06.625555 18353 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:06.625885 18353 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:06.625921 18353 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:06.627584 18353 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:00:06.627655 18353 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:06.627671 18353 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:06.627684 18353 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:00:06.627698 18353 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:00:06.629657 18353 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:46193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:46777
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:46777
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18353
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:06.630053 18353 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:06.630374 18353 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 01:00:06.636865 18353 server_base.cc:1034] running on GCE node
W20260811 01:00:06.636826 18370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:06.636826 18366 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:06.636826 18364 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:06.637488 18353 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:06.637889 18353 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:06.639102 18353 hybrid_clock.cc:648] HybridClock initialized: now 1786410006639084 us; error 48 us; skew 500 ppm
Aug 11 01:00:06 dist-test-slave-h3ft krb5kdc[18328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410006, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:06.642561 18353 init.cc:377] Logged in from keytab as kudu/127.15.70.62@KRBTEST.COM (short username kudu)
I20260811 01:00:06.643326 18353 webserver.cc:460] Webserver started at http://127.15.70.62:44111/ using document root <none> and password file <none>
I20260811 01:00:06.643625 18353 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:06.643700 18353 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:06.643884 18353 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:06.645331 18353 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "f8b15de31ee54be1a8d636c186f31bd4"
format_stamp: "Formatted at 2026-08-11 01:00:06 on dist-test-slave-h3ft"
server_key: "5b9a083004e38955f68aefea7fc45da3"
server_key_iv: "f97797521b98086d12f28984d09964ba"
server_key_version: "encryptionkey@0"
I20260811 01:00:06.645787 18353 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "f8b15de31ee54be1a8d636c186f31bd4"
format_stamp: "Formatted at 2026-08-11 01:00:06 on dist-test-slave-h3ft"
server_key: "5b9a083004e38955f68aefea7fc45da3"
server_key_iv: "f97797521b98086d12f28984d09964ba"
server_key_version: "encryptionkey@0"
I20260811 01:00:06.647684 18353 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260811 01:00:06.649024 18382 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:06.649416 18353 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:00:06.649600 18353 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "f8b15de31ee54be1a8d636c186f31bd4"
format_stamp: "Formatted at 2026-08-11 01:00:06 on dist-test-slave-h3ft"
server_key: "5b9a083004e38955f68aefea7fc45da3"
server_key_iv: "f97797521b98086d12f28984d09964ba"
server_key_version: "encryptionkey@0"
I20260811 01:00:06.649727 18353 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:06.664991 18353 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:06.668512 18353 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:06.668713 18353 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:06.674577 18353 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:46777
I20260811 01:00:06.674631 18463 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:46777 every 8 connection(s)
I20260811 01:00:06.675338 18353 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 01:00:06.675920 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 18353
I20260811 01:00:06.676106 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 01:00:06.676340 15640 external_mini_cluster.cc:1428] Setting key 71b0221a2ec9a37fdca0c5c055ee7789
I20260811 01:00:06.676971 18464 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:06.681463 18464 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8b15de31ee54be1a8d636c186f31bd4: Bootstrap starting.
I20260811 01:00:06.682535 18464 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f8b15de31ee54be1a8d636c186f31bd4: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:06.682991 18464 log.cc:824] T 00000000000000000000000000000000 P f8b15de31ee54be1a8d636c186f31bd4: Log is configured to *not* fsync() on all Append() calls
I20260811 01:00:06.684190 18469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:06.677096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39309 (local address 127.15.70.62:46777)
0811 01:00:06.677342 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:06.677352 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:06.677385 (+ 33us) server_negotiation.cc:407] Connection header received
0811 01:00:06.677949 (+ 564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:06.677956 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:06.678030 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:06.678189 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:06.678617 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:06.679750 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:06.681111 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:06.681730 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:06.681868 (+ 138us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:06.682880 (+ 1012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:06.682886 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:06.682886 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:00:06.683221 (+ 335us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:06.683282 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:00:06.683299 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:06.683767 (+ 468us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:06.683902 (+ 135us) server_negotiation.cc:299] Negotiation successful
0811 01:00:06.683940 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":126,"threads_started":1}
I20260811 01:00:06.684312 18464 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8b15de31ee54be1a8d636c186f31bd4: No bootstrap required, opened a new log
I20260811 01:00:06.685830 15640 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:00:06.687454 18464 raft_consensus.cc:348] T 00000000000000000000000000000000 P f8b15de31ee54be1a8d636c186f31bd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8b15de31ee54be1a8d636c186f31bd4" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 46777 } }
I20260811 01:00:06.687685 18464 raft_consensus.cc:374] T 00000000000000000000000000000000 P f8b15de31ee54be1a8d636c186f31bd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:06.687713 18464 raft_consensus.cc:729] T 00000000000000000000000000000000 P f8b15de31ee54be1a8d636c186f31bd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8b15de31ee54be1a8d636c186f31bd4, State: Initialized, Role: FOLLOWER
I20260811 01:00:06.687906 18464 consensus_queue.cc:260] T 00000000000000000000000000000000 P f8b15de31ee54be1a8d636c186f31bd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8b15de31ee54be1a8d636c186f31bd4" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 46777 } }
I20260811 01:00:06.688019 18464 raft_consensus.cc:388] T 00000000000000000000000000000000 P f8b15de31ee54be1a8d636c186f31bd4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:00:06.688068 18464 raft_consensus.cc:482] T 00000000000000000000000000000000 P f8b15de31ee54be1a8d636c186f31bd4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:00:06.688130 18464 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f8b15de31ee54be1a8d636c186f31bd4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:06.689293 18464 raft_consensus.cc:504] T 00000000000000000000000000000000 P f8b15de31ee54be1a8d636c186f31bd4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8b15de31ee54be1a8d636c186f31bd4" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 46777 } }
I20260811 01:00:06.689455 18464 leader_election.cc:302] T 00000000000000000000000000000000 P f8b15de31ee54be1a8d636c186f31bd4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f8b15de31ee54be1a8d636c186f31bd4; no voters:
I20260811 01:00:06.689692 18464 leader_election.cc:288] T 00000000000000000000000000000000 P f8b15de31ee54be1a8d636c186f31bd4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:00:06.689764 18479 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f8b15de31ee54be1a8d636c186f31bd4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:00:06.690040 18464 sys_catalog.cc:564] T 00000000000000000000000000000000 P f8b15de31ee54be1a8d636c186f31bd4 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:00:06.690053 18479 raft_consensus.cc:686] T 00000000000000000000000000000000 P f8b15de31ee54be1a8d636c186f31bd4 [term 1 LEADER]: Becoming Leader. State: Replica: f8b15de31ee54be1a8d636c186f31bd4, State: Running, Role: LEADER
I20260811 01:00:06.690200 18479 consensus_queue.cc:237] T 00000000000000000000000000000000 P f8b15de31ee54be1a8d636c186f31bd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8b15de31ee54be1a8d636c186f31bd4" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 46777 } }
I20260811 01:00:06.690629 18479 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8b15de31ee54be1a8d636c186f31bd4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f8b15de31ee54be1a8d636c186f31bd4. Latest consensus state: current_term: 1 leader_uuid: "f8b15de31ee54be1a8d636c186f31bd4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8b15de31ee54be1a8d636c186f31bd4" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 46777 } } }
I20260811 01:00:06.690670 18480 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8b15de31ee54be1a8d636c186f31bd4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f8b15de31ee54be1a8d636c186f31bd4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8b15de31ee54be1a8d636c186f31bd4" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 46777 } } }
I20260811 01:00:06.690742 18480 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8b15de31ee54be1a8d636c186f31bd4 [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:06.690740 18479 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8b15de31ee54be1a8d636c186f31bd4 [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:06.692492 18469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:06.688076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43879 (local address 127.15.70.62:46777)
0811 01:00:06.688159 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:06.688163 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:06.688294 (+ 131us) server_negotiation.cc:407] Connection header received
0811 01:00:06.688387 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:06.688388 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:06.688404 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:06.688470 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:06.688623 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:06.689373 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:06.690592 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:06.690912 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:06.691019 (+ 107us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:06.692131 (+ 1112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:06.692133 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:06.692133 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:00:06.692141 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:06.692165 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:00:06.692171 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:06.692227 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:06.692358 (+ 131us) server_negotiation.cc:299] Negotiation successful
0811 01:00:06.692375 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
W20260811 01:00:06.692907 18504 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f8b15de31ee54be1a8d636c186f31bd4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 01:00:06.692978 18504 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 01:00:06.693043 18496 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:00:06.693285 18496 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:00:06.695345 18496 catalog_manager.cc:1347] Generated new cluster ID: 74e88a17f4e541d59233f5b97a9b1661
I20260811 01:00:06.695408 18496 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:00:06.718684 18496 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:00:06.719802 18496 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:00:06.728364 18496 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f8b15de31ee54be1a8d636c186f31bd4: Generated new TSK 0
I20260811 01:00:06.728721 18496 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:00:06.739822 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 18353
W20260811 01:00:06.761610 18325 connection.cc:535] client connection to 127.15.70.62:46777 recv error: Network error: failed to read from TLS socket (remote: 127.15.70.62:46777): Connection reset by peer (error 104)
2026-08-11T01:00:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1814 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409704606556-15640-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:00:06 dist-test-slave-h3ft krb5kdc[18510](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:00:06 dist-test-slave-h3ft krb5kdc[18510](info): set up 2 sockets
Aug 11 01:00:06 dist-test-slave-h3ft krb5kdc[18510](info): commencing operation
krb5kdc: starting...
W20260811 01:00:08.160697 15640 mini_kdc.cc:121] Time spent starting KDC: real 1.384s user 0.000s sys 0.010s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Aug 11 01:00:08 dist-test-slave-h3ft krb5kdc[18510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:00:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:00:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.70.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
I20260811 01:00:08.332329 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:38723
--webserver_interface=127.15.70.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:33009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:38723
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:08.443073 18529 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:08.443432 18529 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:08.443495 18529 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:08.445019 18529 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:00:08.445108 18529 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:08.445133 18529 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:08.445158 18529 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:00:08.445185 18529 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:00:08.447188 18529 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:33009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:38723
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:38723
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18529
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:08.447587 18529 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:08.447906 18529 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:08.454761 18541 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:08.454967 18529 server_base.cc:1034] running on GCE node
W20260811 01:00:08.454761 18539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:08.454819 18544 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:08.455621 18529 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:08.456094 18529 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:08.457307 18529 hybrid_clock.cc:648] HybridClock initialized: now 1786410008457286 us; error 54 us; skew 500 ppm
Aug 11 01:00:08 dist-test-slave-h3ft krb5kdc[18510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410008, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:08.465180 18529 init.cc:377] Logged in from keytab as kudu/127.15.70.62@KRBTEST.COM (short username kudu)
I20260811 01:00:08.466033 18529 webserver.cc:460] Webserver started at http://127.15.70.62:40081/ using document root <none> and password file <none>
I20260811 01:00:08.466418 18529 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:08.466486 18529 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:08.466912 18529 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:08.468463 18529 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "9efe262e81014f5082dc18509c43b720"
format_stamp: "Formatted at 2026-08-11 01:00:08 on dist-test-slave-h3ft"
server_key: "2d9a6b76c21a64a6204606f283f66593"
server_key_iv: "a367c5af364ea47c6fbe73486f095020"
server_key_version: "encryptionkey@0"
I20260811 01:00:08.468966 18529 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "9efe262e81014f5082dc18509c43b720"
format_stamp: "Formatted at 2026-08-11 01:00:08 on dist-test-slave-h3ft"
server_key: "2d9a6b76c21a64a6204606f283f66593"
server_key_iv: "a367c5af364ea47c6fbe73486f095020"
server_key_version: "encryptionkey@0"
I20260811 01:00:08.470948 18529 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 01:00:08.472153 18553 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:08.472632 18529 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:00:08.472805 18529 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "9efe262e81014f5082dc18509c43b720"
format_stamp: "Formatted at 2026-08-11 01:00:08 on dist-test-slave-h3ft"
server_key: "2d9a6b76c21a64a6204606f283f66593"
server_key_iv: "a367c5af364ea47c6fbe73486f095020"
server_key_version: "encryptionkey@0"
I20260811 01:00:08.472975 18529 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:08.477648 18529 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:08.480820 18529 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:08.481014 18529 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:08.486718 18529 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:38723
I20260811 01:00:08.486765 18638 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:38723 every 8 connection(s)
I20260811 01:00:08.487512 18529 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 01:00:08.489218 18639 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:08.491328 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 18529
I20260811 01:00:08.491516 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 01:00:08.491736 15640 external_mini_cluster.cc:1428] Setting key 07b0415ce8304e8c0a6c2cd8a9dc4fb9
I20260811 01:00:08.493384 18639 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9efe262e81014f5082dc18509c43b720: Bootstrap starting.
I20260811 01:00:08.494400 18639 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9efe262e81014f5082dc18509c43b720: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:08.494895 18639 log.cc:824] T 00000000000000000000000000000000 P 9efe262e81014f5082dc18509c43b720: Log is configured to *not* fsync() on all Append() calls
I20260811 01:00:08.495421 18646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:08.492513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41989 (local address 127.15.70.62:38723)
0811 01:00:08.492808 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:08.492822 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:08.492870 (+ 48us) server_negotiation.cc:407] Connection header received
0811 01:00:08.493596 (+ 726us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:08.493607 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:08.493648 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:08.493855 (+ 207us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:08.494724 (+ 869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:08.494728 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:08.494728 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:00:08.494734 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:08.494797 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:00:08.494817 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:08.494929 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:08.495075 (+ 146us) server_negotiation.cc:299] Negotiation successful
0811 01:00:08.495130 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":213,"thread_start_us":144,"threads_started":1}
I20260811 01:00:08.496027 18639 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9efe262e81014f5082dc18509c43b720: No bootstrap required, opened a new log
I20260811 01:00:08.496858 15640 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:00:08.499444 18639 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9efe262e81014f5082dc18509c43b720 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9efe262e81014f5082dc18509c43b720" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 38723 } }
I20260811 01:00:08.499751 18639 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9efe262e81014f5082dc18509c43b720 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:08.499805 18639 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9efe262e81014f5082dc18509c43b720 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9efe262e81014f5082dc18509c43b720, State: Initialized, Role: FOLLOWER
I20260811 01:00:08.499991 18639 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9efe262e81014f5082dc18509c43b720 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9efe262e81014f5082dc18509c43b720" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 38723 } }
I20260811 01:00:08.500109 18639 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9efe262e81014f5082dc18509c43b720 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:00:08.500157 18639 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9efe262e81014f5082dc18509c43b720 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:00:08.500216 18639 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9efe262e81014f5082dc18509c43b720 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:08.500692 18646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:08.499205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49973 (local address 127.15.70.62:38723)
0811 01:00:08.499283 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:08.499286 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:08.499421 (+ 135us) server_negotiation.cc:407] Connection header received
0811 01:00:08.499510 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:08.499510 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:08.499516 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:08.499563 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:08.500400 (+ 837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:08.500402 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:08.500403 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:00:08.500407 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:08.500426 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:00:08.500431 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:08.500485 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:08.500578 (+ 93us) server_negotiation.cc:299] Negotiation successful
0811 01:00:08.500591 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 01:00:08.501367 18639 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9efe262e81014f5082dc18509c43b720 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9efe262e81014f5082dc18509c43b720" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 38723 } }
I20260811 01:00:08.501680 18639 leader_election.cc:302] T 00000000000000000000000000000000 P 9efe262e81014f5082dc18509c43b720 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9efe262e81014f5082dc18509c43b720; no voters:
I20260811 01:00:08.501964 18639 leader_election.cc:288] T 00000000000000000000000000000000 P 9efe262e81014f5082dc18509c43b720 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:00:08.502090 18657 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9efe262e81014f5082dc18509c43b720 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:00:08.502290 18657 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9efe262e81014f5082dc18509c43b720 [term 1 LEADER]: Becoming Leader. State: Replica: 9efe262e81014f5082dc18509c43b720, State: Running, Role: LEADER
I20260811 01:00:08.502341 18639 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9efe262e81014f5082dc18509c43b720 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:00:08.502413 18657 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9efe262e81014f5082dc18509c43b720 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9efe262e81014f5082dc18509c43b720" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 38723 } }
I20260811 01:00:08.502964 18663 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9efe262e81014f5082dc18509c43b720 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9efe262e81014f5082dc18509c43b720. Latest consensus state: current_term: 1 leader_uuid: "9efe262e81014f5082dc18509c43b720" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9efe262e81014f5082dc18509c43b720" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 38723 } } }
I20260811 01:00:08.503130 18663 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9efe262e81014f5082dc18509c43b720 [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:08.503408 18671 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:00:08.503415 18662 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9efe262e81014f5082dc18509c43b720 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9efe262e81014f5082dc18509c43b720" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9efe262e81014f5082dc18509c43b720" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 38723 } } }
I20260811 01:00:08.503932 18662 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9efe262e81014f5082dc18509c43b720 [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:08.504142 18671 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:00:08.506254 18671 catalog_manager.cc:1347] Generated new cluster ID: af82babb252c44dd9984cc7d091d07cd
I20260811 01:00:08.506330 18671 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:00:08.527810 18671 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:00:08.528090 18671 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:00:08.543884 18671 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9efe262e81014f5082dc18509c43b720: Generated new TSK 0
I20260811 01:00:08.544217 18671 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:00:08.558701 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 18529
2026-08-11T01:00:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1822 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409704606556-15640-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:00:08 dist-test-slave-h3ft krb5kdc[18684](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:00:08 dist-test-slave-h3ft krb5kdc[18684](info): set up 2 sockets
Aug 11 01:00:08 dist-test-slave-h3ft krb5kdc[18684](info): commencing operation
krb5kdc: starting...
W20260811 01:00:09.992420 15640 mini_kdc.cc:121] Time spent starting KDC: real 1.393s user 0.000s sys 0.010s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Aug 11 01:00:10 dist-test-slave-h3ft krb5kdc[18684](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410010, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:00:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:00:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.70.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
I20260811 01:00:10.169679 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:46195
--webserver_interface=127.15.70.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:34657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:46195
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:10.268229 18699 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:10.268512 18699 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:10.268543 18699 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:10.270009 18699 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:00:10.270087 18699 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:10.270104 18699 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:10.270118 18699 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:00:10.270131 18699 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:00:10.272056 18699 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:34657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:46195
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:46195
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18699
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:10.272431 18699 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:10.272792 18699 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:10.279153 18710 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:10.279168 18715 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:10.279279 18699 server_base.cc:1034] running on GCE node
W20260811 01:00:10.279247 18711 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:10.279913 18699 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:10.280267 18699 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:10.281428 18699 hybrid_clock.cc:648] HybridClock initialized: now 1786410010281406 us; error 46 us; skew 500 ppm
Aug 11 01:00:10 dist-test-slave-h3ft krb5kdc[18684](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410010, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:10.284932 18699 init.cc:377] Logged in from keytab as kudu/127.15.70.62@KRBTEST.COM (short username kudu)
I20260811 01:00:10.285662 18699 webserver.cc:460] Webserver started at http://127.15.70.62:33865/ using document root <none> and password file <none>
I20260811 01:00:10.285977 18699 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:10.286059 18699 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:10.286240 18699 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:10.287736 18699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "6da88426f44b443693f2eb61c50fec9f"
format_stamp: "Formatted at 2026-08-11 01:00:10 on dist-test-slave-h3ft"
server_key: "3b80e392df4eac3a6ab24eb24d98e460"
server_key_iv: "c707eb983e59578cb50a142d385ec69e"
server_key_version: "encryptionkey@0"
I20260811 01:00:10.288455 18699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "6da88426f44b443693f2eb61c50fec9f"
format_stamp: "Formatted at 2026-08-11 01:00:10 on dist-test-slave-h3ft"
server_key: "3b80e392df4eac3a6ab24eb24d98e460"
server_key_iv: "c707eb983e59578cb50a142d385ec69e"
server_key_version: "encryptionkey@0"
I20260811 01:00:10.290535 18699 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260811 01:00:10.291771 18725 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:10.292060 18699 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:00:10.292207 18699 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "6da88426f44b443693f2eb61c50fec9f"
format_stamp: "Formatted at 2026-08-11 01:00:10 on dist-test-slave-h3ft"
server_key: "3b80e392df4eac3a6ab24eb24d98e460"
server_key_iv: "c707eb983e59578cb50a142d385ec69e"
server_key_version: "encryptionkey@0"
I20260811 01:00:10.292315 18699 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:10.304210 18699 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:10.307085 18699 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:10.307310 18699 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:10.313015 18699 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:46195
I20260811 01:00:10.313045 18812 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:46195 every 8 connection(s)
I20260811 01:00:10.313565 18699 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 01:00:10.314994 18813 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:10.318086 18813 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6da88426f44b443693f2eb61c50fec9f: Bootstrap starting.
I20260811 01:00:10.318799 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 18699
I20260811 01:00:10.318944 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 01:00:10.319276 18813 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6da88426f44b443693f2eb61c50fec9f: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:10.319387 15640 external_mini_cluster.cc:1428] Setting key 11aac9b8f56486104098649867b2ce4a
I20260811 01:00:10.319722 18813 log.cc:824] T 00000000000000000000000000000000 P 6da88426f44b443693f2eb61c50fec9f: Log is configured to *not* fsync() on all Append() calls
I20260811 01:00:10.320818 18813 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6da88426f44b443693f2eb61c50fec9f: No bootstrap required, opened a new log
I20260811 01:00:10.323741 18813 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6da88426f44b443693f2eb61c50fec9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6da88426f44b443693f2eb61c50fec9f" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 46195 } }
I20260811 01:00:10.324013 18813 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6da88426f44b443693f2eb61c50fec9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:10.324062 18813 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6da88426f44b443693f2eb61c50fec9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6da88426f44b443693f2eb61c50fec9f, State: Initialized, Role: FOLLOWER
I20260811 01:00:10.324234 18813 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6da88426f44b443693f2eb61c50fec9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6da88426f44b443693f2eb61c50fec9f" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 46195 } }
I20260811 01:00:10.324326 18813 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6da88426f44b443693f2eb61c50fec9f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:00:10.324359 18813 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6da88426f44b443693f2eb61c50fec9f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:00:10.324409 18813 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6da88426f44b443693f2eb61c50fec9f [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:10.325314 18813 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6da88426f44b443693f2eb61c50fec9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6da88426f44b443693f2eb61c50fec9f" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 46195 } }
I20260811 01:00:10.325484 18813 leader_election.cc:302] T 00000000000000000000000000000000 P 6da88426f44b443693f2eb61c50fec9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6da88426f44b443693f2eb61c50fec9f; no voters:
I20260811 01:00:10.325753 18813 leader_election.cc:288] T 00000000000000000000000000000000 P 6da88426f44b443693f2eb61c50fec9f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:00:10.325876 18822 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6da88426f44b443693f2eb61c50fec9f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:00:10.326146 18813 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6da88426f44b443693f2eb61c50fec9f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:00:10.326200 18822 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6da88426f44b443693f2eb61c50fec9f [term 1 LEADER]: Becoming Leader. State: Replica: 6da88426f44b443693f2eb61c50fec9f, State: Running, Role: LEADER
I20260811 01:00:10.326431 18822 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6da88426f44b443693f2eb61c50fec9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6da88426f44b443693f2eb61c50fec9f" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 46195 } }
I20260811 01:00:10.327178 18824 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6da88426f44b443693f2eb61c50fec9f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6da88426f44b443693f2eb61c50fec9f. Latest consensus state: current_term: 1 leader_uuid: "6da88426f44b443693f2eb61c50fec9f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6da88426f44b443693f2eb61c50fec9f" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 46195 } } }
I20260811 01:00:10.327276 18824 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6da88426f44b443693f2eb61c50fec9f [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:10.327826 18833 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:00:10.328447 18833 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 01:00:10 dist-test-slave-h3ft krb5kdc[18684](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410010, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 01:00:10.329419 18823 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6da88426f44b443693f2eb61c50fec9f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6da88426f44b443693f2eb61c50fec9f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6da88426f44b443693f2eb61c50fec9f" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 46195 } } }
I20260811 01:00:10.329620 18823 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6da88426f44b443693f2eb61c50fec9f [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:10.330796 18833 catalog_manager.cc:1347] Generated new cluster ID: d1a25b534a474ded83fff2192d9bd4b3
I20260811 01:00:10.330904 18833 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:00:10.333664 18821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:10.320267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47827 (local address 127.15.70.62:46195)
0811 01:00:10.320505 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:10.320516 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:10.320547 (+ 31us) server_negotiation.cc:407] Connection header received
0811 01:00:10.321224 (+ 677us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:10.321233 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:10.321296 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:10.321448 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:10.322440 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:10.323614 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:10.324785 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:10.325284 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:10.325386 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:10.329205 (+ 3819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:10.329211 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:10.329211 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:10.329227 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:10.331715 (+ 2488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:10.332230 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:10.332234 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:10.332234 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:10.332356 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:10.332615 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:10.332615 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:10.332616 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:10.332957 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:10.333123 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:10.333259 (+ 136us) server_negotiation.cc:299] Negotiation successful
0811 01:00:10.333414 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":109,"threads_started":1}
I20260811 01:00:10.335311 15640 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:00:10.345060 18821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:10.337234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58637 (local address 127.15.70.62:46195)
0811 01:00:10.337276 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:10.337278 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:10.337287 (+ 9us) server_negotiation.cc:407] Connection header received
0811 01:00:10.337311 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:10.337312 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:10.337324 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:10.337389 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:10.338070 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:10.338889 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:10.339926 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:10.340260 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:10.340339 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:10.341895 (+ 1556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:10.341898 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:10.341898 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:10.341906 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:10.343721 (+ 1815us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:10.344164 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:10.344165 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:10.344166 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:10.344242 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:10.344449 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:10.344449 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:10.344450 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:10.344618 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:10.344729 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:10.344833 (+ 104us) server_negotiation.cc:299] Negotiation successful
0811 01:00:10.344935 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 01:00:10.347559 18833 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:00:10.348081 18833 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:00:10.357336 18833 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6da88426f44b443693f2eb61c50fec9f: Generated new TSK 0
I20260811 01:00:10.357592 18833 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:00:10.363289 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 18699
2026-08-11T01:00:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1799 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409704606556-15640-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:00:10 dist-test-slave-h3ft krb5kdc[18858](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:00:10 dist-test-slave-h3ft krb5kdc[18858](info): set up 2 sockets
Aug 11 01:00:10 dist-test-slave-h3ft krb5kdc[18858](info): commencing operation
krb5kdc: starting...
W20260811 01:00:11.809751 15640 mini_kdc.cc:121] Time spent starting KDC: real 1.410s user 0.005s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Aug 11 01:00:11 dist-test-slave-h3ft krb5kdc[18858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410011, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:00:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:00:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.70.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
I20260811 01:00:11.975785 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:37079
--webserver_interface=127.15.70.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:34981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:37079
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:12.086985 18874 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:12.087404 18874 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:12.087442 18874 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:12.089275 18874 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:00:12.089386 18874 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:12.089406 18874 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:12.089422 18874 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:00:12.089437 18874 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:00:12.091872 18874 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:34981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:37079
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:37079
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18874
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:12.092332 18874 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:12.092731 18874 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:12.099982 18886 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:12.099988 18882 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:12.100061 18884 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:12.100622 18874 server_base.cc:1034] running on GCE node
I20260811 01:00:12.101001 18874 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:12.101485 18874 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:12.102695 18874 hybrid_clock.cc:648] HybridClock initialized: now 1786410012102669 us; error 46 us; skew 500 ppm
Aug 11 01:00:12 dist-test-slave-h3ft krb5kdc[18858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410012, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:12.106554 18874 init.cc:377] Logged in from keytab as kudu/127.15.70.62@KRBTEST.COM (short username kudu)
I20260811 01:00:12.107287 18874 webserver.cc:460] Webserver started at http://127.15.70.62:40497/ using document root <none> and password file <none>
I20260811 01:00:12.107650 18874 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:12.107743 18874 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:12.107925 18874 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:12.109309 18874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "be595935aaee462dbddf8bb0e893a1b1"
format_stamp: "Formatted at 2026-08-11 01:00:12 on dist-test-slave-h3ft"
server_key: "68f6f2dbf0a191c7f91e6a17ecd51e03"
server_key_iv: "272e84eecd9e6018e844215bb1839556"
server_key_version: "encryptionkey@0"
I20260811 01:00:12.109777 18874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "be595935aaee462dbddf8bb0e893a1b1"
format_stamp: "Formatted at 2026-08-11 01:00:12 on dist-test-slave-h3ft"
server_key: "68f6f2dbf0a191c7f91e6a17ecd51e03"
server_key_iv: "272e84eecd9e6018e844215bb1839556"
server_key_version: "encryptionkey@0"
I20260811 01:00:12.111608 18874 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260811 01:00:12.112643 18895 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:12.112914 18874 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:00:12.113046 18874 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "be595935aaee462dbddf8bb0e893a1b1"
format_stamp: "Formatted at 2026-08-11 01:00:12 on dist-test-slave-h3ft"
server_key: "68f6f2dbf0a191c7f91e6a17ecd51e03"
server_key_iv: "272e84eecd9e6018e844215bb1839556"
server_key_version: "encryptionkey@0"
I20260811 01:00:12.113157 18874 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:12.130499 18874 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:12.133581 18874 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:12.133805 18874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:12.139703 18874 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:37079
I20260811 01:00:12.139752 18983 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:37079 every 8 connection(s)
I20260811 01:00:12.140270 18874 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 01:00:12.141541 18984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:12.144868 18984 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be595935aaee462dbddf8bb0e893a1b1: Bootstrap starting.
I20260811 01:00:12.145396 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 18874
I20260811 01:00:12.145578 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 01:00:12.145790 15640 external_mini_cluster.cc:1428] Setting key 42dcd8f1da8bbbedd334403dc6ff3429
I20260811 01:00:12.145823 18984 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P be595935aaee462dbddf8bb0e893a1b1: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:12.146281 18984 log.cc:824] T 00000000000000000000000000000000 P be595935aaee462dbddf8bb0e893a1b1: Log is configured to *not* fsync() on all Append() calls
I20260811 01:00:12.147425 18984 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be595935aaee462dbddf8bb0e893a1b1: No bootstrap required, opened a new log
I20260811 01:00:12.149919 18984 raft_consensus.cc:348] T 00000000000000000000000000000000 P be595935aaee462dbddf8bb0e893a1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be595935aaee462dbddf8bb0e893a1b1" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 37079 } }
I20260811 01:00:12.150161 18984 raft_consensus.cc:374] T 00000000000000000000000000000000 P be595935aaee462dbddf8bb0e893a1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:12.150214 18984 raft_consensus.cc:729] T 00000000000000000000000000000000 P be595935aaee462dbddf8bb0e893a1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be595935aaee462dbddf8bb0e893a1b1, State: Initialized, Role: FOLLOWER
I20260811 01:00:12.150458 18984 consensus_queue.cc:260] T 00000000000000000000000000000000 P be595935aaee462dbddf8bb0e893a1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be595935aaee462dbddf8bb0e893a1b1" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 37079 } }
I20260811 01:00:12.150584 18984 raft_consensus.cc:388] T 00000000000000000000000000000000 P be595935aaee462dbddf8bb0e893a1b1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:00:12.150662 18984 raft_consensus.cc:482] T 00000000000000000000000000000000 P be595935aaee462dbddf8bb0e893a1b1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:00:12.150736 18984 raft_consensus.cc:3037] T 00000000000000000000000000000000 P be595935aaee462dbddf8bb0e893a1b1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:12.151659 18984 raft_consensus.cc:504] T 00000000000000000000000000000000 P be595935aaee462dbddf8bb0e893a1b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be595935aaee462dbddf8bb0e893a1b1" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 37079 } }
I20260811 01:00:12.151818 18984 leader_election.cc:302] T 00000000000000000000000000000000 P be595935aaee462dbddf8bb0e893a1b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: be595935aaee462dbddf8bb0e893a1b1; no voters:
I20260811 01:00:12.152125 18984 leader_election.cc:288] T 00000000000000000000000000000000 P be595935aaee462dbddf8bb0e893a1b1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:00:12.152163 18990 raft_consensus.cc:2781] T 00000000000000000000000000000000 P be595935aaee462dbddf8bb0e893a1b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:00:12.152330 18990 raft_consensus.cc:686] T 00000000000000000000000000000000 P be595935aaee462dbddf8bb0e893a1b1 [term 1 LEADER]: Becoming Leader. State: Replica: be595935aaee462dbddf8bb0e893a1b1, State: Running, Role: LEADER
I20260811 01:00:12.152511 18990 consensus_queue.cc:237] T 00000000000000000000000000000000 P be595935aaee462dbddf8bb0e893a1b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be595935aaee462dbddf8bb0e893a1b1" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 37079 } }
I20260811 01:00:12.152526 18984 sys_catalog.cc:564] T 00000000000000000000000000000000 P be595935aaee462dbddf8bb0e893a1b1 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:00:12.153514 18989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:12.146717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33571 (local address 127.15.70.62:37079)
0811 01:00:12.147059 (+ 342us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:12.147072 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:12.147118 (+ 46us) server_negotiation.cc:407] Connection header received
0811 01:00:12.147811 (+ 693us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:12.147820 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:12.147883 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:12.148080 (+ 197us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:12.148355 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:12.149491 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:12.150625 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:12.151312 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:12.151497 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:12.152515 (+ 1018us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:12.152521 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:12.152521 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:00:12.152814 (+ 293us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:12.152884 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:00:12.152916 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:12.152971 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:12.153139 (+ 168us) server_negotiation.cc:299] Negotiation successful
0811 01:00:12.153232 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":123,"threads_started":1}
I20260811 01:00:12.154328 18993 sys_catalog.cc:455] T 00000000000000000000000000000000 P be595935aaee462dbddf8bb0e893a1b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader be595935aaee462dbddf8bb0e893a1b1. Latest consensus state: current_term: 1 leader_uuid: "be595935aaee462dbddf8bb0e893a1b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be595935aaee462dbddf8bb0e893a1b1" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 37079 } } }
I20260811 01:00:12.154369 18991 sys_catalog.cc:455] T 00000000000000000000000000000000 P be595935aaee462dbddf8bb0e893a1b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "be595935aaee462dbddf8bb0e893a1b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be595935aaee462dbddf8bb0e893a1b1" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 37079 } } }
I20260811 01:00:12.154460 18993 sys_catalog.cc:458] T 00000000000000000000000000000000 P be595935aaee462dbddf8bb0e893a1b1 [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:12.154500 18991 sys_catalog.cc:458] T 00000000000000000000000000000000 P be595935aaee462dbddf8bb0e893a1b1 [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:12.154755 19006 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:00:12.154827 15640 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:00:12.155592 19006 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:00:12.160626 18989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:12.157058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47403 (local address 127.15.70.62:37079)
0811 01:00:12.157116 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:12.157119 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:12.157186 (+ 67us) server_negotiation.cc:407] Connection header received
0811 01:00:12.157278 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:12.157279 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:12.157291 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:12.157356 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:12.157542 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:12.158114 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:12.158954 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:12.159259 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:12.159360 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:12.160253 (+ 893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:12.160255 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:12.160255 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:00:12.160262 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:12.160286 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:00:12.160293 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:12.160382 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:12.160482 (+ 100us) server_negotiation.cc:299] Negotiation successful
0811 01:00:12.160518 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 01:00:12.161275 19006 catalog_manager.cc:1347] Generated new cluster ID: 27bbbc450bf04eab8d2681bb9fc1be98
I20260811 01:00:12.161346 19006 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:00:12.177408 19006 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:00:12.178376 19006 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:00:12.182976 19006 catalog_manager.cc:5868] T 00000000000000000000000000000000 P be595935aaee462dbddf8bb0e893a1b1: Generated new TSK 0
I20260811 01:00:12.183403 19006 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:00:12.191861 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 18874
2026-08-11T01:00:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1840 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409704606556-15640-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:00:12 dist-test-slave-h3ft krb5kdc[19035](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:00:12 dist-test-slave-h3ft krb5kdc[19035](info): set up 2 sockets
Aug 11 01:00:12 dist-test-slave-h3ft krb5kdc[19035](info): commencing operation
krb5kdc: starting...
W20260811 01:00:13.602782 15640 mini_kdc.cc:121] Time spent starting KDC: real 1.362s user 0.002s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Aug 11 01:00:13 dist-test-slave-h3ft krb5kdc[19035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410013, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:00:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:00:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.70.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
I20260811 01:00:13.759634 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:33239
--webserver_interface=127.15.70.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:43731
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:33239
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:13.856189 19053 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:13.856457 19053 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:13.856484 19053 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:13.857774 19053 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:00:13.857838 19053 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:13.857853 19053 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:13.857867 19053 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:00:13.857878 19053 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:00:13.859555 19053 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:43731
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:33239
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:33239
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19053
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:13.859869 19053 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:13.860164 19053 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:13.866714 19067 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:13.866725 19053 server_base.cc:1034] running on GCE node
W20260811 01:00:13.866746 19064 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:13.866791 19062 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:13.867552 19053 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:13.868013 19053 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:13.869272 19053 hybrid_clock.cc:648] HybridClock initialized: now 1786410013869226 us; error 70 us; skew 500 ppm
Aug 11 01:00:13 dist-test-slave-h3ft krb5kdc[19035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410013, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:13.879593 19053 init.cc:377] Logged in from keytab as kudu/127.15.70.62@KRBTEST.COM (short username kudu)
I20260811 01:00:13.880334 19053 webserver.cc:460] Webserver started at http://127.15.70.62:34381/ using document root <none> and password file <none>
I20260811 01:00:13.880678 19053 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:13.880764 19053 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:13.880949 19053 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:13.882318 19053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "84ac447be4b94d04aeb74e0ad2eac566"
format_stamp: "Formatted at 2026-08-11 01:00:13 on dist-test-slave-h3ft"
server_key: "43443ee0c9abc26931b158ee86ba12f0"
server_key_iv: "38f37a901440896c34f5a45763ea062b"
server_key_version: "encryptionkey@0"
I20260811 01:00:13.882771 19053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "84ac447be4b94d04aeb74e0ad2eac566"
format_stamp: "Formatted at 2026-08-11 01:00:13 on dist-test-slave-h3ft"
server_key: "43443ee0c9abc26931b158ee86ba12f0"
server_key_iv: "38f37a901440896c34f5a45763ea062b"
server_key_version: "encryptionkey@0"
I20260811 01:00:13.884673 19053 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260811 01:00:13.885870 19077 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:13.886269 19053 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:00:13.886420 19053 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "84ac447be4b94d04aeb74e0ad2eac566"
format_stamp: "Formatted at 2026-08-11 01:00:13 on dist-test-slave-h3ft"
server_key: "43443ee0c9abc26931b158ee86ba12f0"
server_key_iv: "38f37a901440896c34f5a45763ea062b"
server_key_version: "encryptionkey@0"
I20260811 01:00:13.886570 19053 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:13.891053 19053 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:13.893882 19053 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:13.894125 19053 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:13.900372 19053 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:33239
I20260811 01:00:13.900472 19160 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:33239 every 8 connection(s)
I20260811 01:00:13.900976 19053 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 01:00:13.902384 19161 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:13.905412 19161 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84ac447be4b94d04aeb74e0ad2eac566: Bootstrap starting.
I20260811 01:00:13.906042 19161 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 84ac447be4b94d04aeb74e0ad2eac566: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:13.906316 19161 log.cc:824] T 00000000000000000000000000000000 P 84ac447be4b94d04aeb74e0ad2eac566: Log is configured to *not* fsync() on all Append() calls
I20260811 01:00:13.907426 19161 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84ac447be4b94d04aeb74e0ad2eac566: No bootstrap required, opened a new log
I20260811 01:00:13.908147 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 19053
I20260811 01:00:13.908288 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 01:00:13.908552 15640 external_mini_cluster.cc:1428] Setting key 696e14cae381e8431b9b72c4ac9038da
I20260811 01:00:13.909698 19161 raft_consensus.cc:348] T 00000000000000000000000000000000 P 84ac447be4b94d04aeb74e0ad2eac566 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84ac447be4b94d04aeb74e0ad2eac566" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 33239 } }
I20260811 01:00:13.909890 19161 raft_consensus.cc:374] T 00000000000000000000000000000000 P 84ac447be4b94d04aeb74e0ad2eac566 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:13.909945 19161 raft_consensus.cc:729] T 00000000000000000000000000000000 P 84ac447be4b94d04aeb74e0ad2eac566 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84ac447be4b94d04aeb74e0ad2eac566, State: Initialized, Role: FOLLOWER
I20260811 01:00:13.910122 19161 consensus_queue.cc:260] T 00000000000000000000000000000000 P 84ac447be4b94d04aeb74e0ad2eac566 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84ac447be4b94d04aeb74e0ad2eac566" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 33239 } }
I20260811 01:00:13.910231 19161 raft_consensus.cc:388] T 00000000000000000000000000000000 P 84ac447be4b94d04aeb74e0ad2eac566 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:00:13.910270 19161 raft_consensus.cc:482] T 00000000000000000000000000000000 P 84ac447be4b94d04aeb74e0ad2eac566 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:00:13.910396 19161 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 84ac447be4b94d04aeb74e0ad2eac566 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:13.911798 19161 raft_consensus.cc:504] T 00000000000000000000000000000000 P 84ac447be4b94d04aeb74e0ad2eac566 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84ac447be4b94d04aeb74e0ad2eac566" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 33239 } }
I20260811 01:00:13.911765 19165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:13.909382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41215 (local address 127.15.70.62:33239)
0811 01:00:13.909678 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:13.909690 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:13.909730 (+ 40us) server_negotiation.cc:407] Connection header received
0811 01:00:13.909887 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:13.909895 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:13.909955 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:13.910172 (+ 217us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:13.911115 (+ 943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:13.911120 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:13.911121 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:00:13.911127 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:13.911200 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:00:13.911216 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:13.911300 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:13.911484 (+ 184us) server_negotiation.cc:299] Negotiation successful
0811 01:00:13.911543 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":213,"thread_start_us":168,"threads_started":1}
I20260811 01:00:13.911949 19161 leader_election.cc:302] T 00000000000000000000000000000000 P 84ac447be4b94d04aeb74e0ad2eac566 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 84ac447be4b94d04aeb74e0ad2eac566; no voters:
I20260811 01:00:13.912168 19161 leader_election.cc:288] T 00000000000000000000000000000000 P 84ac447be4b94d04aeb74e0ad2eac566 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:00:13.912384 19166 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 84ac447be4b94d04aeb74e0ad2eac566 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:00:13.912632 19161 sys_catalog.cc:564] T 00000000000000000000000000000000 P 84ac447be4b94d04aeb74e0ad2eac566 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:00:13.912729 19166 raft_consensus.cc:686] T 00000000000000000000000000000000 P 84ac447be4b94d04aeb74e0ad2eac566 [term 1 LEADER]: Becoming Leader. State: Replica: 84ac447be4b94d04aeb74e0ad2eac566, State: Running, Role: LEADER
I20260811 01:00:13.913093 19166 consensus_queue.cc:237] T 00000000000000000000000000000000 P 84ac447be4b94d04aeb74e0ad2eac566 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84ac447be4b94d04aeb74e0ad2eac566" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 33239 } }
I20260811 01:00:13.913434 15640 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:00:13.914736 19167 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84ac447be4b94d04aeb74e0ad2eac566 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "84ac447be4b94d04aeb74e0ad2eac566" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84ac447be4b94d04aeb74e0ad2eac566" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 33239 } } }
I20260811 01:00:13.914853 19167 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84ac447be4b94d04aeb74e0ad2eac566 [sys.catalog]: This master's current role is: LEADER
W20260811 01:00:13.915146 19186 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 84ac447be4b94d04aeb74e0ad2eac566: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 01:00:13.915266 19186 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 01:00:13.915251 19168 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84ac447be4b94d04aeb74e0ad2eac566 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 84ac447be4b94d04aeb74e0ad2eac566. Latest consensus state: current_term: 1 leader_uuid: "84ac447be4b94d04aeb74e0ad2eac566" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84ac447be4b94d04aeb74e0ad2eac566" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 33239 } } }
I20260811 01:00:13.915444 19192 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:00:13.915445 19168 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84ac447be4b94d04aeb74e0ad2eac566 [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:13.915675 19192 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:00:13.917953 19192 catalog_manager.cc:1347] Generated new cluster ID: 8911fb4765644246b12b68dcfd77f987
I20260811 01:00:13.918017 19192 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:00:13.918135 19165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:13.916657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43663 (local address 127.15.70.62:33239)
0811 01:00:13.916709 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:13.916712 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:13.916900 (+ 188us) server_negotiation.cc:407] Connection header received
0811 01:00:13.916977 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:13.916978 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:13.916987 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:13.917074 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:13.917767 (+ 693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:13.917769 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:13.917769 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:00:13.917775 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:13.917794 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:00:13.917800 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:13.917850 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:13.917987 (+ 137us) server_negotiation.cc:299] Negotiation successful
0811 01:00:13.918004 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 01:00:13.934422 19192 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:00:13.934650 19192 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:00:13.938251 19192 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 84ac447be4b94d04aeb74e0ad2eac566: Generated new TSK 0
I20260811 01:00:13.938469 19192 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:00:13.945613 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 19053
2026-08-11T01:00:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1735 ms)
[----------] 18 tests from AuthTokenIssuingTest (31205 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:00:14 dist-test-slave-h3ft krb5kdc[19201](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:00:14 dist-test-slave-h3ft krb5kdc[19201](info): set up 2 sockets
Aug 11 01:00:14 dist-test-slave-h3ft krb5kdc[19201](info): commencing operation
krb5kdc: starting...
W20260811 01:00:15.347904 15640 mini_kdc.cc:121] Time spent starting KDC: real 1.372s user 0.003s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Aug 11 01:00:15 dist-test-slave-h3ft krb5kdc[19201](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410015, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:00:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:00:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.70.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
I20260811 01:00:15.503621 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:33845
--webserver_interface=127.15.70.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:46755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:33845,127.15.70.61:34033,127.15.70.60:35331
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:15.601200 19226 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 01:00:15.601540 19226 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:15.601575 19226 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:15.601624 19226 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:15.603053 19226 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:00:15.603140 19226 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:15.603163 19226 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:15.603184 19226 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:00:15.603216 19226 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:00:15.605044 19226 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:46755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:33845,127.15.70.61:34033,127.15.70.60:35331
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:33845
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19226
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:15.605417 19226 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:15.605726 19226 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:15.612181 19238 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:15.612227 19231 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:15.612248 19232 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:15.612376 19226 server_base.cc:1034] running on GCE node
I20260811 01:00:15.612869 19226 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:15.613215 19226 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:15.614413 19226 hybrid_clock.cc:648] HybridClock initialized: now 1786410015614397 us; error 37 us; skew 500 ppm
Aug 11 01:00:15 dist-test-slave-h3ft krb5kdc[19201](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410015, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:15.617813 19226 init.cc:377] Logged in from keytab as kudu/127.15.70.62@KRBTEST.COM (short username kudu)
I20260811 01:00:15.618484 19226 webserver.cc:460] Webserver started at http://127.15.70.62:43797/ using document root <none> and password file <none>
I20260811 01:00:15.618795 19226 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:15.618854 19226 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:15.619103 19226 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:15.620469 19226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "e914bc74a7164c08bf60405473c84886"
format_stamp: "Formatted at 2026-08-11 01:00:15 on dist-test-slave-h3ft"
server_key: "a2b3eb986a797845e664a20f9f2b7a46"
server_key_iv: "3ac22b97a2d0e3ca8f50000bd9124980"
server_key_version: "encryptionkey@0"
I20260811 01:00:15.620921 19226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "e914bc74a7164c08bf60405473c84886"
format_stamp: "Formatted at 2026-08-11 01:00:15 on dist-test-slave-h3ft"
server_key: "a2b3eb986a797845e664a20f9f2b7a46"
server_key_iv: "3ac22b97a2d0e3ca8f50000bd9124980"
server_key_version: "encryptionkey@0"
I20260811 01:00:15.622588 19226 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 01:00:15.623670 19252 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:15.624054 19226 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:00:15.624176 19226 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "e914bc74a7164c08bf60405473c84886"
format_stamp: "Formatted at 2026-08-11 01:00:15 on dist-test-slave-h3ft"
server_key: "a2b3eb986a797845e664a20f9f2b7a46"
server_key_iv: "3ac22b97a2d0e3ca8f50000bd9124980"
server_key_version: "encryptionkey@0"
I20260811 01:00:15.624274 19226 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:15.648634 19226 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:15.651575 19226 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:15.651759 19226 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:15.657473 19226 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:33845
I20260811 01:00:15.657524 19333 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:33845 every 8 connection(s)
I20260811 01:00:15.658015 19226 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 01:00:15.659435 19334 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:15.661538 19334 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.70.62" port: 33845 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:00:15.661774 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 19226
I20260811 01:00:15.662050 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 01:00:15.662326 15640 external_mini_cluster.cc:1428] Setting key 8899c1b24053526fcc4e8825b501506c
Aug 11 01:00:15 dist-test-slave-h3ft krb5kdc[19201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410015, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.70.61@KRBTEST.COM; defaulting to no policy
I20260811 01:00:15.674721 19340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:15.662568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:33845 (local address 127.0.0.1:37442)
0811 01:00:15.662833 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:15.662885 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:15.663567 (+ 682us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:15.663936 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:15.663939 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:15.664319 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:15.664526 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:15.664531 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:15.665827 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:15.665829 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:15.667041 (+ 1212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:15.667044 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:15.667610 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:15.667612 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:15.667701 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:15.668412 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:15.668426 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:15.670455 (+ 2029us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:15.672712 (+ 2257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:15.672720 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:15.672723 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:15.672959 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:15.673317 (+ 358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:15.673318 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:15.673319 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:15.673427 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:15.673891 (+ 464us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:15.673898 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:15.673972 (+ 74us) client_negotiation.cc:769] Sending connection context
0811 01:00:15.674106 (+ 134us) client_negotiation.cc:240] Negotiation successful
0811 01:00:15.674448 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"mutex_wait_us":145,"thread_start_us":158,"threads_started":1}
I20260811 01:00:15.674721 19343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:15.662624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37442 (local address 127.15.70.62:33845)
0811 01:00:15.662904 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:15.662910 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:15.663034 (+ 124us) server_negotiation.cc:407] Connection header received
0811 01:00:15.663756 (+ 722us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:15.663759 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:15.663785 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:15.663923 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:15.664653 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:15.665709 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:15.667119 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:15.667483 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:15.667593 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:15.670595 (+ 3002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:15.670611 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:15.670612 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:15.670620 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:15.672593 (+ 1973us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:15.673101 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:15.673106 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:15.673111 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:15.673242 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:15.673500 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:15.673501 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:15.673501 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:15.673802 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:15.673908 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:15.674145 (+ 237us) server_negotiation.cc:299] Negotiation successful
0811 01:00:15.674371 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":240,"thread_start_us":117,"threads_started":1}
I20260811 01:00:15.675720 19334 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34033 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:00:15.676349 19340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:15.676168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.61:34033 (local address 127.0.0.1:43078)
0811 01:00:15.676254 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:15.676318 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.61:34033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260811 01:00:15.676645 19258 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.70.61:34033: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.61@KRBTEST.COM" created.
I20260811 01:00:15.677350 19340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:15.677242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.61:34033 (local address 127.0.0.1:43088)
0811 01:00:15.677283 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:15.677314 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.61:34033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260811 01:00:15.677533 19334 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.70.61:34033: Network error: Client connection negotiation failed: client connection to 127.15.70.61:34033: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.61.keytab.
Entry for principal kudu/127.15.70.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.61.keytab.
I20260811 01:00:15.699501 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.61:34033
--webserver_interface=127.15.70.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.61.keytab
--principal=kudu/127.15.70.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:46755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:33845,127.15.70.61:34033,127.15.70.60:35331
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:00:15.726898 19334 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34033 } attempt: 1
I20260811 01:00:15.727716 19340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:15.727535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.61:34033 (local address 127.0.0.1:43096)
0811 01:00:15.727616 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:15.727671 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.61:34033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260811 01:00:15.728199 19340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:15.728099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.61:34033 (local address 127.0.0.1:43106)
0811 01:00:15.728145 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:15.728176 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.61:34033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 01:00:15.728324 19334 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.70.61:34033: Network error: Client connection negotiation failed: client connection to 127.15.70.61:34033: connect: Connection refused (error 111)
I20260811 01:00:15.796509 19334 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34033 } attempt: 2
I20260811 01:00:15.797312 19340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:15.797129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.61:34033 (local address 127.0.0.1:43110)
0811 01:00:15.797212 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:15.797269 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.61:34033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 01:00:15.797852 19340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:15.797757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.61:34033 (local address 127.0.0.1:43122)
0811 01:00:15.797803 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:15.797832 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.61:34033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 01:00:15.797976 19334 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.70.61:34033: Network error: Client connection negotiation failed: client connection to 127.15.70.61:34033: connect: Connection refused (error 111)
W20260811 01:00:15.803690 19349 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 01:00:15.803994 19349 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:15.804023 19349 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:15.804049 19349 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:15.805287 19349 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:00:15.805328 19349 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:15.805343 19349 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:15.805356 19349 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:00:15.805368 19349 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:00:15.806979 19349 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:46755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:33845,127.15.70.61:34033,127.15.70.60:35331
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.61.keytab
--principal=kudu/127.15.70.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.61:34033
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.15.70.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19349
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:15.807317 19349 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:15.807699 19349 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:15.813431 19357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:15.813436 19355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:15.813512 19360 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:15.814194 19349 server_base.cc:1034] running on GCE node
I20260811 01:00:15.814500 19349 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:15.814862 19349 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:15.816042 19349 hybrid_clock.cc:648] HybridClock initialized: now 1786410015816026 us; error 34 us; skew 500 ppm
Aug 11 01:00:15 dist-test-slave-h3ft krb5kdc[19201](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410015, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:15.819490 19349 init.cc:377] Logged in from keytab as kudu/127.15.70.61@KRBTEST.COM (short username kudu)
I20260811 01:00:15.820165 19349 webserver.cc:460] Webserver started at http://127.15.70.61:43249/ using document root <none> and password file <none>
I20260811 01:00:15.820478 19349 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:15.820568 19349 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:15.820739 19349 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:15.822062 19349 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-1/data/instance:
uuid: "68c903aaea354df1b1b191043148808b"
format_stamp: "Formatted at 2026-08-11 01:00:15 on dist-test-slave-h3ft"
server_key: "a6119a375b5aed6606f5ef4fcca9755e"
server_key_iv: "58ca80e27172f73efcd01ba431cf13e2"
server_key_version: "encryptionkey@0"
I20260811 01:00:15.822484 19349 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-1/wal/instance:
uuid: "68c903aaea354df1b1b191043148808b"
format_stamp: "Formatted at 2026-08-11 01:00:15 on dist-test-slave-h3ft"
server_key: "a6119a375b5aed6606f5ef4fcca9755e"
server_key_iv: "58ca80e27172f73efcd01ba431cf13e2"
server_key_version: "encryptionkey@0"
I20260811 01:00:15.824226 19349 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260811 01:00:15.825239 19375 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:15.825482 19349 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:00:15.825600 19349 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-1/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-1/wal
uuid: "68c903aaea354df1b1b191043148808b"
format_stamp: "Formatted at 2026-08-11 01:00:15 on dist-test-slave-h3ft"
server_key: "a6119a375b5aed6606f5ef4fcca9755e"
server_key_iv: "58ca80e27172f73efcd01ba431cf13e2"
server_key_version: "encryptionkey@0"
I20260811 01:00:15.825685 19349 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:15.836750 19349 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:15.839583 19349 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:15.839773 19349 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:15.844986 19349 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.61:34033
I20260811 01:00:15.845023 19457 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.61:34033 every 8 connection(s)
I20260811 01:00:15.845477 19349 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-1/data/info.pb
I20260811 01:00:15.846709 19458 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:15.847903 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 19349
I20260811 01:00:15.848024 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-1/wal/instance
I20260811 01:00:15.848268 15640 external_mini_cluster.cc:1428] Setting key 8c3bb01d7170c74c2cdfc565e6835f74
I20260811 01:00:15.849545 19458 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.70.62" port: 33845 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:00:15 dist-test-slave-h3ft krb5kdc[19201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410015, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.61@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.70.60@KRBTEST.COM; defaulting to no policy
I20260811 01:00:15.862468 19343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:15.850618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37448 (local address 127.15.70.62:33845)
0811 01:00:15.850693 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:15.850697 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:15.851047 (+ 350us) server_negotiation.cc:407] Connection header received
0811 01:00:15.851729 (+ 682us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:15.851731 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:15.851757 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:15.851856 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:15.852881 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:15.853713 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:15.854947 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:15.855397 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:15.855493 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:15.858768 (+ 3275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:15.858771 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:15.858772 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:15.858784 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:15.860671 (+ 1887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:15.861345 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:15.861346 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:15.861347 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:15.861415 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:15.861676 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:15.861677 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:15.861677 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:15.861814 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:15.861871 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:15.862285 (+ 414us) server_negotiation.cc:299] Negotiation successful
0811 01:00:15.862377 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 01:00:15.862685 19462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:15.850607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:33845 (local address 127.0.0.1:37448)
0811 01:00:15.850854 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:15.850904 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:15.851595 (+ 691us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:15.852054 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:15.852059 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:15.852457 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:15.852740 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:15.852745 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:15.853850 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:15.853852 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:15.854814 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:15.854817 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:15.855552 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:15.855554 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:15.855688 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:15.856545 (+ 857us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:15.856558 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:15.858627 (+ 2069us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:15.860810 (+ 2183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:15.860825 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:15.860829 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:15.861262 (+ 433us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:15.861483 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:15.861484 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:15.861484 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:15.861617 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:15.861911 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:15.861917 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:15.862078 (+ 161us) client_negotiation.cc:769] Sending connection context
0811 01:00:15.862238 (+ 160us) client_negotiation.cc:240] Negotiation successful
0811 01:00:15.862412 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":151,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.60@KRBTEST.COM" created.
I20260811 01:00:15.863468 19458 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34033 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:00:15 dist-test-slave-h3ft krb5kdc[19201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410015, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.61@KRBTEST.COM for kudu/127.15.70.61@KRBTEST.COM
I20260811 01:00:15.874137 19462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:15.863838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.61:34033 (local address 127.0.0.1:43136)
0811 01:00:15.863903 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:15.863915 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:15.863962 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:15.864441 (+ 479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:15.864442 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:15.864591 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:15.864656 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:15.864658 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:15.866148 (+ 1490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:15.866149 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:15.867050 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:15.867053 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:15.867611 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:15.867612 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:15.867697 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:15.868304 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:15.868316 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:15.870100 (+ 1784us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:15.872470 (+ 2370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:15.872472 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:15.872472 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:15.872726 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:15.873128 (+ 402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:15.873129 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:15.873130 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:15.873207 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:15.873584 (+ 377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:15.873585 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:15.873644 (+ 59us) client_negotiation.cc:769] Sending connection context
0811 01:00:15.873728 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 01:00:15.873869 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 01:00:15.874153 19463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:15.864004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43136 (local address 127.15.70.61:34033)
0811 01:00:15.864239 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:15.864246 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:15.864277 (+ 31us) server_negotiation.cc:407] Connection header received
0811 01:00:15.864307 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:15.864309 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:15.864328 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:15.864430 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:15.864741 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:15.866016 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:15.867134 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:15.867509 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:15.867578 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:15.870209 (+ 2631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:15.870219 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:15.870219 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:15.870226 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:15.872364 (+ 2138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:15.872919 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:15.872923 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:15.872923 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:15.873032 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:15.873291 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:15.873293 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:15.873293 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:15.873501 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:15.873588 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:15.873778 (+ 190us) server_negotiation.cc:299] Negotiation successful
0811 01:00:15.873968 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":74,"server-negotiator.queue_time_us":193,"thread_start_us":114,"threads_started":1}
I20260811 01:00:15.875140 19458 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.70.60" port: 35331 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:00:15.875749 19462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:15.875605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:35331 (local address 127.0.0.1:49858)
0811 01:00:15.875650 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:15.875719 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.60:35331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260811 01:00:15.875983 19377 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.70.60:35331: connect: Connection refused (error 111)
I20260811 01:00:15.876657 19462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:15.876533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:35331 (local address 127.0.0.1:49862)
0811 01:00:15.876602 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:15.876634 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.60:35331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260811 01:00:15.876842 19458 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.70.60:35331: Network error: Client connection negotiation failed: client connection to 127.15.70.60:35331: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.60.keytab.
Entry for principal kudu/127.15.70.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.60.keytab.
I20260811 01:00:15.886907 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.60:35331
--webserver_interface=127.15.70.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.60.keytab
--principal=kudu/127.15.70.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:46755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:33845,127.15.70.61:34033,127.15.70.60:35331
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:00:15.889191 19334 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34033 } attempt: 3
Aug 11 01:00:15 dist-test-slave-h3ft krb5kdc[19201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410015, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for kudu/127.15.70.61@KRBTEST.COM
I20260811 01:00:15.897801 19340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:15.889692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.61:34033 (local address 127.0.0.1:43140)
0811 01:00:15.889764 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:15.889783 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:15.889854 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:15.890045 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:15.890047 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:15.890261 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:15.890346 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:15.890349 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:15.891170 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:15.891171 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:15.891757 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:15.891759 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:15.892192 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:15.892193 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:15.892290 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:15.892935 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:15.892941 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:15.894682 (+ 1741us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:15.896591 (+ 1909us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:15.896592 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:15.896593 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:15.896794 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:15.897030 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:15.897031 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:15.897032 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:15.897101 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:15.897395 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:15.897396 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:15.897457 (+ 61us) client_negotiation.cc:769] Sending connection context
0811 01:00:15.897543 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 01:00:15.897678 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 01:00:15.897801 19463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:15.889808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43140 (local address 127.15.70.61:34033)
0811 01:00:15.889896 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:15.889899 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:15.889910 (+ 11us) server_negotiation.cc:407] Connection header received
0811 01:00:15.889952 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:15.889953 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:15.889966 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:15.890036 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:15.890445 (+ 409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:15.891069 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:15.891856 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:15.892109 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:15.892194 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:15.894791 (+ 2597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:15.894793 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:15.894793 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:15.894811 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:15.896485 (+ 1674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:15.896876 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:15.896878 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:15.896879 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:15.896950 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:15.897175 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:15.897176 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:15.897177 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:15.897313 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:15.897395 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:15.897572 (+ 177us) server_negotiation.cc:299] Negotiation successful
0811 01:00:15.897679 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 01:00:15.898445 19334 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.70.60" port: 35331 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:00:15.898887 19340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:15.898759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:35331 (local address 127.0.0.1:49866)
0811 01:00:15.898816 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:15.898848 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.60:35331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 01:00:15.899292 19340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:15.899200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:35331 (local address 127.0.0.1:49870)
0811 01:00:15.899247 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:15.899271 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.60:35331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 01:00:15.899390 19334 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.70.60:35331: Network error: Client connection negotiation failed: client connection to 127.15.70.60:35331: connect: Connection refused (error 111)
I20260811 01:00:15.926157 19458 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.70.60" port: 35331 } attempt: 1
I20260811 01:00:15.926923 19462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:15.926731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:35331 (local address 127.0.0.1:49876)
0811 01:00:15.926814 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:15.926874 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.60:35331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 01:00:15.927506 19462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:15.927291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:35331 (local address 127.0.0.1:49880)
0811 01:00:15.927374 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:15.927475 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.60:35331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260811 01:00:15.927646 19458 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.70.60:35331: Network error: Client connection negotiation failed: client connection to 127.15.70.60:35331: connect: Connection refused (error 111)
I20260811 01:00:15.930531 19334 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.70.60" port: 35331 } attempt: 1
I20260811 01:00:15.931180 19340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:15.930988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:35331 (local address 127.0.0.1:49884)
0811 01:00:15.931103 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:15.931141 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.60:35331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260811 01:00:15.931655 19340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:15.931488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:35331 (local address 127.0.0.1:49900)
0811 01:00:15.931557 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:15.931609 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.60:35331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260811 01:00:15.931843 19334 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.70.60:35331: Network error: Client connection negotiation failed: client connection to 127.15.70.60:35331: connect: Connection refused (error 111)
W20260811 01:00:15.988890 19468 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 01:00:15.989183 19468 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:15.989203 19468 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:15.989229 19468 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:15.990450 19468 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:00:15.990497 19468 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:15.990512 19468 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:15.990525 19468 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:00:15.990537 19468 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:00:15.992200 19468 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:46755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:33845,127.15.70.61:34033,127.15.70.60:35331
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.60.keytab
--principal=kudu/127.15.70.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.60:35331
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.15.70.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19468
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:15.992460 19468 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:15.992689 19468 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 01:00:15.995816 19458 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.70.60" port: 35331 } attempt: 2
I20260811 01:00:15.996505 19462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:15.996317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:35331 (local address 127.0.0.1:49910)
0811 01:00:15.996398 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:15.996456 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.60:35331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260811 01:00:15.997014 19462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:15.996876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:35331 (local address 127.0.0.1:49924)
0811 01:00:15.996942 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:15.996975 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.60:35331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260811 01:00:15.997143 19458 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.70.60:35331: Network error: Client connection negotiation failed: client connection to 127.15.70.60:35331: connect: Connection refused (error 111)
W20260811 01:00:15.998675 19476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:15.998683 19475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:15.998683 19480 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:15.999121 19468 server_base.cc:1034] running on GCE node
I20260811 01:00:15.999387 19468 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:15.999683 19468 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:16.000910 19468 hybrid_clock.cc:648] HybridClock initialized: now 1786410016000887 us; error 27 us; skew 500 ppm
Aug 11 01:00:16 dist-test-slave-h3ft krb5kdc[19201](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410016, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:16.004676 19468 init.cc:377] Logged in from keytab as kudu/127.15.70.60@KRBTEST.COM (short username kudu)
I20260811 01:00:16.005431 19468 webserver.cc:460] Webserver started at http://127.15.70.60:45351/ using document root <none> and password file <none>
I20260811 01:00:16.005710 19468 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:16.005766 19468 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:16.005908 19468 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:16.007056 19334 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.70.60" port: 35331 } attempt: 2
I20260811 01:00:16.007673 19340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:16.007492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:35331 (local address 127.0.0.1:49932)
0811 01:00:16.007579 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:16.007626 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.60:35331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 01:00:16.007565 19468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-2/data/instance:
uuid: "bf0387f881a54ca3a3b1bf67fbb0d844"
format_stamp: "Formatted at 2026-08-11 01:00:16 on dist-test-slave-h3ft"
server_key: "9304f1b9d378089313404a992d39e868"
server_key_iv: "07f18f9d6444f4475f4564b194a58b22"
server_key_version: "encryptionkey@0"
I20260811 01:00:16.008168 19468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-2/wal/instance:
uuid: "bf0387f881a54ca3a3b1bf67fbb0d844"
format_stamp: "Formatted at 2026-08-11 01:00:16 on dist-test-slave-h3ft"
server_key: "9304f1b9d378089313404a992d39e868"
server_key_iv: "07f18f9d6444f4475f4564b194a58b22"
server_key_version: "encryptionkey@0"
I20260811 01:00:16.008391 19340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:16.008229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:35331 (local address 127.0.0.1:49942)
0811 01:00:16.008318 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:16.008359 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.60:35331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260811 01:00:16.008517 19334 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.70.60:35331: Network error: Client connection negotiation failed: client connection to 127.15.70.60:35331: connect: Connection refused (error 111)
I20260811 01:00:16.010151 19468 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 01:00:16.011258 19490 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:16.011508 19468 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:00:16.011675 19468 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-2/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-2/wal
uuid: "bf0387f881a54ca3a3b1bf67fbb0d844"
format_stamp: "Formatted at 2026-08-11 01:00:16 on dist-test-slave-h3ft"
server_key: "9304f1b9d378089313404a992d39e868"
server_key_iv: "07f18f9d6444f4475f4564b194a58b22"
server_key_version: "encryptionkey@0"
I20260811 01:00:16.011773 19468 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:16.025179 19468 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:16.028127 19468 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:16.028326 19468 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:16.033613 19468 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.60:35331
I20260811 01:00:16.033653 19571 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.60:35331 every 8 connection(s)
I20260811 01:00:16.034092 19468 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-2/data/info.pb
I20260811 01:00:16.035059 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 19468
I20260811 01:00:16.035187 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409704606556-15640-0/minicluster-data/master-2/wal/instance
I20260811 01:00:16.035410 15640 external_mini_cluster.cc:1428] Setting key b92edb93f95222b9396a60b30713c242
I20260811 01:00:16.035471 19573 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:16.038331 19573 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.70.62" port: 33845 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:00:16 dist-test-slave-h3ft krb5kdc[19201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410015, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.70.60@KRBTEST.COM
Aug 11 01:00:16 dist-test-slave-h3ft krb5kdc[19201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410016, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.60@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 01:00:16.048134 19579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:16.036169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49950 (local address 127.15.70.60:35331)
0811 01:00:16.036390 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:16.036401 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:16.036441 (+ 40us) server_negotiation.cc:407] Connection header received
0811 01:00:16.036923 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:16.036933 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:16.037001 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:16.037188 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:16.037891 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:16.039354 (+ 1463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:16.040473 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:16.041129 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:16.041222 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:16.044218 (+ 2996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:16.044228 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:16.044229 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:16.044236 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:16.046161 (+ 1925us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:16.046666 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:16.046669 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:16.046669 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:16.046761 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:16.046986 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:16.046987 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:16.046987 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:16.047321 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:16.047463 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:16.047662 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 01:00:16.047864 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":100,"threads_started":1}
I20260811 01:00:16.048524 19343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:16.039242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37450 (local address 127.15.70.62:33845)
0811 01:00:16.039325 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:16.039327 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:16.039561 (+ 234us) server_negotiation.cc:407] Connection header received
0811 01:00:16.039603 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:16.039604 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:16.039618 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:16.039681 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:16.040292 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:16.041002 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:16.042108 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:16.042298 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:16.042355 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:16.044744 (+ 2389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:16.044746 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:16.044746 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:16.044754 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:16.047112 (+ 2358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:16.047598 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:16.047599 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:16.047600 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:16.047676 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:16.047949 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:16.047951 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:16.047951 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:16.048091 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:16.048173 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:16.048368 (+ 195us) server_negotiation.cc:299] Negotiation successful
0811 01:00:16.048453 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 01:00:16.048820 19581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:16.039155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:33845 (local address 127.0.0.1:37450)
0811 01:00:16.039422 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:16.039467 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:16.039546 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:16.039704 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:16.039707 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:16.040119 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:16.040211 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:16.040214 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:16.041105 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:16.041106 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:16.042011 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:16.042014 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:16.042423 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:16.042425 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:16.042515 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:16.043107 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:16.043120 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:16.044634 (+ 1514us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:16.047192 (+ 2558us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:16.047201 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:16.047204 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:16.047500 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:16.047762 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:16.047763 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:16.047764 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:16.047838 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:16.048176 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:16.048184 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:16.048239 (+ 55us) client_negotiation.cc:769] Sending connection context
0811 01:00:16.048330 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 01:00:16.048459 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":98,"threads_started":1}
I20260811 01:00:16.049467 19573 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34033 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:00:16 dist-test-slave-h3ft krb5kdc[19201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410016, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.60@KRBTEST.COM for kudu/127.15.70.61@KRBTEST.COM
Aug 11 01:00:16 dist-test-slave-h3ft krb5kdc[19201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410015, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 01:00:16.057701 19581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:16.049777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.61:34033 (local address 127.0.0.1:43154)
0811 01:00:16.049829 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:16.049840 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:16.049891 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:16.050087 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:16.050088 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:16.050238 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:16.050301 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:16.050303 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:16.051062 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:16.051064 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:16.051685 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:16.051687 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:16.052202 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:16.052204 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:16.052303 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:16.052763 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:16.052768 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:16.054142 (+ 1374us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:16.056540 (+ 2398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:16.056541 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:16.056542 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:16.056732 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:16.056980 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:16.056980 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:16.056981 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:16.057050 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:16.057328 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:16.057329 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:16.057388 (+ 59us) client_negotiation.cc:769] Sending connection context
0811 01:00:16.057467 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 01:00:16.057586 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 01:00:16.057701 19463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:16.049888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43154 (local address 127.15.70.61:34033)
0811 01:00:16.049944 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:16.049946 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:16.049956 (+ 10us) server_negotiation.cc:407] Connection header received
0811 01:00:16.049986 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:16.049987 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:16.050000 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:16.050059 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:16.050380 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:16.050941 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:16.051786 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:16.052093 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:16.052174 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:16.054238 (+ 2064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:16.054240 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:16.054240 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:16.054247 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:16.056411 (+ 2164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:16.056827 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:16.056829 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:16.056829 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:16.056903 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:16.057116 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:16.057117 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:16.057118 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:16.057250 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:16.057328 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:16.057509 (+ 181us) server_negotiation.cc:299] Negotiation successful
0811 01:00:16.057593 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 01:00:16.058246 19573 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.70.60" port: 35331 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:00:16.058326 19343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:16.049206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37458 (local address 127.15.70.62:33845)
0811 01:00:16.049243 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:16.049246 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:16.049326 (+ 80us) server_negotiation.cc:407] Connection header received
0811 01:00:16.049394 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:16.049395 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:16.049409 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:16.049465 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:16.050103 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:16.050710 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:16.051549 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:16.051846 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:16.051901 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:16.054851 (+ 2950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:16.054852 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:16.054853 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:16.054867 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:16.056549 (+ 1682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:16.056956 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:16.056957 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:16.056958 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:16.057022 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:16.057233 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:16.057234 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:16.057234 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:16.057362 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:16.057586 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:16.057624 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 01:00:16.057712 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
Aug 11 01:00:16 dist-test-slave-h3ft krb5kdc[19201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410016, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.60@KRBTEST.COM for kudu/127.15.70.60@KRBTEST.COM
Aug 11 01:00:16 dist-test-slave-h3ft krb5kdc[19201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410015, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.70.61@KRBTEST.COM
I20260811 01:00:16.066243 19581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:16.058607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:35331 (local address 127.0.0.1:49952)
0811 01:00:16.058653 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:16.058666 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:16.058717 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:16.058855 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:16.058856 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:16.059058 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:16.059106 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:16.059108 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:16.059793 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:16.059794 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:16.060283 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:16.060285 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:16.060672 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:16.060673 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:16.060719 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:16.061216 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:16.061221 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:16.062972 (+ 1751us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:16.064957 (+ 1985us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:16.064959 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:16.064960 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:16.065204 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:16.065452 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:16.065453 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:16.065453 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:16.065513 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:16.065818 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:16.065818 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:16.065880 (+ 62us) client_negotiation.cc:769] Sending connection context
0811 01:00:16.065980 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 01:00:16.066069 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260811 01:00:16.066254 19579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:16.058642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49952 (local address 127.15.70.60:35331)
0811 01:00:16.058753 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:16.058755 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:16.058763 (+ 8us) server_negotiation.cc:407] Connection header received
0811 01:00:16.058781 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:16.058781 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:16.058791 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:16.058846 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:16.059187 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:16.059710 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:16.060383 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:16.060601 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:16.060678 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:16.063127 (+ 2449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:16.063128 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:16.063129 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:16.063136 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:16.064825 (+ 1689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:16.065301 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:16.065302 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:16.065303 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:16.065372 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:16.065581 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:16.065582 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:16.065583 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:16.065737 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:16.065817 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:16.066053 (+ 236us) server_negotiation.cc:299] Negotiation successful
0811 01:00:16.066146 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260811 01:00:16.067444 19463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:16.059122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43164 (local address 127.15.70.61:34033)
0811 01:00:16.059170 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:16.059172 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:16.059183 (+ 11us) server_negotiation.cc:407] Connection header received
0811 01:00:16.059207 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:16.059208 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:16.059218 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:16.059273 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:16.059766 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:16.060233 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:16.060921 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:16.061140 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:16.061227 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:16.064084 (+ 2857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:16.064085 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:16.064086 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:16.064095 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:16.066075 (+ 1980us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:16.066509 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:16.066511 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:16.066512 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:16.066580 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:16.066789 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:16.066790 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:16.066790 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:16.066930 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:16.067204 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:16.067247 (+ 43us) server_negotiation.cc:299] Negotiation successful
0811 01:00:16.067333 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 01:00:16.068781 19573 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf0387f881a54ca3a3b1bf67fbb0d844: Bootstrap starting.
I20260811 01:00:16.069339 15640 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:00:16.069972 19573 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bf0387f881a54ca3a3b1bf67fbb0d844: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:16.070364 19573 log.cc:824] T 00000000000000000000000000000000 P bf0387f881a54ca3a3b1bf67fbb0d844: Log is configured to *not* fsync() on all Append() calls
I20260811 01:00:16.071488 19573 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf0387f881a54ca3a3b1bf67fbb0d844: No bootstrap required, opened a new log
I20260811 01:00:16.070561 19294 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "e914bc74a7164c08bf60405473c84886"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37458
I20260811 01:00:16.073331 19573 raft_consensus.cc:348] T 00000000000000000000000000000000 P bf0387f881a54ca3a3b1bf67fbb0d844 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e914bc74a7164c08bf60405473c84886" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 33845 } } peers { permanent_uuid: "68c903aaea354df1b1b191043148808b" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34033 } } peers { permanent_uuid: "bf0387f881a54ca3a3b1bf67fbb0d844" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 35331 } }
I20260811 01:00:16.073532 19573 raft_consensus.cc:729] T 00000000000000000000000000000000 P bf0387f881a54ca3a3b1bf67fbb0d844 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf0387f881a54ca3a3b1bf67fbb0d844, State: Initialized, Role: FOLLOWER
I20260811 01:00:16.073657 19573 consensus_queue.cc:260] T 00000000000000000000000000000000 P bf0387f881a54ca3a3b1bf67fbb0d844 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e914bc74a7164c08bf60405473c84886" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 33845 } } peers { permanent_uuid: "68c903aaea354df1b1b191043148808b" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34033 } } peers { permanent_uuid: "bf0387f881a54ca3a3b1bf67fbb0d844" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 35331 } }
I20260811 01:00:16.074059 19586 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf0387f881a54ca3a3b1bf67fbb0d844 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e914bc74a7164c08bf60405473c84886" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 33845 } } peers { permanent_uuid: "68c903aaea354df1b1b191043148808b" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34033 } } peers { permanent_uuid: "bf0387f881a54ca3a3b1bf67fbb0d844" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 35331 } } }
I20260811 01:00:16.074133 19573 sys_catalog.cc:564] T 00000000000000000000000000000000 P bf0387f881a54ca3a3b1bf67fbb0d844 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:00:16.074155 19586 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf0387f881a54ca3a3b1bf67fbb0d844 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 01:00:16.076470 19607 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bf0387f881a54ca3a3b1bf67fbb0d844: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 01:00:16.076545 19607 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 01:00:16.076824 19468 master_runner.cc:186] Error getting master registration for 127.15.70.62:33845: OK, instance_id { permanent_uuid: "e914bc74a7164c08bf60405473c84886" instance_seqno: 1786410015655904 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 01:00:16.080503 19468 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 01:00:16.088325 19458 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.70.60" port: 35331 } attempt: 3
Aug 11 01:00:16 dist-test-slave-h3ft krb5kdc[19201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410015, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.61@KRBTEST.COM for kudu/127.15.70.60@KRBTEST.COM
I20260811 01:00:16.098124 19579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:16.089005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49960 (local address 127.15.70.60:35331)
0811 01:00:16.089086 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:16.089088 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:16.089118 (+ 30us) server_negotiation.cc:407] Connection header received
0811 01:00:16.089153 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:16.089154 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:16.089167 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:16.089222 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:16.089643 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:16.090187 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:16.091031 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:16.091253 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:16.091341 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:16.094227 (+ 2886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:16.094230 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:16.094231 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:16.094242 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:16.096420 (+ 2178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:16.096969 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:16.096970 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:16.096971 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:16.097051 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:16.097295 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:16.097296 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:16.097297 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:16.097597 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:16.097675 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:16.097874 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 01:00:16.097991 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 01:00:16.098124 19462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:16.088899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:35331 (local address 127.0.0.1:49960)
0811 01:00:16.088970 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:16.088992 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:16.089068 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:16.089248 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:16.089249 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:16.089480 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:16.089546 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:16.089548 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:16.090289 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:16.090290 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:16.090898 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:16.090901 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:16.091339 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:16.091340 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:16.091399 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:16.092045 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:16.092053 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:16.094069 (+ 2016us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:16.096563 (+ 2494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:16.096565 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:16.096566 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:16.096877 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:16.097133 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:16.097134 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:16.097134 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:16.097223 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:16.097679 (+ 456us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:16.097681 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:16.097747 (+ 66us) client_negotiation.cc:769] Sending connection context
0811 01:00:16.097830 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 01:00:16.097996 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260811 01:00:16.100235 19458 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68c903aaea354df1b1b191043148808b: Bootstrap starting.
I20260811 01:00:16.101286 19458 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 68c903aaea354df1b1b191043148808b: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:16.101704 19458 log.cc:824] T 00000000000000000000000000000000 P 68c903aaea354df1b1b191043148808b: Log is configured to *not* fsync() on all Append() calls
I20260811 01:00:16.102730 19458 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68c903aaea354df1b1b191043148808b: No bootstrap required, opened a new log
I20260811 01:00:16.104880 19458 raft_consensus.cc:348] T 00000000000000000000000000000000 P 68c903aaea354df1b1b191043148808b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e914bc74a7164c08bf60405473c84886" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 33845 } } peers { permanent_uuid: "68c903aaea354df1b1b191043148808b" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34033 } } peers { permanent_uuid: "bf0387f881a54ca3a3b1bf67fbb0d844" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 35331 } }
I20260811 01:00:16.105070 19458 raft_consensus.cc:729] T 00000000000000000000000000000000 P 68c903aaea354df1b1b191043148808b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68c903aaea354df1b1b191043148808b, State: Initialized, Role: FOLLOWER
I20260811 01:00:16.105188 19458 consensus_queue.cc:260] T 00000000000000000000000000000000 P 68c903aaea354df1b1b191043148808b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e914bc74a7164c08bf60405473c84886" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 33845 } } peers { permanent_uuid: "68c903aaea354df1b1b191043148808b" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34033 } } peers { permanent_uuid: "bf0387f881a54ca3a3b1bf67fbb0d844" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 35331 } }
I20260811 01:00:16.105618 19611 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68c903aaea354df1b1b191043148808b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e914bc74a7164c08bf60405473c84886" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 33845 } } peers { permanent_uuid: "68c903aaea354df1b1b191043148808b" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34033 } } peers { permanent_uuid: "bf0387f881a54ca3a3b1bf67fbb0d844" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 35331 } } }
I20260811 01:00:16.105718 19458 sys_catalog.cc:564] T 00000000000000000000000000000000 P 68c903aaea354df1b1b191043148808b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:00:16.105741 19611 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68c903aaea354df1b1b191043148808b [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:00:16.107620 19334 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.70.60" port: 35331 } attempt: 3
W20260811 01:00:16.108057 19626 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 68c903aaea354df1b1b191043148808b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 01:00:16.108114 19626 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 01:00:16.108729 19349 master_runner.cc:186] Error getting master registration for 127.15.70.62:33845: OK, instance_id { permanent_uuid: "e914bc74a7164c08bf60405473c84886" instance_seqno: 1786410015655904 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 01:00:16.111568 19349 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 11 01:00:16 dist-test-slave-h3ft krb5kdc[19201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410015, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for kudu/127.15.70.60@KRBTEST.COM
I20260811 01:00:16.118305 19340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:16.108012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:35331 (local address 127.0.0.1:49966)
0811 01:00:16.108244 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:16.108256 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:16.108307 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:16.109357 (+ 1050us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:16.109359 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:16.109650 (+ 291us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:16.109742 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:16.109746 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:16.110770 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:16.110771 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:16.111647 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:16.111650 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:16.112173 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:16.112175 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:16.112250 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:16.112926 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:16.112933 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:16.114807 (+ 1874us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:16.117077 (+ 2270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:16.117079 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:16.117079 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:16.117319 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:16.117536 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:16.117537 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:16.117538 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:16.117597 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:16.117922 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:16.117923 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:16.117979 (+ 56us) client_negotiation.cc:769] Sending connection context
0811 01:00:16.118044 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 01:00:16.118173 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205}
I20260811 01:00:16.119113 19579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:16.108506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49966 (local address 127.15.70.60:35331)
0811 01:00:16.108594 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:16.108596 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:16.108609 (+ 13us) server_negotiation.cc:407] Connection header received
0811 01:00:16.108645 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:16.108646 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:16.108660 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:16.108730 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:16.109883 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:16.110656 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:16.111760 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:16.112091 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:16.112170 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:16.115033 (+ 2863us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:16.115035 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:16.115035 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:16.115047 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:16.116965 (+ 1918us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:16.117403 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:16.117404 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:16.117405 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:16.117468 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:16.117659 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:16.117660 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:16.117660 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:16.117819 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:16.117892 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:16.118857 (+ 965us) server_negotiation.cc:299] Negotiation successful
0811 01:00:16.118956 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 01:00:16.121402 19334 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e914bc74a7164c08bf60405473c84886: Bootstrap starting.
I20260811 01:00:16.122355 19334 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e914bc74a7164c08bf60405473c84886: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:16.122712 19334 log.cc:824] T 00000000000000000000000000000000 P e914bc74a7164c08bf60405473c84886: Log is configured to *not* fsync() on all Append() calls
I20260811 01:00:16.123999 19334 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e914bc74a7164c08bf60405473c84886: No bootstrap required, opened a new log
I20260811 01:00:16.125726 19334 raft_consensus.cc:348] T 00000000000000000000000000000000 P e914bc74a7164c08bf60405473c84886 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e914bc74a7164c08bf60405473c84886" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 33845 } } peers { permanent_uuid: "68c903aaea354df1b1b191043148808b" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34033 } } peers { permanent_uuid: "bf0387f881a54ca3a3b1bf67fbb0d844" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 35331 } }
I20260811 01:00:16.125985 19334 raft_consensus.cc:729] T 00000000000000000000000000000000 P e914bc74a7164c08bf60405473c84886 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e914bc74a7164c08bf60405473c84886, State: Initialized, Role: FOLLOWER
I20260811 01:00:16.126087 19334 consensus_queue.cc:260] T 00000000000000000000000000000000 P e914bc74a7164c08bf60405473c84886 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e914bc74a7164c08bf60405473c84886" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 33845 } } peers { permanent_uuid: "68c903aaea354df1b1b191043148808b" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34033 } } peers { permanent_uuid: "bf0387f881a54ca3a3b1bf67fbb0d844" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 35331 } }
I20260811 01:00:16.126535 19294 raft_consensus.cc:482] T 00000000000000000000000000000000 P e914bc74a7164c08bf60405473c84886 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 01:00:16.126605 19294 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e914bc74a7164c08bf60405473c84886 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:16.127700 19294 raft_consensus.cc:504] T 00000000000000000000000000000000 P e914bc74a7164c08bf60405473c84886 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e914bc74a7164c08bf60405473c84886" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 33845 } } peers { permanent_uuid: "68c903aaea354df1b1b191043148808b" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34033 } } peers { permanent_uuid: "bf0387f881a54ca3a3b1bf67fbb0d844" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 35331 } }
I20260811 01:00:16.128038 19294 leader_election.cc:288] T 00000000000000000000000000000000 P e914bc74a7164c08bf60405473c84886 [CANDIDATE]: Term 1 election: Requested vote from peers 68c903aaea354df1b1b191043148808b (127.15.70.61:34033), bf0387f881a54ca3a3b1bf67fbb0d844 (127.15.70.60:35331)
I20260811 01:00:16.128489 19411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e914bc74a7164c08bf60405473c84886" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "68c903aaea354df1b1b191043148808b"
I20260811 01:00:16.128661 19411 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 68c903aaea354df1b1b191043148808b [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:16.129809 19534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e914bc74a7164c08bf60405473c84886" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "bf0387f881a54ca3a3b1bf67fbb0d844"
I20260811 01:00:16.129917 19411 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 68c903aaea354df1b1b191043148808b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e914bc74a7164c08bf60405473c84886 in term 1.
I20260811 01:00:16.129999 19534 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bf0387f881a54ca3a3b1bf67fbb0d844 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:16.130270 19258 leader_election.cc:302] T 00000000000000000000000000000000 P e914bc74a7164c08bf60405473c84886 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68c903aaea354df1b1b191043148808b, e914bc74a7164c08bf60405473c84886; no voters:
I20260811 01:00:16.130925 19642 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e914bc74a7164c08bf60405473c84886 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:00:16.131217 19642 raft_consensus.cc:686] T 00000000000000000000000000000000 P e914bc74a7164c08bf60405473c84886 [term 1 LEADER]: Becoming Leader. State: Replica: e914bc74a7164c08bf60405473c84886, State: Running, Role: LEADER
I20260811 01:00:16.131219 19534 raft_consensus.cc:2454] T 00000000000000000000000000000000 P bf0387f881a54ca3a3b1bf67fbb0d844 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e914bc74a7164c08bf60405473c84886 in term 1.
I20260811 01:00:16.131408 19642 consensus_queue.cc:237] T 00000000000000000000000000000000 P e914bc74a7164c08bf60405473c84886 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e914bc74a7164c08bf60405473c84886" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 33845 } } peers { permanent_uuid: "68c903aaea354df1b1b191043148808b" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34033 } } peers { permanent_uuid: "bf0387f881a54ca3a3b1bf67fbb0d844" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 35331 } }
I20260811 01:00:16.126462 19334 sys_catalog.cc:564] T 00000000000000000000000000000000 P e914bc74a7164c08bf60405473c84886 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:00:16.132064 19642 sys_catalog.cc:455] T 00000000000000000000000000000000 P e914bc74a7164c08bf60405473c84886 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e914bc74a7164c08bf60405473c84886. Latest consensus state: current_term: 1 leader_uuid: "e914bc74a7164c08bf60405473c84886" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e914bc74a7164c08bf60405473c84886" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 33845 } } peers { permanent_uuid: "68c903aaea354df1b1b191043148808b" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34033 } } peers { permanent_uuid: "bf0387f881a54ca3a3b1bf67fbb0d844" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 35331 } } }
I20260811 01:00:16.132230 19642 sys_catalog.cc:458] T 00000000000000000000000000000000 P e914bc74a7164c08bf60405473c84886 [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:16.126426 19631 sys_catalog.cc:455] T 00000000000000000000000000000000 P e914bc74a7164c08bf60405473c84886 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e914bc74a7164c08bf60405473c84886" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 33845 } } peers { permanent_uuid: "68c903aaea354df1b1b191043148808b" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34033 } } peers { permanent_uuid: "bf0387f881a54ca3a3b1bf67fbb0d844" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 35331 } } }
I20260811 01:00:16.132438 19631 sys_catalog.cc:458] T 00000000000000000000000000000000 P e914bc74a7164c08bf60405473c84886 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 01:00:16.137281 19659 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e914bc74a7164c08bf60405473c84886: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 01:00:16.137365 19659 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 01:00:16.137506 19660 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:00:16.137689 19660 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:00:16.147444 19343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:16.129598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37460 (local address 127.15.70.62:33845)
0811 01:00:16.129655 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:16.129658 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:16.133575 (+ 3917us) server_negotiation.cc:407] Connection header received
0811 01:00:16.133690 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:16.133691 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:16.133705 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:16.133738 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:16.134674 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:16.135519 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:16.137611 (+ 2092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:16.137934 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:16.137981 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:16.143118 (+ 5137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:16.143120 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:16.143120 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:16.143129 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:16.144933 (+ 1804us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:16.146439 (+ 1506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:16.146441 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:16.146442 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:16.146513 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:16.146721 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:16.146721 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:16.146722 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:16.146885 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:16.146973 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:16.147217 (+ 244us) server_negotiation.cc:299] Negotiation successful
0811 01:00:16.147315 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 01:00:16.152076 19463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:16.130567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43172 (local address 127.15.70.61:34033)
0811 01:00:16.130619 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:16.130621 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:16.136721 (+ 6100us) server_negotiation.cc:407] Connection header received
0811 01:00:16.136835 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:16.136836 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:16.136849 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:16.136892 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:16.140439 (+ 3547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:16.141206 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:16.142203 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:16.142504 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:16.142549 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:16.148707 (+ 6158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:16.148709 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:16.148710 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:16.148721 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:16.150550 (+ 1829us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:16.150996 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:16.151054 (+ 58us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:16.151055 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:16.151127 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:16.151338 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:16.151339 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:16.151339 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:16.151487 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:16.151605 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:16.151851 (+ 246us) server_negotiation.cc:299] Negotiation successful
0811 01:00:16.151976 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 01:00:16.152384 19534 raft_consensus.cc:1261] T 00000000000000000000000000000000 P bf0387f881a54ca3a3b1bf67fbb0d844 [term 1 FOLLOWER]: Refusing update from remote peer e914bc74a7164c08bf60405473c84886: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260811 01:00:16.152796 19261 tablet.cc:2369] T 00000000000000000000000000000000 P e914bc74a7164c08bf60405473c84886: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:00:16.152840 19644 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e914bc74a7164c08bf60405473c84886 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf0387f881a54ca3a3b1bf67fbb0d844" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 35331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:00:16.154592 19586 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf0387f881a54ca3a3b1bf67fbb0d844 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e914bc74a7164c08bf60405473c84886. Latest consensus state: current_term: 1 leader_uuid: "e914bc74a7164c08bf60405473c84886" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e914bc74a7164c08bf60405473c84886" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 33845 } } peers { permanent_uuid: "68c903aaea354df1b1b191043148808b" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34033 } } peers { permanent_uuid: "bf0387f881a54ca3a3b1bf67fbb0d844" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 35331 } } }
I20260811 01:00:16.154709 19586 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf0387f881a54ca3a3b1bf67fbb0d844 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:00:16.155220 19411 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 68c903aaea354df1b1b191043148808b [term 1 FOLLOWER]: Refusing update from remote peer e914bc74a7164c08bf60405473c84886: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:00:16.155534 19642 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e914bc74a7164c08bf60405473c84886 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68c903aaea354df1b1b191043148808b" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:00:16.157012 19611 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68c903aaea354df1b1b191043148808b [sys.catalog]: SysCatalogTable state changed. Reason: New leader e914bc74a7164c08bf60405473c84886. Latest consensus state: current_term: 1 leader_uuid: "e914bc74a7164c08bf60405473c84886" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e914bc74a7164c08bf60405473c84886" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 33845 } } peers { permanent_uuid: "68c903aaea354df1b1b191043148808b" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34033 } } peers { permanent_uuid: "bf0387f881a54ca3a3b1bf67fbb0d844" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 35331 } } }
I20260811 01:00:16.157116 19611 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68c903aaea354df1b1b191043148808b [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:00:16.158978 19579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:16.135302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49974 (local address 127.15.70.60:35331)
0811 01:00:16.135358 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:16.135360 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:16.140073 (+ 4713us) server_negotiation.cc:407] Connection header received
0811 01:00:16.140185 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:16.140187 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:16.140200 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:16.140231 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:16.140893 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:16.141589 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:16.153189 (+ 11600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:16.153540 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:16.153592 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:16.155241 (+ 1649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:16.155243 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:16.155243 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:16.155252 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:16.157299 (+ 2047us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:16.157808 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:16.157810 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:16.157811 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:16.157892 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:16.158090 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:16.158090 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:16.158091 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:16.158240 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:16.158332 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:16.158770 (+ 438us) server_negotiation.cc:299] Negotiation successful
0811 01:00:16.158867 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 01:00:16.161177 19644 sys_catalog.cc:455] T 00000000000000000000000000000000 P e914bc74a7164c08bf60405473c84886 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e914bc74a7164c08bf60405473c84886" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e914bc74a7164c08bf60405473c84886" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 33845 } } peers { permanent_uuid: "68c903aaea354df1b1b191043148808b" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34033 } } peers { permanent_uuid: "bf0387f881a54ca3a3b1bf67fbb0d844" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 35331 } } }
I20260811 01:00:16.161299 19644 sys_catalog.cc:458] T 00000000000000000000000000000000 P e914bc74a7164c08bf60405473c84886 [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:16.161470 19663 mvcc.cc:205] Tried to move back new op lower bound from 7317135426156527616 to 7317135426075922432. Current Snapshot: MvccSnapshot[applied={T|T < 7317135426156527616}]
I20260811 01:00:16.162341 19586 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf0387f881a54ca3a3b1bf67fbb0d844 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e914bc74a7164c08bf60405473c84886" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e914bc74a7164c08bf60405473c84886" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 33845 } } peers { permanent_uuid: "68c903aaea354df1b1b191043148808b" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34033 } } peers { permanent_uuid: "bf0387f881a54ca3a3b1bf67fbb0d844" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 35331 } } }
I20260811 01:00:16.162428 19586 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf0387f881a54ca3a3b1bf67fbb0d844 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:00:16.165621 19664 mvcc.cc:205] Tried to move back new op lower bound from 7317135426156527616 to 7317135426075922432. Current Snapshot: MvccSnapshot[applied={T|T < 7317135426156527616}]
I20260811 01:00:16.167236 19631 sys_catalog.cc:455] T 00000000000000000000000000000000 P e914bc74a7164c08bf60405473c84886 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e914bc74a7164c08bf60405473c84886" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e914bc74a7164c08bf60405473c84886" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 33845 } } peers { permanent_uuid: "68c903aaea354df1b1b191043148808b" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34033 } } peers { permanent_uuid: "bf0387f881a54ca3a3b1bf67fbb0d844" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 35331 } } }
I20260811 01:00:16.167357 19631 sys_catalog.cc:458] T 00000000000000000000000000000000 P e914bc74a7164c08bf60405473c84886 [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:16.167670 19611 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68c903aaea354df1b1b191043148808b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e914bc74a7164c08bf60405473c84886" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e914bc74a7164c08bf60405473c84886" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 33845 } } peers { permanent_uuid: "68c903aaea354df1b1b191043148808b" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 34033 } } peers { permanent_uuid: "bf0387f881a54ca3a3b1bf67fbb0d844" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 35331 } } }
I20260811 01:00:16.167780 19611 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68c903aaea354df1b1b191043148808b [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:00:16.168042 19668 mvcc.cc:205] Tried to move back new op lower bound from 7317135426156527616 to 7317135426075922432. Current Snapshot: MvccSnapshot[applied={T|T < 7317135426156527616}]
I20260811 01:00:16.168437 19660 catalog_manager.cc:1347] Generated new cluster ID: 9e6c2240a9ce4da6863523193f41fae0
I20260811 01:00:16.168519 19660 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:00:16.180473 19660 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:00:16.181362 19660 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:00:16.189316 19660 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e914bc74a7164c08bf60405473c84886: Generated new TSK 0
I20260811 01:00:16.189668 19660 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 01:00:16.224653 19463 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:00:16.222458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43178 (local address 127.15.70.61:34033)
0811 01:00:16.222521 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:16.222524 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:16.223774 (+ 1250us) server_negotiation.cc:407] Connection header received
0811 01:00:16.223901 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:16.223903 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:16.223918 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:16.223953 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:16.224548 (+ 595us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43178: BlockingRecv error: recv got EOF from 127.0.0.1:43178 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
W20260811 01:00:16.225641 19579 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:00:16.222954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49990 (local address 127.15.70.60:35331)
0811 01:00:16.223072 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:16.223074 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:16.224974 (+ 1900us) server_negotiation.cc:407] Connection header received
0811 01:00:16.225093 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:16.225095 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:16.225109 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:16.225141 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:16.225551 (+ 410us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49990: BlockingRecv error: recv got EOF from 127.0.0.1:49990 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
W20260811 01:00:16.226588 19343 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:00:16.223426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37466 (local address 127.15.70.62:33845)
0811 01:00:16.223494 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:16.223496 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:16.225927 (+ 2431us) server_negotiation.cc:407] Connection header received
0811 01:00:16.226045 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:16.226047 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:16.226062 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:16.226095 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:16.226498 (+ 403us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37466: BlockingRecv error: recv got EOF from 127.0.0.1:37466 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260811 01:00:16.233084 19463 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:00:16.231612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43182 (local address 127.15.70.61:34033)
0811 01:00:16.231679 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:16.231682 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:16.232077 (+ 395us) server_negotiation.cc:407] Connection header received
0811 01:00:16.232308 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:16.232309 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:16.232350 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:16.232395 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:16.232996 (+ 601us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43182: BlockingRecv error: recv got EOF from 127.0.0.1:43182 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
W20260811 01:00:16.237360 19463 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:00:16.236125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43190 (local address 127.15.70.61:34033)
0811 01:00:16.236178 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:16.236181 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:16.236576 (+ 395us) server_negotiation.cc:407] Connection header received
0811 01:00:16.236714 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:16.236715 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:16.236732 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:16.236771 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:16.237268 (+ 497us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43190: BlockingRecv error: recv got EOF from 127.0.0.1:43190 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
W20260811 01:00:16.242096 19463 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:00:16.240892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43204 (local address 127.15.70.61:34033)
0811 01:00:16.240947 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:16.240949 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:16.241312 (+ 363us) server_negotiation.cc:407] Connection header received
0811 01:00:16.241472 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:16.241473 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:16.241491 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:16.241532 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:16.242018 (+ 486us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43204: BlockingRecv error: recv got EOF from 127.0.0.1:43204 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
W20260811 01:00:16.249294 19463 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:00:16.247908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43212 (local address 127.15.70.61:34033)
0811 01:00:16.247972 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:16.247975 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:16.248418 (+ 443us) server_negotiation.cc:407] Connection header received
0811 01:00:16.248576 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:16.248578 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:16.248596 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:16.248640 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:16.249205 (+ 565us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43212: BlockingRecv error: recv got EOF from 127.0.0.1:43212 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
W20260811 01:00:16.260653 19463 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:00:16.259226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43214 (local address 127.15.70.61:34033)
0811 01:00:16.259299 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:16.259301 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:16.259746 (+ 445us) server_negotiation.cc:407] Connection header received
0811 01:00:16.259903 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:16.259905 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:16.259923 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:16.259967 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:16.260559 (+ 592us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43214: BlockingRecv error: recv got EOF from 127.0.0.1:43214 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
W20260811 01:00:16.280126 19463 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:00:16.278577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43224 (local address 127.15.70.61:34033)
0811 01:00:16.278650 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:16.278653 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:16.279127 (+ 474us) server_negotiation.cc:407] Connection header received
0811 01:00:16.279291 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:16.279293 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:16.279314 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:16.279383 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:16.280032 (+ 649us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43224: BlockingRecv error: recv got EOF from 127.0.0.1:43224 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
W20260811 01:00:16.315518 19463 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:00:16.314447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43238 (local address 127.15.70.61:34033)
0811 01:00:16.314547 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:16.314550 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:16.314699 (+ 149us) server_negotiation.cc:407] Connection header received
0811 01:00:16.314773 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:16.314775 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:16.314790 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:16.314886 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:16.315429 (+ 543us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43238: BlockingRecv error: recv got EOF from 127.0.0.1:43238 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260811 01:00:16.382288 19463 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:00:16.381219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43246 (local address 127.15.70.61:34033)
0811 01:00:16.381331 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:16.381334 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:16.381467 (+ 133us) server_negotiation.cc:407] Connection header received
0811 01:00:16.381587 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:16.381588 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:16.381612 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:16.381687 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:16.382150 (+ 463us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43246: BlockingRecv error: recv got EOF from 127.0.0.1:43246 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
W20260811 01:00:16.512878 19463 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:00:16.511906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43260 (local address 127.15.70.61:34033)
0811 01:00:16.511985 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:16.511987 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:16.512102 (+ 115us) server_negotiation.cc:407] Connection header received
0811 01:00:16.512151 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:16.512153 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:16.512171 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:16.512257 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:16.512754 (+ 497us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43260: BlockingRecv error: recv got EOF from 127.0.0.1:43260 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
W20260811 01:00:16.771474 19463 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:00:16.770646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43266 (local address 127.15.70.61:34033)
0811 01:00:16.770743 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:16.770745 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:16.770759 (+ 14us) server_negotiation.cc:407] Connection header received
0811 01:00:16.770838 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:16.770839 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:16.770852 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:16.770924 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:16.771362 (+ 438us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43266: BlockingRecv error: recv got EOF from 127.0.0.1:43266 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 01:00:17.077200 19607 catalog_manager.cc:1259] Loaded cluster ID: 9e6c2240a9ce4da6863523193f41fae0
I20260811 01:00:17.077317 19607 catalog_manager.cc:1552] T 00000000000000000000000000000000 P bf0387f881a54ca3a3b1bf67fbb0d844: loading cluster ID for follower catalog manager: success
I20260811 01:00:17.078205 19607 catalog_manager.cc:1574] T 00000000000000000000000000000000 P bf0387f881a54ca3a3b1bf67fbb0d844: acquiring CA information for follower catalog manager: success
I20260811 01:00:17.078509 19607 catalog_manager.cc:1602] T 00000000000000000000000000000000 P bf0387f881a54ca3a3b1bf67fbb0d844: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 01:00:17.108762 19626 catalog_manager.cc:1259] Loaded cluster ID: 9e6c2240a9ce4da6863523193f41fae0
I20260811 01:00:17.108917 19626 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 68c903aaea354df1b1b191043148808b: loading cluster ID for follower catalog manager: success
I20260811 01:00:17.109894 19626 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 68c903aaea354df1b1b191043148808b: acquiring CA information for follower catalog manager: success
I20260811 01:00:17.110226 19626 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 68c903aaea354df1b1b191043148808b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 01:00:17.288460 19789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:17.285034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43270 (local address 127.15.70.61:34033)
0811 01:00:17.285205 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:17.285207 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:17.285221 (+ 14us) server_negotiation.cc:407] Connection header received
0811 01:00:17.285256 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:17.285257 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:17.285336 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:17.285427 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:00:17.285639 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:17.286233 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:17.287334 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:17.287632 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:17.287753 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:17.288005 (+ 252us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:00:17.288152 (+ 147us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:00:17.288228 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:17.288312 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 01:00:17.288359 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":91,"threads_started":1}
I20260811 01:00:17.294144 19800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:17.291244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49996 (local address 127.15.70.60:35331)
0811 01:00:17.291449 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:17.291452 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:17.291464 (+ 12us) server_negotiation.cc:407] Connection header received
0811 01:00:17.291526 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:17.291527 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:17.291592 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:17.291693 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:00:17.291847 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:17.292386 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:17.293223 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:17.293489 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:17.293567 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:17.293741 (+ 174us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:00:17.293874 (+ 133us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:00:17.293968 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:17.294009 (+ 41us) server_negotiation.cc:299] Negotiation successful
0811 01:00:17.294031 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":77,"threads_started":1}
I20260811 01:00:17.299814 19789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:17.296698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43286 (local address 127.15.70.61:34033)
0811 01:00:17.296750 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:17.296753 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:17.296763 (+ 10us) server_negotiation.cc:407] Connection header received
0811 01:00:17.296792 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:17.296793 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:17.296803 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:17.296876 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:00:17.297083 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:17.297909 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:17.298851 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:17.299180 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:17.299249 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:17.299461 (+ 212us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:00:17.299502 (+ 41us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:00:17.299565 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:17.299685 (+ 120us) server_negotiation.cc:299] Negotiation successful
0811 01:00:17.299720 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 01:00:17.300019 19800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:17.296585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50002 (local address 127.15.70.60:35331)
0811 01:00:17.296632 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:17.296634 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:17.297016 (+ 382us) server_negotiation.cc:407] Connection header received
0811 01:00:17.297083 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:17.297084 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:17.297094 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:17.297142 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:00:17.297307 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:17.297755 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:17.298975 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:17.299320 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:17.299392 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:17.299572 (+ 180us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:00:17.299610 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:00:17.299673 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:17.299907 (+ 234us) server_negotiation.cc:299] Negotiation successful
0811 01:00:17.299938 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 01:00:17.300836 19808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:17.296500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37468 (local address 127.15.70.62:33845)
0811 01:00:17.296836 (+ 336us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:17.296838 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:17.296845 (+ 7us) server_negotiation.cc:407] Connection header received
0811 01:00:17.296933 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:17.296934 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:17.297017 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:17.297136 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:00:17.297300 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:17.298078 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:17.299227 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:17.299565 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:17.299659 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:17.299860 (+ 201us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:00:17.300517 (+ 657us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:00:17.300595 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:17.300645 (+ 50us) server_negotiation.cc:299] Negotiation successful
0811 01:00:17.300682 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":83,"threads_started":1}
I20260811 01:00:17.303249 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 19226
I20260811 01:00:17.322796 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 19349
I20260811 01:00:17.340159 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 19468
2026-08-11T01:00:17Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3394 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:00:17 dist-test-slave-h3ft krb5kdc[19817](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:00:17 dist-test-slave-h3ft krb5kdc[19817](info): set up 2 sockets
Aug 11 01:00:17 dist-test-slave-h3ft krb5kdc[19817](info): commencing operation
krb5kdc: starting...
W20260811 01:00:18.744977 15640 mini_kdc.cc:121] Time spent starting KDC: real 1.375s user 0.003s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/krb5kdc/test-user.keytab.
Aug 11 01:00:18 dist-test-slave-h3ft krb5kdc[19817](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410018, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:00:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:00:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.70.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
Entry for principal kudu/127.15.70.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab.
I20260811 01:00:18.906926 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:42529
--webserver_interface=127.15.70.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:43753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:42529,127.15.70.61:41085,127.15.70.60:40237
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:19.010284 19837 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 01:00:19.010682 19837 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:19.010720 19837 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:19.010775 19837 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:19.012456 19837 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:00:19.012631 19837 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:19.012660 19837 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:19.012701 19837 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:00:19.012727 19837 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:00:19.014781 19837 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:43753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:42529,127.15.70.61:41085,127.15.70.60:40237
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.62.keytab
--principal=kudu/127.15.70.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.62:42529
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.70.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19837
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:19.015218 19837 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:19.015543 19837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:19.021999 19853 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:19.022027 19850 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:19.022022 19849 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:19.022135 19837 server_base.cc:1034] running on GCE node
I20260811 01:00:19.022529 19837 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:19.022953 19837 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:19.024186 19837 hybrid_clock.cc:648] HybridClock initialized: now 1786410019024163 us; error 44 us; skew 500 ppm
Aug 11 01:00:19 dist-test-slave-h3ft krb5kdc[19817](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410019, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:19.031780 19837 init.cc:377] Logged in from keytab as kudu/127.15.70.62@KRBTEST.COM (short username kudu)
I20260811 01:00:19.032465 19837 webserver.cc:460] Webserver started at http://127.15.70.62:34161/ using document root <none> and password file <none>
I20260811 01:00:19.032759 19837 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:19.032835 19837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:19.033011 19837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:19.034361 19837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-0/data/instance:
uuid: "a668f7edc8a64ac487d73c4b99fb4a8a"
format_stamp: "Formatted at 2026-08-11 01:00:19 on dist-test-slave-h3ft"
server_key: "bba4e796da479d07d41480d183b8d4ad"
server_key_iv: "0896bb7b2f2230c80a6593d434e68ab1"
server_key_version: "encryptionkey@0"
I20260811 01:00:19.034822 19837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-0/wal/instance:
uuid: "a668f7edc8a64ac487d73c4b99fb4a8a"
format_stamp: "Formatted at 2026-08-11 01:00:19 on dist-test-slave-h3ft"
server_key: "bba4e796da479d07d41480d183b8d4ad"
server_key_iv: "0896bb7b2f2230c80a6593d434e68ab1"
server_key_version: "encryptionkey@0"
I20260811 01:00:19.036540 19837 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:00:19.037468 19865 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:19.037714 19837 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:00:19.037853 19837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-0/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-0/wal
uuid: "a668f7edc8a64ac487d73c4b99fb4a8a"
format_stamp: "Formatted at 2026-08-11 01:00:19 on dist-test-slave-h3ft"
server_key: "bba4e796da479d07d41480d183b8d4ad"
server_key_iv: "0896bb7b2f2230c80a6593d434e68ab1"
server_key_version: "encryptionkey@0"
I20260811 01:00:19.037945 19837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:19.051748 19837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:19.054684 19837 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:19.054896 19837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:19.060410 19837 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.62:42529
I20260811 01:00:19.060461 19953 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.62:42529 every 8 connection(s)
I20260811 01:00:19.060950 19837 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-0/data/info.pb
I20260811 01:00:19.062394 19956 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:19.064667 19956 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.70.62" port: 42529 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:00:19.066185 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 19837
I20260811 01:00:19.066304 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-0/wal/instance
I20260811 01:00:19.066551 15640 external_mini_cluster.cc:1428] Setting key 918ecdbcf06db72dfe3eaafba992fe87
Aug 11 01:00:19 dist-test-slave-h3ft krb5kdc[19817](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410019, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.70.61@KRBTEST.COM; defaulting to no policy
I20260811 01:00:19.079305 19959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:19.065748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37112 (local address 127.15.70.62:42529)
0811 01:00:19.066039 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:19.066051 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:19.066235 (+ 184us) server_negotiation.cc:407] Connection header received
0811 01:00:19.067190 (+ 955us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:19.067193 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:19.067220 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:19.067338 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:19.068349 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.069503 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.070681 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.071167 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.071309 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:19.075103 (+ 3794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:19.075123 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:19.075124 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:19.075132 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:19.077162 (+ 2030us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:19.077677 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:19.077681 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:19.077681 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:19.077787 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:19.078043 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:19.078044 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:19.078044 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:19.078344 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:19.078456 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:19.078738 (+ 282us) server_negotiation.cc:299] Negotiation successful
0811 01:00:19.078927 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":5,"server-negotiator.queue_time_us":240,"thread_start_us":127,"threads_started":1}
I20260811 01:00:19.079303 19958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:19.065658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:42529 (local address 127.0.0.1:37112)
0811 01:00:19.066038 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:19.066101 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:19.066982 (+ 881us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:19.067378 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:19.067382 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:19.067891 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:19.068186 (+ 295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:19.068193 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.069665 (+ 1472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.069666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:19.070561 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:19.070565 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.071304 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.071305 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:19.071470 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:19.072418 (+ 948us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:19.072440 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:19.074906 (+ 2466us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:19.077288 (+ 2382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:19.077297 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:19.077300 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:19.077562 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:19.077865 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:19.077865 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:19.077866 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:19.077967 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:19.078425 (+ 458us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:19.078431 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:19.078515 (+ 84us) client_negotiation.cc:769] Sending connection context
0811 01:00:19.078643 (+ 128us) client_negotiation.cc:240] Negotiation successful
0811 01:00:19.078979 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"mutex_wait_us":143,"thread_start_us":155,"threads_started":1}
I20260811 01:00:19.080549 19956 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.70.61" port: 41085 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:00:19.081069 19958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:19.080896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.61:41085 (local address 127.0.0.1:35180)
0811 01:00:19.080961 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:19.081036 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.61:41085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260811 01:00:19.081306 19868 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.70.61:41085: connect: Connection refused (error 111)
I20260811 01:00:19.081982 19958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:19.081835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.61:41085 (local address 127.0.0.1:35184)
0811 01:00:19.081912 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:19.081950 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.61:41085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.61@KRBTEST.COM" created.
W20260811 01:00:19.082159 19956 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.70.61:41085: Network error: Client connection negotiation failed: client connection to 127.15.70.61:41085: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.61.keytab.
Entry for principal kudu/127.15.70.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.61.keytab.
I20260811 01:00:19.103864 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.61:41085
--webserver_interface=127.15.70.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.61.keytab
--principal=kudu/127.15.70.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:43753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:42529,127.15.70.61:41085,127.15.70.60:40237
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:00:19.131467 19956 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.70.61" port: 41085 } attempt: 1
I20260811 01:00:19.132273 19958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:19.132061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.61:41085 (local address 127.0.0.1:35192)
0811 01:00:19.132153 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:19.132214 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.61:41085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260811 01:00:19.132758 19958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:19.132651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.61:41085 (local address 127.0.0.1:35200)
0811 01:00:19.132704 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:19.132737 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.61:41085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260811 01:00:19.132899 19956 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.70.61:41085: Network error: Client connection negotiation failed: client connection to 127.15.70.61:41085: connect: Connection refused (error 111)
I20260811 01:00:19.201203 19956 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.70.61" port: 41085 } attempt: 2
I20260811 01:00:19.201996 19958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:19.201790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.61:41085 (local address 127.0.0.1:35210)
0811 01:00:19.201895 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:19.201949 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.61:41085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260811 01:00:19.202601 19958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:19.202438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.61:41085 (local address 127.0.0.1:35220)
0811 01:00:19.202520 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:19.202561 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.61:41085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260811 01:00:19.202787 19956 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.70.61:41085: Network error: Client connection negotiation failed: client connection to 127.15.70.61:41085: connect: Connection refused (error 111)
W20260811 01:00:19.209223 19965 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 01:00:19.209585 19965 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:19.209609 19965 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:19.209640 19965 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:19.211444 19965 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:00:19.211536 19965 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:19.211555 19965 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:19.211570 19965 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:00:19.211581 19965 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:00:19.213690 19965 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:43753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:42529,127.15.70.61:41085,127.15.70.60:40237
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.61.keytab
--principal=kudu/127.15.70.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.61:41085
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.15.70.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19965
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:19.214020 19965 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:19.214283 19965 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:19.220662 19976 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:19.220680 19972 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:19.220672 19973 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:19.221170 19965 server_base.cc:1034] running on GCE node
I20260811 01:00:19.221625 19965 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:19.222136 19965 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:19.223344 19965 hybrid_clock.cc:648] HybridClock initialized: now 1786410019223313 us; error 50 us; skew 500 ppm
Aug 11 01:00:19 dist-test-slave-h3ft krb5kdc[19817](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410019, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:19.227306 19965 init.cc:377] Logged in from keytab as kudu/127.15.70.61@KRBTEST.COM (short username kudu)
I20260811 01:00:19.227928 19965 webserver.cc:460] Webserver started at http://127.15.70.61:33827/ using document root <none> and password file <none>
I20260811 01:00:19.228214 19965 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:19.228292 19965 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:19.228467 19965 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:19.229851 19965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-1/data/instance:
uuid: "2cbe7f50fd424aaab76b4261387cb277"
format_stamp: "Formatted at 2026-08-11 01:00:19 on dist-test-slave-h3ft"
server_key: "49715b5983ac86eebfdb6b70fcb245f4"
server_key_iv: "3b2539e3c6b053f41dfe75512f98b3f2"
server_key_version: "encryptionkey@0"
I20260811 01:00:19.230335 19965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-1/wal/instance:
uuid: "2cbe7f50fd424aaab76b4261387cb277"
format_stamp: "Formatted at 2026-08-11 01:00:19 on dist-test-slave-h3ft"
server_key: "49715b5983ac86eebfdb6b70fcb245f4"
server_key_iv: "3b2539e3c6b053f41dfe75512f98b3f2"
server_key_version: "encryptionkey@0"
I20260811 01:00:19.232147 19965 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260811 01:00:19.233328 19994 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:19.233609 19965 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:00:19.233743 19965 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-1/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-1/wal
uuid: "2cbe7f50fd424aaab76b4261387cb277"
format_stamp: "Formatted at 2026-08-11 01:00:19 on dist-test-slave-h3ft"
server_key: "49715b5983ac86eebfdb6b70fcb245f4"
server_key_iv: "3b2539e3c6b053f41dfe75512f98b3f2"
server_key_version: "encryptionkey@0"
I20260811 01:00:19.233842 19965 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:19.252791 19965 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:19.255784 19965 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:19.256000 19965 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:19.261195 19965 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.61:41085
I20260811 01:00:19.261238 20077 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.61:41085 every 8 connection(s)
I20260811 01:00:19.261704 19965 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-1/data/info.pb
I20260811 01:00:19.262609 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 19965
I20260811 01:00:19.262710 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-1/wal/instance
I20260811 01:00:19.263063 15640 external_mini_cluster.cc:1428] Setting key 635b7173a986acc495f1415ad6986fde
I20260811 01:00:19.263221 20078 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:19.265372 20078 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.70.62" port: 42529 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:00:19 dist-test-slave-h3ft krb5kdc[19817](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410019, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.61@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.70.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.70.60@KRBTEST.COM" created.
I20260811 01:00:19.277398 19959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:19.266470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37126 (local address 127.15.70.62:42529)
0811 01:00:19.266573 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:19.266577 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:19.266849 (+ 272us) server_negotiation.cc:407] Connection header received
0811 01:00:19.267561 (+ 712us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:19.267563 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:19.267578 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:19.267643 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:19.268423 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.269061 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.270266 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.270514 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.270603 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:19.273672 (+ 3069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:19.273674 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:19.273675 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:19.273692 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:19.275471 (+ 1779us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:19.276055 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:19.276057 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:19.276057 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:19.276126 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:19.276401 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:19.276402 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:19.276403 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:19.276551 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:19.276610 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:19.277113 (+ 503us) server_negotiation.cc:299] Negotiation successful
0811 01:00:19.277234 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 01:00:19.277519 20083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:19.266429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:42529 (local address 127.0.0.1:37126)
0811 01:00:19.266683 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:19.266735 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:19.267441 (+ 706us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:19.267719 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:19.267724 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:19.268063 (+ 339us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:19.268308 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:19.268313 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.269177 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.269178 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:19.270163 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:19.270167 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.270629 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.270630 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:19.270797 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:19.271553 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:19.271563 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:19.273536 (+ 1973us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:19.275585 (+ 2049us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:19.275596 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:19.275599 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:19.275956 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:19.276194 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:19.276195 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:19.276195 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:19.276330 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:19.276620 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:19.276627 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:19.276926 (+ 299us) client_negotiation.cc:769] Sending connection context
0811 01:00:19.277038 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 01:00:19.277260 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":157,"threads_started":1}
I20260811 01:00:19.278352 20078 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.70.61" port: 41085 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:00:19 dist-test-slave-h3ft krb5kdc[19817](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410019, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.61@KRBTEST.COM for kudu/127.15.70.61@KRBTEST.COM
I20260811 01:00:19.287158 20083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:19.278720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.61:41085 (local address 127.0.0.1:35234)
0811 01:00:19.278785 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:19.278798 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:19.278849 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:19.279230 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:19.279231 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:19.279391 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:19.279471 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:19.279473 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.280455 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.280457 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:19.280980 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:19.280981 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.281525 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.281526 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:19.281606 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:19.282134 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:19.282139 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:19.283652 (+ 1513us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:19.285845 (+ 2193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:19.285846 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:19.285846 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:19.286044 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:19.286309 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:19.286310 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:19.286310 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:19.286372 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:19.286743 (+ 371us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:19.286744 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:19.286787 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 01:00:19.286856 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 01:00:19.286992 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260811 01:00:19.287277 20084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:19.278802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35234 (local address 127.15.70.61:41085)
0811 01:00:19.279067 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:19.279073 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:19.279105 (+ 32us) server_negotiation.cc:407] Connection header received
0811 01:00:19.279124 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:19.279126 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:19.279139 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:19.279230 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:19.279558 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.280334 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.281065 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.281430 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.281527 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:19.283750 (+ 2223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:19.283763 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:19.283763 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:19.283771 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:19.285716 (+ 1945us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:19.286153 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:19.286158 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:19.286159 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:19.286227 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:19.286438 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:19.286439 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:19.286439 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:19.286673 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:19.286762 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:19.286894 (+ 132us) server_negotiation.cc:299] Negotiation successful
0811 01:00:19.287137 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":138,"server-negotiator.queue_time_us":193,"thread_start_us":140,"threads_started":1}
I20260811 01:00:19.288331 20078 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.70.60" port: 40237 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:00:19.288877 20083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:19.288677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:40237 (local address 127.0.0.1:59054)
0811 01:00:19.288766 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:19.288841 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.60:40237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260811 01:00:19.289116 19997 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.70.60:40237: connect: Connection refused (error 111)
I20260811 01:00:19.289788 20083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:19.289698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:40237 (local address 127.0.0.1:59070)
0811 01:00:19.289730 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:19.289761 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.60:40237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
W20260811 01:00:19.289990 20078 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.70.60:40237: Network error: Client connection negotiation failed: client connection to 127.15.70.60:40237: connect: Connection refused (error 111)
I20260811 01:00:19.294037 19956 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.70.61" port: 41085 } attempt: 3
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.70.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.60.keytab.
Entry for principal kudu/127.15.70.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.60.keytab.
Aug 11 01:00:19 dist-test-slave-h3ft krb5kdc[19817](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410019, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for kudu/127.15.70.61@KRBTEST.COM
I20260811 01:00:19.300374 15640 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN44M8g/build/release/bin/kudu
/tmp/dist-test-taskN44M8g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.60:40237
--webserver_interface=127.15.70.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.60.keytab
--principal=kudu/127.15.70.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.70.20:43753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.70.62:42529,127.15.70.61:41085,127.15.70.60:40237
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:00:19.303617 19958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:19.294577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.61:41085 (local address 127.0.0.1:35236)
0811 01:00:19.294650 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:19.294664 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:19.294740 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:19.294922 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:19.294923 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:19.295210 (+ 287us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:19.295297 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:19.295300 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.296126 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.296128 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:19.296817 (+ 689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:19.296820 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.297249 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.297250 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:19.297351 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:19.297936 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:19.297943 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:19.300068 (+ 2125us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:19.302220 (+ 2152us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:19.302222 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:19.302223 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:19.302520 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:19.302832 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:19.302833 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:19.302834 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:19.302903 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:19.303280 (+ 377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:19.303281 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:19.303338 (+ 57us) client_negotiation.cc:769] Sending connection context
0811 01:00:19.303398 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 01:00:19.303507 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 01:00:19.303709 20084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:19.294692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35236 (local address 127.15.70.61:41085)
0811 01:00:19.294762 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:19.294764 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:19.294789 (+ 25us) server_negotiation.cc:407] Connection header received
0811 01:00:19.294821 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:19.294824 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:19.294842 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:19.294900 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:19.295396 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.295990 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.296910 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.297162 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.297249 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:19.300242 (+ 2993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:19.300246 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:19.300246 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:19.300255 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:19.302105 (+ 1850us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:19.302652 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:19.302653 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:19.302654 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:19.302743 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:19.302977 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:19.302978 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:19.302978 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:19.303204 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:19.303289 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:19.303453 (+ 164us) server_negotiation.cc:299] Negotiation successful
0811 01:00:19.303570 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 01:00:19.304123 19956 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.70.60" port: 40237 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:00:19.304611 19958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:19.304474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:40237 (local address 127.0.0.1:59076)
0811 01:00:19.304534 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:19.304574 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.60:40237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 01:00:19.305034 19958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:19.304939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:40237 (local address 127.0.0.1:59088)
0811 01:00:19.304983 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:19.305008 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.60:40237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 01:00:19.305164 19956 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.70.60:40237: Network error: Client connection negotiation failed: client connection to 127.15.70.60:40237: connect: Connection refused (error 111)
I20260811 01:00:19.336333 19956 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.70.60" port: 40237 } attempt: 1
I20260811 01:00:19.337142 19958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:19.336927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:40237 (local address 127.0.0.1:59090)
0811 01:00:19.337022 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:19.337099 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.60:40237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260811 01:00:19.337561 19958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:19.337458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:40237 (local address 127.0.0.1:59100)
0811 01:00:19.337508 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:19.337537 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.60:40237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260811 01:00:19.337692 19956 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.70.60:40237: Network error: Client connection negotiation failed: client connection to 127.15.70.60:40237: connect: Connection refused (error 111)
I20260811 01:00:19.339283 20078 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.70.60" port: 40237 } attempt: 1
I20260811 01:00:19.339784 20083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:19.339619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:40237 (local address 127.0.0.1:59102)
0811 01:00:19.339690 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:19.339739 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.60:40237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260811 01:00:19.340232 20083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:19.340122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:40237 (local address 127.0.0.1:59112)
0811 01:00:19.340175 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:19.340209 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.60:40237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 01:00:19.340342 20078 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.70.60:40237: Network error: Client connection negotiation failed: client connection to 127.15.70.60:40237: connect: Connection refused (error 111)
W20260811 01:00:19.406589 20090 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 01:00:19.406898 20090 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:19.406919 20090 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:19.406951 20090 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:19.408383 20090 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:00:19.408478 20090 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:19.408509 20090 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:19.408527 20090 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:00:19.408543 20090 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:00:19.408529 20078 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.70.60" port: 40237 } attempt: 2
I20260811 01:00:19.409194 20083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:19.408990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:40237 (local address 127.0.0.1:59114)
0811 01:00:19.409089 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:19.409144 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.60:40237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260811 01:00:19.409650 20083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:19.409534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:40237 (local address 127.0.0.1:59120)
0811 01:00:19.409586 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:19.409620 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.60:40237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 01:00:19.409772 20078 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.70.60:40237: Network error: Client connection negotiation failed: client connection to 127.15.70.60:40237: connect: Connection refused (error 111)
I20260811 01:00:19.410699 20090 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.70.20:43753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.15.70.62:42529,127.15.70.61:41085,127.15.70.60:40237
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/krb5kdc/kudu_127.15.70.60.keytab
--principal=kudu/127.15.70.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.70.60:40237
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.15.70.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20090
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:19.411139 20090 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:19.411451 20090 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 01:00:19.412869 19956 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.70.60" port: 40237 } attempt: 2
I20260811 01:00:19.413432 19958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:19.413271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:40237 (local address 127.0.0.1:59128)
0811 01:00:19.413353 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:19.413395 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.60:40237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260811 01:00:19.413854 19958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:19.413759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:40237 (local address 127.0.0.1:59140)
0811 01:00:19.413807 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:19.413834 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.70.60:40237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260811 01:00:19.413975 19956 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.70.60:40237: Network error: Client connection negotiation failed: client connection to 127.15.70.60:40237: connect: Connection refused (error 111)
W20260811 01:00:19.417717 20098 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:19.417672 20097 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:19.417672 20103 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:19.418334 20090 server_base.cc:1034] running on GCE node
I20260811 01:00:19.418754 20090 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:19.419178 20090 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:19.420343 20090 hybrid_clock.cc:648] HybridClock initialized: now 1786410019420320 us; error 50 us; skew 500 ppm
Aug 11 01:00:19 dist-test-slave-h3ft krb5kdc[19817](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410019, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:19.423648 20090 init.cc:377] Logged in from keytab as kudu/127.15.70.60@KRBTEST.COM (short username kudu)
I20260811 01:00:19.424257 20090 webserver.cc:460] Webserver started at http://127.15.70.60:36043/ using document root <none> and password file <none>
I20260811 01:00:19.424587 20090 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:19.424640 20090 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:19.424842 20090 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:19.426153 20090 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-2/data/instance:
uuid: "c2d10c44d71948fba35930a1caf45b45"
format_stamp: "Formatted at 2026-08-11 01:00:19 on dist-test-slave-h3ft"
server_key: "d72ab4c217149aa5872a0bc4bc859729"
server_key_iv: "89919237a0b3a7f1862728eb3aec9e98"
server_key_version: "encryptionkey@0"
I20260811 01:00:19.426606 20090 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-2/wal/instance:
uuid: "c2d10c44d71948fba35930a1caf45b45"
format_stamp: "Formatted at 2026-08-11 01:00:19 on dist-test-slave-h3ft"
server_key: "d72ab4c217149aa5872a0bc4bc859729"
server_key_iv: "89919237a0b3a7f1862728eb3aec9e98"
server_key_version: "encryptionkey@0"
I20260811 01:00:19.428333 20090 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260811 01:00:19.429323 20125 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:19.429558 20090 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:00:19.429677 20090 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-2/data,/tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-2/wal
uuid: "c2d10c44d71948fba35930a1caf45b45"
format_stamp: "Formatted at 2026-08-11 01:00:19 on dist-test-slave-h3ft"
server_key: "d72ab4c217149aa5872a0bc4bc859729"
server_key_iv: "89919237a0b3a7f1862728eb3aec9e98"
server_key_version: "encryptionkey@0"
I20260811 01:00:19.429770 20090 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:19.447552 20090 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:19.450439 20090 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:19.450646 20090 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:19.455945 20090 rpc_server.cc:307] RPC server started. Bound to: 127.15.70.60:40237
I20260811 01:00:19.456012 20216 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.70.60:40237 every 8 connection(s)
I20260811 01:00:19.456462 20090 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-2/data/info.pb
I20260811 01:00:19.457762 20220 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:19.459313 15640 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN44M8g/build/release/bin/kudu as pid 20090
I20260811 01:00:19.459453 15640 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN44M8g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409704606556-15640-0/minicluster-data/master-2/wal/instance
I20260811 01:00:19.459697 15640 external_mini_cluster.cc:1428] Setting key fd009ee83d3eb08fad0021ee96afbd03
I20260811 01:00:19.460093 20220 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.70.62" port: 42529 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:00:19 dist-test-slave-h3ft krb5kdc[19817](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410019, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.60@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
Aug 11 01:00:19 dist-test-slave-h3ft krb5kdc[19817](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410018, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.70.60@KRBTEST.COM
I20260811 01:00:19.470219 19959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:19.461027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37134 (local address 127.15.70.62:42529)
0811 01:00:19.461092 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:19.461094 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:19.461232 (+ 138us) server_negotiation.cc:407] Connection header received
0811 01:00:19.461435 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:19.461436 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:19.461451 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:19.461515 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:19.462211 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.462752 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.463812 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.464033 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.464128 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:19.466936 (+ 2808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:19.466938 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:19.466939 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:19.466951 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:19.468627 (+ 1676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:19.469086 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:19.469087 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:19.469088 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:19.469162 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:19.469456 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:19.469457 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:19.469458 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:19.469602 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:19.469679 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:19.470000 (+ 321us) server_negotiation.cc:299] Negotiation successful
0811 01:00:19.470103 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 01:00:19.470454 20225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:19.460906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.62:42529 (local address 127.0.0.1:37134)
0811 01:00:19.461091 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:19.461147 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:19.461327 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:19.461539 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:19.461541 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:19.461885 (+ 344us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:19.462098 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:19.462103 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.462841 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.462843 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:19.463715 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:19.463717 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.464172 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.464174 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:19.464303 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:19.464952 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:19.464961 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:19.466808 (+ 1847us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:19.468725 (+ 1917us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:19.468734 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:19.468736 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:19.468999 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:19.469240 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:19.469241 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:19.469242 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:19.469375 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:19.469682 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:19.469691 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:19.469857 (+ 166us) client_negotiation.cc:769] Sending connection context
0811 01:00:19.469977 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 01:00:19.470161 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":97,"threads_started":1}
I20260811 01:00:19.470793 20224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:19.460377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59148 (local address 127.15.70.60:40237)
0811 01:00:19.460616 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:19.460627 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:19.460670 (+ 43us) server_negotiation.cc:407] Connection header received
0811 01:00:19.461328 (+ 658us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:19.461336 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:19.461361 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:19.461487 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:19.462217 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.463129 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.463936 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.464288 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.464376 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:19.467432 (+ 3056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:19.467443 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:19.467443 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:19.467451 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:19.469189 (+ 1738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:19.469673 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:19.469677 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:19.469677 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:19.469742 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:19.469969 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:19.469970 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:19.469970 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:19.470135 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:19.470314 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:19.470574 (+ 260us) server_negotiation.cc:299] Negotiation successful
0811 01:00:19.470667 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":133,"threads_started":1}
I20260811 01:00:19.471138 20220 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.70.61" port: 41085 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:00:19 dist-test-slave-h3ft krb5kdc[19817](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410019, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.60@KRBTEST.COM for kudu/127.15.70.61@KRBTEST.COM
Aug 11 01:00:19 dist-test-slave-h3ft krb5kdc[19817](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410018, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.70.62@KRBTEST.COM
I20260811 01:00:19.479918 20225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:19.471473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.61:41085 (local address 127.0.0.1:35250)
0811 01:00:19.471512 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:19.471525 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:19.471577 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:19.471818 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:19.471821 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:19.471951 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:19.472000 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:19.472001 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.472897 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.472899 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:19.473547 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:19.473550 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.474194 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.474195 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:19.474268 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:19.474798 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:19.474803 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:19.476263 (+ 1460us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:19.478386 (+ 2123us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:19.478387 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:19.478388 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:19.478611 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:19.478992 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:19.478993 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:19.478993 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:19.479110 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:19.479488 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:19.479490 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:19.479551 (+ 61us) client_negotiation.cc:769] Sending connection context
0811 01:00:19.479651 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 01:00:19.479785 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19}
I20260811 01:00:19.479918 20084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:19.471553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35250 (local address 127.15.70.61:41085)
0811 01:00:19.471627 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:19.471629 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:19.471639 (+ 10us) server_negotiation.cc:407] Connection header received
0811 01:00:19.471672 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:19.471673 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:19.471687 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:19.471748 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:19.472092 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.472820 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.473731 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.474119 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.474189 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:19.476387 (+ 2198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:19.476389 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:19.476390 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:19.476397 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:19.478283 (+ 1886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:19.478742 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:19.478744 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:19.478744 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:19.478821 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:19.479215 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:19.479216 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:19.479217 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:19.479398 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:19.479503 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:19.479684 (+ 181us) server_negotiation.cc:299] Negotiation successful
0811 01:00:19.479785 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 01:00:19.480248 19959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:19.471775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37136 (local address 127.15.70.62:42529)
0811 01:00:19.471821 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:19.471823 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:19.471831 (+ 8us) server_negotiation.cc:407] Connection header received
0811 01:00:19.471853 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:19.471854 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:19.471866 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:19.471922 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:19.472549 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.473131 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.474093 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.474363 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.474438 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:19.477007 (+ 2569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:19.477008 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:19.477008 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:19.477016 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:19.478865 (+ 1849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:19.479309 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:19.479310 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:19.479311 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:19.479378 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:19.479604 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:19.479605 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:19.479605 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:19.479737 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:19.479976 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:19.480017 (+ 41us) server_negotiation.cc:299] Negotiation successful
0811 01:00:19.480119 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 01:00:19.480463 20220 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.70.60" port: 40237 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:00:19 dist-test-slave-h3ft krb5kdc[19817](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410019, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.60@KRBTEST.COM for kudu/127.15.70.60@KRBTEST.COM
Aug 11 01:00:19 dist-test-slave-h3ft krb5kdc[19817](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410018, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.70.61@KRBTEST.COM
I20260811 01:00:19.488667 20224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:19.480935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59156 (local address 127.15.70.60:40237)
0811 01:00:19.480975 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:19.480977 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:19.480993 (+ 16us) server_negotiation.cc:407] Connection header received
0811 01:00:19.481012 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:19.481012 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:19.481022 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:19.481065 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:19.481337 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.481853 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.482840 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.483150 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.483226 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:19.485686 (+ 2460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:19.485687 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:19.485688 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:19.485695 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:19.487343 (+ 1648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:19.487693 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:19.487694 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:19.487695 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:19.487760 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:19.487962 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:19.487963 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:19.487964 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:19.488139 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:19.488214 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:19.488489 (+ 275us) server_negotiation.cc:299] Negotiation successful
0811 01:00:19.488578 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 01:00:19.488806 20225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:19.480847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:40237 (local address 127.0.0.1:59156)
0811 01:00:19.480904 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:19.480916 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:19.480957 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:19.481075 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:19.481076 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:19.481223 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:19.481259 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:19.481260 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.481937 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.481938 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:19.482771 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:19.482775 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.483231 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.483232 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:19.483283 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:19.483765 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:19.483771 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:19.485582 (+ 1811us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:19.487436 (+ 1854us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:19.487437 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:19.487437 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:19.487615 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:19.487830 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:19.487831 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:19.487832 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:19.487890 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:19.488236 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:19.488237 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:19.488333 (+ 96us) client_negotiation.cc:769] Sending connection context
0811 01:00:19.488455 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 01:00:19.488650 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36,"mutex_wait_us":60}
I20260811 01:00:19.491259 20084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:19.481349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35262 (local address 127.15.70.61:41085)
0811 01:00:19.481388 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:19.481390 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:19.482066 (+ 676us) server_negotiation.cc:407] Connection header received
0811 01:00:19.482092 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:19.482093 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:19.482104 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:19.482174 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:19.482810 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.483461 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.484435 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.484749 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.484841 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:19.487844 (+ 3003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:19.487846 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:19.487847 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:19.487856 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:19.489769 (+ 1913us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:19.490235 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:19.490236 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:19.490237 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:19.490311 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:19.490551 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:19.490552 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:19.490552 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:19.490724 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:19.490958 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:19.491048 (+ 90us) server_negotiation.cc:299] Negotiation successful
0811 01:00:19.491140 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 01:00:19.491609 20220 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2d10c44d71948fba35930a1caf45b45: Bootstrap starting.
I20260811 01:00:19.492884 20220 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c2d10c44d71948fba35930a1caf45b45: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:19.493235 20220 log.cc:824] T 00000000000000000000000000000000 P c2d10c44d71948fba35930a1caf45b45: Log is configured to *not* fsync() on all Append() calls
I20260811 01:00:19.493507 15640 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:00:19.494180 20220 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2d10c44d71948fba35930a1caf45b45: No bootstrap required, opened a new log
I20260811 01:00:19.494722 19911 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "a668f7edc8a64ac487d73c4b99fb4a8a"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37136
I20260811 01:00:19.496382 20220 raft_consensus.cc:348] T 00000000000000000000000000000000 P c2d10c44d71948fba35930a1caf45b45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a668f7edc8a64ac487d73c4b99fb4a8a" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 42529 } } peers { permanent_uuid: "2cbe7f50fd424aaab76b4261387cb277" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 41085 } } peers { permanent_uuid: "c2d10c44d71948fba35930a1caf45b45" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 40237 } }
I20260811 01:00:19.496570 20220 raft_consensus.cc:729] T 00000000000000000000000000000000 P c2d10c44d71948fba35930a1caf45b45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d10c44d71948fba35930a1caf45b45, State: Initialized, Role: FOLLOWER
I20260811 01:00:19.496675 20220 consensus_queue.cc:260] T 00000000000000000000000000000000 P c2d10c44d71948fba35930a1caf45b45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a668f7edc8a64ac487d73c4b99fb4a8a" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 42529 } } peers { permanent_uuid: "2cbe7f50fd424aaab76b4261387cb277" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 41085 } } peers { permanent_uuid: "c2d10c44d71948fba35930a1caf45b45" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 40237 } }
I20260811 01:00:19.497049 20227 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2d10c44d71948fba35930a1caf45b45 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a668f7edc8a64ac487d73c4b99fb4a8a" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 42529 } } peers { permanent_uuid: "2cbe7f50fd424aaab76b4261387cb277" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 41085 } } peers { permanent_uuid: "c2d10c44d71948fba35930a1caf45b45" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 40237 } } }
I20260811 01:00:19.497145 20220 sys_catalog.cc:564] T 00000000000000000000000000000000 P c2d10c44d71948fba35930a1caf45b45 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:00:19.497155 20227 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2d10c44d71948fba35930a1caf45b45 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 01:00:19.499387 20245 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c2d10c44d71948fba35930a1caf45b45: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 01:00:19.499475 20245 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 01:00:19.500945 20078 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.70.60" port: 40237 } attempt: 3
I20260811 01:00:19.499900 20090 master_runner.cc:186] Error getting master registration for 127.15.70.62:42529: OK, instance_id { permanent_uuid: "a668f7edc8a64ac487d73c4b99fb4a8a" instance_seqno: 1786410019058754 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 01:00:19.503760 20090 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 11 01:00:19 dist-test-slave-h3ft krb5kdc[19817](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410019, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.61@KRBTEST.COM for kudu/127.15.70.60@KRBTEST.COM
I20260811 01:00:19.510741 20083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:19.501378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:40237 (local address 127.0.0.1:59164)
0811 01:00:19.501515 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:19.501531 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:19.501589 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:19.501776 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:19.501778 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:19.502045 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:19.502132 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:19.502135 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.503095 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.503097 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:19.503979 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:19.503983 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.504550 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.504552 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:19.504622 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:19.505317 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:19.505324 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:19.507240 (+ 1916us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:19.509364 (+ 2124us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:19.509365 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:19.509366 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:19.509633 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:19.509872 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:19.509873 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:19.509873 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:19.509945 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:19.510342 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:19.510343 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:19.510407 (+ 64us) client_negotiation.cc:769] Sending connection context
0811 01:00:19.510478 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 01:00:19.510607 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105}
I20260811 01:00:19.510772 20224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:19.501531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59164 (local address 127.15.70.60:40237)
0811 01:00:19.501593 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:19.501597 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:19.501642 (+ 45us) server_negotiation.cc:407] Connection header received
0811 01:00:19.501671 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:19.501672 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:19.501684 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:19.501747 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:19.502218 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.502967 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.504118 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.504456 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.504535 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:19.507382 (+ 2847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:19.507385 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:19.507385 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:19.507396 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:19.509239 (+ 1843us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:19.509715 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:19.509717 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:19.509717 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:19.509793 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:19.510016 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:19.510017 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:19.510017 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:19.510267 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:19.510350 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:19.510532 (+ 182us) server_negotiation.cc:299] Negotiation successful
0811 01:00:19.510643 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 01:00:19.513183 20078 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2cbe7f50fd424aaab76b4261387cb277: Bootstrap starting.
I20260811 01:00:19.513144 19956 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.70.60" port: 40237 } attempt: 3
I20260811 01:00:19.514060 20078 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2cbe7f50fd424aaab76b4261387cb277: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:19.514343 20078 log.cc:824] T 00000000000000000000000000000000 P 2cbe7f50fd424aaab76b4261387cb277: Log is configured to *not* fsync() on all Append() calls
I20260811 01:00:19.515431 20078 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2cbe7f50fd424aaab76b4261387cb277: No bootstrap required, opened a new log
I20260811 01:00:19.517971 20078 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2cbe7f50fd424aaab76b4261387cb277 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a668f7edc8a64ac487d73c4b99fb4a8a" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 42529 } } peers { permanent_uuid: "2cbe7f50fd424aaab76b4261387cb277" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 41085 } } peers { permanent_uuid: "c2d10c44d71948fba35930a1caf45b45" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 40237 } }
I20260811 01:00:19.518169 20078 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2cbe7f50fd424aaab76b4261387cb277 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cbe7f50fd424aaab76b4261387cb277, State: Initialized, Role: FOLLOWER
I20260811 01:00:19.518280 20078 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2cbe7f50fd424aaab76b4261387cb277 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a668f7edc8a64ac487d73c4b99fb4a8a" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 42529 } } peers { permanent_uuid: "2cbe7f50fd424aaab76b4261387cb277" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 41085 } } peers { permanent_uuid: "c2d10c44d71948fba35930a1caf45b45" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 40237 } }
I20260811 01:00:19.518754 20078 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2cbe7f50fd424aaab76b4261387cb277 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:00:19.518678 20249 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2cbe7f50fd424aaab76b4261387cb277 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a668f7edc8a64ac487d73c4b99fb4a8a" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 42529 } } peers { permanent_uuid: "2cbe7f50fd424aaab76b4261387cb277" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 41085 } } peers { permanent_uuid: "c2d10c44d71948fba35930a1caf45b45" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 40237 } } }
I20260811 01:00:19.518972 20249 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2cbe7f50fd424aaab76b4261387cb277 [sys.catalog]: This master's current role is: FOLLOWER
Aug 11 01:00:19 dist-test-slave-h3ft krb5kdc[19817](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410019, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.70.62@KRBTEST.COM for kudu/127.15.70.60@KRBTEST.COM
W20260811 01:00:19.521569 20267 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2cbe7f50fd424aaab76b4261387cb277: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 01:00:19.521699 20267 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 01:00:19.522297 19965 master_runner.cc:186] Error getting master registration for 127.15.70.62:42529: OK, instance_id { permanent_uuid: "a668f7edc8a64ac487d73c4b99fb4a8a" instance_seqno: 1786410019058754 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 01:00:19.525902 19965 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 01:00:19.527230 19958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:19.513526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.70.60:40237 (local address 127.0.0.1:59170)
0811 01:00:19.513596 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:19.513608 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:19.513650 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:19.514059 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:19.514060 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:19.514291 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:19.514374 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:19.514377 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.515492 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.515493 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:19.516374 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:19.516378 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.516912 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.516913 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:19.516981 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:19.517653 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:19.517659 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:19.519532 (+ 1873us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:19.521762 (+ 2230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:19.521762 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:19.521763 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:19.522027 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:19.526323 (+ 4296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:19.526325 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:19.526326 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:19.526419 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:19.526775 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:19.526777 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:19.526839 (+ 62us) client_negotiation.cc:769] Sending connection context
0811 01:00:19.526917 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 01:00:19.527107 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 01:00:19.527714 20224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:19.513828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59170 (local address 127.15.70.60:40237)
0811 01:00:19.513899 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:19.513901 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:19.513920 (+ 19us) server_negotiation.cc:407] Connection header received
0811 01:00:19.513943 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:19.513944 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:19.513956 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:19.514468 (+ 512us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:19.514524 (+ 56us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.515368 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.516487 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.516810 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.517210 (+ 400us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:19.519656 (+ 2446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:19.519657 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:19.519658 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:19.519669 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:19.521522 (+ 1853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:19.526058 (+ 4536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:19.526061 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:19.526062 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:19.526183 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:19.526493 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:19.526494 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:19.526494 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:19.526676 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:19.526747 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:19.527486 (+ 739us) server_negotiation.cc:299] Negotiation successful
0811 01:00:19.527608 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 01:00:19.530085 19956 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a668f7edc8a64ac487d73c4b99fb4a8a: Bootstrap starting.
I20260811 01:00:19.531212 19956 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a668f7edc8a64ac487d73c4b99fb4a8a: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:19.531620 19956 log.cc:824] T 00000000000000000000000000000000 P a668f7edc8a64ac487d73c4b99fb4a8a: Log is configured to *not* fsync() on all Append() calls
I20260811 01:00:19.533036 19956 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a668f7edc8a64ac487d73c4b99fb4a8a: No bootstrap required, opened a new log
I20260811 01:00:19.535737 19956 raft_consensus.cc:348] T 00000000000000000000000000000000 P a668f7edc8a64ac487d73c4b99fb4a8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a668f7edc8a64ac487d73c4b99fb4a8a" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 42529 } } peers { permanent_uuid: "2cbe7f50fd424aaab76b4261387cb277" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 41085 } } peers { permanent_uuid: "c2d10c44d71948fba35930a1caf45b45" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 40237 } }
I20260811 01:00:19.535967 19956 raft_consensus.cc:729] T 00000000000000000000000000000000 P a668f7edc8a64ac487d73c4b99fb4a8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a668f7edc8a64ac487d73c4b99fb4a8a, State: Initialized, Role: FOLLOWER
I20260811 01:00:19.536091 19956 consensus_queue.cc:260] T 00000000000000000000000000000000 P a668f7edc8a64ac487d73c4b99fb4a8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a668f7edc8a64ac487d73c4b99fb4a8a" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 42529 } } peers { permanent_uuid: "2cbe7f50fd424aaab76b4261387cb277" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 41085 } } peers { permanent_uuid: "c2d10c44d71948fba35930a1caf45b45" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 40237 } }
I20260811 01:00:19.536657 19956 sys_catalog.cc:564] T 00000000000000000000000000000000 P a668f7edc8a64ac487d73c4b99fb4a8a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:00:19.536700 19911 raft_consensus.cc:482] T 00000000000000000000000000000000 P a668f7edc8a64ac487d73c4b99fb4a8a [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 01:00:19.536764 19911 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a668f7edc8a64ac487d73c4b99fb4a8a [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:19.537931 19911 raft_consensus.cc:504] T 00000000000000000000000000000000 P a668f7edc8a64ac487d73c4b99fb4a8a [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a668f7edc8a64ac487d73c4b99fb4a8a" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 42529 } } peers { permanent_uuid: "2cbe7f50fd424aaab76b4261387cb277" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 41085 } } peers { permanent_uuid: "c2d10c44d71948fba35930a1caf45b45" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 40237 } }
I20260811 01:00:19.538272 19911 leader_election.cc:288] T 00000000000000000000000000000000 P a668f7edc8a64ac487d73c4b99fb4a8a [CANDIDATE]: Term 1 election: Requested vote from peers 2cbe7f50fd424aaab76b4261387cb277 (127.15.70.61:41085), c2d10c44d71948fba35930a1caf45b45 (127.15.70.60:40237)
I20260811 01:00:19.539676 20035 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a668f7edc8a64ac487d73c4b99fb4a8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "2cbe7f50fd424aaab76b4261387cb277"
I20260811 01:00:19.539861 20035 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2cbe7f50fd424aaab76b4261387cb277 [term 0 FOLLOWER]: Advancing to term 1
W20260811 01:00:19.539904 20288 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a668f7edc8a64ac487d73c4b99fb4a8a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 01:00:19.539963 20288 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 01:00:19.541105 20035 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2cbe7f50fd424aaab76b4261387cb277 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a668f7edc8a64ac487d73c4b99fb4a8a in term 1.
I20260811 01:00:19.543179 20175 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a668f7edc8a64ac487d73c4b99fb4a8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c2d10c44d71948fba35930a1caf45b45"
I20260811 01:00:19.543381 20175 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c2d10c44d71948fba35930a1caf45b45 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:19.544596 20175 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c2d10c44d71948fba35930a1caf45b45 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a668f7edc8a64ac487d73c4b99fb4a8a in term 1.
I20260811 01:00:19.545087 19868 leader_election.cc:302] T 00000000000000000000000000000000 P a668f7edc8a64ac487d73c4b99fb4a8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cbe7f50fd424aaab76b4261387cb277, a668f7edc8a64ac487d73c4b99fb4a8a; no voters:
I20260811 01:00:19.536616 20270 sys_catalog.cc:455] T 00000000000000000000000000000000 P a668f7edc8a64ac487d73c4b99fb4a8a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a668f7edc8a64ac487d73c4b99fb4a8a" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 42529 } } peers { permanent_uuid: "2cbe7f50fd424aaab76b4261387cb277" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 41085 } } peers { permanent_uuid: "c2d10c44d71948fba35930a1caf45b45" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 40237 } } }
I20260811 01:00:19.546131 20270 sys_catalog.cc:458] T 00000000000000000000000000000000 P a668f7edc8a64ac487d73c4b99fb4a8a [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:00:19.546254 20270 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a668f7edc8a64ac487d73c4b99fb4a8a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:00:19.546365 20270 raft_consensus.cc:686] T 00000000000000000000000000000000 P a668f7edc8a64ac487d73c4b99fb4a8a [term 1 LEADER]: Becoming Leader. State: Replica: a668f7edc8a64ac487d73c4b99fb4a8a, State: Running, Role: LEADER
I20260811 01:00:19.546514 20270 consensus_queue.cc:237] T 00000000000000000000000000000000 P a668f7edc8a64ac487d73c4b99fb4a8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a668f7edc8a64ac487d73c4b99fb4a8a" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 42529 } } peers { permanent_uuid: "2cbe7f50fd424aaab76b4261387cb277" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 41085 } } peers { permanent_uuid: "c2d10c44d71948fba35930a1caf45b45" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 40237 } }
I20260811 01:00:19.547277 20297 sys_catalog.cc:455] T 00000000000000000000000000000000 P a668f7edc8a64ac487d73c4b99fb4a8a [sys.catalog]: SysCatalogTable state changed. Reason: New leader a668f7edc8a64ac487d73c4b99fb4a8a. Latest consensus state: current_term: 1 leader_uuid: "a668f7edc8a64ac487d73c4b99fb4a8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a668f7edc8a64ac487d73c4b99fb4a8a" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 42529 } } peers { permanent_uuid: "2cbe7f50fd424aaab76b4261387cb277" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 41085 } } peers { permanent_uuid: "c2d10c44d71948fba35930a1caf45b45" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 40237 } } }
I20260811 01:00:19.547401 20297 sys_catalog.cc:458] T 00000000000000000000000000000000 P a668f7edc8a64ac487d73c4b99fb4a8a [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:19.548009 19837 master_runner.cc:263] No leader master found from master a668f7edc8a64ac487d73c4b99fb4a8a
I20260811 01:00:19.548060 19837 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260811 01:00:19.555881 19876 tablet.cc:2369] T 00000000000000000000000000000000 P a668f7edc8a64ac487d73c4b99fb4a8a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:00:19.557495 20224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:19.547845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59174 (local address 127.15.70.60:40237)
0811 01:00:19.547925 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:19.547928 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:19.548533 (+ 605us) server_negotiation.cc:407] Connection header received
0811 01:00:19.548654 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:19.548655 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:19.548668 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:19.548701 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:19.549719 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.550534 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.551675 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.551985 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.552032 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:19.553971 (+ 1939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:19.553973 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:19.553973 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:19.553984 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:19.556142 (+ 2158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:19.556558 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:19.556560 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:19.556561 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:19.556630 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:19.556837 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:19.556838 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:19.556838 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:19.556989 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:19.557074 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:19.557288 (+ 214us) server_negotiation.cc:299] Negotiation successful
0811 01:00:19.557380 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 01:00:19.559232 20299 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:00:19.563812 19959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:19.547636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37150 (local address 127.15.70.62:42529)
0811 01:00:19.547715 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:19.547719 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:19.549667 (+ 1948us) server_negotiation.cc:407] Connection header received
0811 01:00:19.549770 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:19.549771 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:19.549784 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:19.549816 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:19.550614 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.551343 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.554885 (+ 3542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.555213 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.555264 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:19.559653 (+ 4389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:19.559655 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:19.559655 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:19.559667 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:19.562056 (+ 2389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:19.562798 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:19.562800 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:19.562800 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:19.562869 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:19.563132 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:19.563133 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:19.563134 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:19.563290 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:19.563389 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:19.563603 (+ 214us) server_negotiation.cc:299] Negotiation successful
0811 01:00:19.563699 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 01:00:19.565563 20084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:19.548654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35268 (local address 127.15.70.61:41085)
0811 01:00:19.548702 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:19.548704 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:19.553516 (+ 4812us) server_negotiation.cc:407] Connection header received
0811 01:00:19.554108 (+ 592us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:19.554111 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:19.554128 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:19.554162 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:19.555642 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.556387 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.559650 (+ 3263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:19.559978 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:19.560022 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:19.561460 (+ 1438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:19.561462 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:19.561462 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:19.561471 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:19.563301 (+ 1830us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:19.563709 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:19.563711 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:19.563711 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:19.563776 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:19.564915 (+ 1139us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:19.564916 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:19.564917 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:19.565071 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:19.565161 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:19.565350 (+ 189us) server_negotiation.cc:299] Negotiation successful
0811 01:00:19.565442 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 01:00:19.567340 20299 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:00:19.569902 20035 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2cbe7f50fd424aaab76b4261387cb277 [term 1 FOLLOWER]: Refusing update from remote peer a668f7edc8a64ac487d73c4b99fb4a8a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:00:19.570317 20175 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c2d10c44d71948fba35930a1caf45b45 [term 1 FOLLOWER]: Refusing update from remote peer a668f7edc8a64ac487d73c4b99fb4a8a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:00:19.571570 20297 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a668f7edc8a64ac487d73c4b99fb4a8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cbe7f50fd424aaab76b4261387cb277" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 41085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:00:19.572479 20297 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a668f7edc8a64ac487d73c4b99fb4a8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2d10c44d71948fba35930a1caf45b45" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 40237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:00:19.574677 20227 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2d10c44d71948fba35930a1caf45b45 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a668f7edc8a64ac487d73c4b99fb4a8a. Latest consensus state: current_term: 1 leader_uuid: "a668f7edc8a64ac487d73c4b99fb4a8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a668f7edc8a64ac487d73c4b99fb4a8a" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 42529 } } peers { permanent_uuid: "2cbe7f50fd424aaab76b4261387cb277" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 41085 } } peers { permanent_uuid: "c2d10c44d71948fba35930a1caf45b45" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 40237 } } }
I20260811 01:00:19.574790 20227 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2d10c44d71948fba35930a1caf45b45 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:00:19.576237 20249 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2cbe7f50fd424aaab76b4261387cb277 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a668f7edc8a64ac487d73c4b99fb4a8a. Latest consensus state: current_term: 1 leader_uuid: "a668f7edc8a64ac487d73c4b99fb4a8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a668f7edc8a64ac487d73c4b99fb4a8a" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 42529 } } peers { permanent_uuid: "2cbe7f50fd424aaab76b4261387cb277" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 41085 } } peers { permanent_uuid: "c2d10c44d71948fba35930a1caf45b45" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 40237 } } }
I20260811 01:00:19.576342 20249 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2cbe7f50fd424aaab76b4261387cb277 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:00:19.578117 20297 sys_catalog.cc:455] T 00000000000000000000000000000000 P a668f7edc8a64ac487d73c4b99fb4a8a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a668f7edc8a64ac487d73c4b99fb4a8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a668f7edc8a64ac487d73c4b99fb4a8a" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 42529 } } peers { permanent_uuid: "2cbe7f50fd424aaab76b4261387cb277" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 41085 } } peers { permanent_uuid: "c2d10c44d71948fba35930a1caf45b45" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 40237 } } }
I20260811 01:00:19.578210 20297 sys_catalog.cc:458] T 00000000000000000000000000000000 P a668f7edc8a64ac487d73c4b99fb4a8a [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:19.578284 20309 mvcc.cc:205] Tried to move back new op lower bound from 7317135440154456064 to 7317135440063770624. Current Snapshot: MvccSnapshot[applied={T|T < 7317135440154456064}]
I20260811 01:00:19.579725 20249 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2cbe7f50fd424aaab76b4261387cb277 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a668f7edc8a64ac487d73c4b99fb4a8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a668f7edc8a64ac487d73c4b99fb4a8a" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 42529 } } peers { permanent_uuid: "2cbe7f50fd424aaab76b4261387cb277" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 41085 } } peers { permanent_uuid: "c2d10c44d71948fba35930a1caf45b45" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 40237 } } }
I20260811 01:00:19.579816 20249 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2cbe7f50fd424aaab76b4261387cb277 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:00:19.580508 20313 mvcc.cc:205] Tried to move back new op lower bound from 7317135440154456064 to 7317135440063770624. Current Snapshot: MvccSnapshot[applied={T|T < 7317135440154456064}]
I20260811 01:00:19.581542 20270 sys_catalog.cc:455] T 00000000000000000000000000000000 P a668f7edc8a64ac487d73c4b99fb4a8a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a668f7edc8a64ac487d73c4b99fb4a8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a668f7edc8a64ac487d73c4b99fb4a8a" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 42529 } } peers { permanent_uuid: "2cbe7f50fd424aaab76b4261387cb277" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 41085 } } peers { permanent_uuid: "c2d10c44d71948fba35930a1caf45b45" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 40237 } } }
I20260811 01:00:19.581638 20270 sys_catalog.cc:458] T 00000000000000000000000000000000 P a668f7edc8a64ac487d73c4b99fb4a8a [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:19.582104 20227 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2d10c44d71948fba35930a1caf45b45 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a668f7edc8a64ac487d73c4b99fb4a8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a668f7edc8a64ac487d73c4b99fb4a8a" member_type: VOTER last_known_addr { host: "127.15.70.62" port: 42529 } } peers { permanent_uuid: "2cbe7f50fd424aaab76b4261387cb277" member_type: VOTER last_known_addr { host: "127.15.70.61" port: 41085 } } peers { permanent_uuid: "c2d10c44d71948fba35930a1caf45b45" member_type: VOTER last_known_addr { host: "127.15.70.60" port: 40237 } } }
I20260811 01:00:19.582203 20227 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2d10c44d71948fba35930a1caf45b45 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:00:19.583976 20310 mvcc.cc:205] Tried to move back new op lower bound from 7317135440154456064 to 7317135440063770624. Current Snapshot: MvccSnapshot[applied={T|T < 7317135440154456064}]
I20260811 01:00:19.584282 20299 catalog_manager.cc:1347] Generated new cluster ID: d51b9567edaf4de5af934b5ae7740261
I20260811 01:00:19.584335 20299 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:00:19.648357 20299 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:00:19.649406 20299 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:00:19.665282 20299 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a668f7edc8a64ac487d73c4b99fb4a8a: Generated new TSK 0
I20260811 01:00:19.665760 20299 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 01:00:19.698772 20224 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:00:19.696576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59190 (local address 127.15.70.60:40237)
0811 01:00:19.696642 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:19.696645 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:19.697856 (+ 1211us) server_negotiation.cc:407] Connection header received
0811 01:00:19.697987 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:19.697989 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:19.698004 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:19.698041 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:19.698665 (+ 624us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59190: BlockingRecv error: recv got EOF from 127.0.0.1:59190 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
W20260811 01:00:19.700196 19959 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:00:19.697093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37160 (local address 127.15.70.62:42529)
0811 01:00:19.697142 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:19.697145 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:19.699358 (+ 2213us) server_negotiation.cc:407] Connection header received
0811 01:00:19.699626 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:19.699628 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:19.699644 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:19.699679 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:19.700091 (+ 412us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37160: BlockingRecv error: recv got EOF from 127.0.0.1:37160 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260811 01:00:19.701182 20084 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:00:19.697486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35276 (local address 127.15.70.61:41085)
0811 01:00:19.697550 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:19.697552 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:19.699493 (+ 1941us) server_negotiation.cc:407] Connection header received
0811 01:00:19.700631 (+ 1138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:19.700633 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:19.700648 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:19.700682 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:19.701099 (+ 417us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35276: BlockingRecv error: recv got EOF from 127.0.0.1:35276 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
W20260811 01:00:19.704861 20084 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:00:19.703866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35292 (local address 127.15.70.61:41085)
0811 01:00:19.703916 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:19.703918 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:19.704172 (+ 254us) server_negotiation.cc:407] Connection header received
0811 01:00:19.704306 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:19.704307 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:19.704334 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:19.704368 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:19.704796 (+ 428us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35292: BlockingRecv error: recv got EOF from 127.0.0.1:35292 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 01:00:19.708647 20084 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:00:19.707673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35294 (local address 127.15.70.61:41085)
0811 01:00:19.707719 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:19.707721 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:19.708005 (+ 284us) server_negotiation.cc:407] Connection header received
0811 01:00:19.708114 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:19.708115 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:19.708129 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:19.708160 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:19.708574 (+ 414us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35294: BlockingRecv error: recv got EOF from 127.0.0.1:35294 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 01:00:19.713294 20084 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:00:19.712273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35304 (local address 127.15.70.61:41085)
0811 01:00:19.712320 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:19.712322 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:19.712639 (+ 317us) server_negotiation.cc:407] Connection header received
0811 01:00:19.712756 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:19.712757 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:19.712772 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:19.712805 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:19.713223 (+ 418us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35304: BlockingRecv error: recv got EOF from 127.0.0.1:35304 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260811 01:00:19.720427 20084 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:00:19.719184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35314 (local address 127.15.70.61:41085)
0811 01:00:19.719276 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:19.719278 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:19.719671 (+ 393us) server_negotiation.cc:407] Connection header received
0811 01:00:19.719792 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:19.719793 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:19.719813 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:19.719861 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:19.720343 (+ 482us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35314: BlockingRecv error: recv got EOF from 127.0.0.1:35314 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
W20260811 01:00:19.731882 20084 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:00:19.730594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35326 (local address 127.15.70.61:41085)
0811 01:00:19.730660 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:19.730663 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:19.731084 (+ 421us) server_negotiation.cc:407] Connection header received
0811 01:00:19.731217 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:19.731219 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:19.731238 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:19.731314 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:19.731787 (+ 473us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35326: BlockingRecv error: recv got EOF from 127.0.0.1:35326 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
W20260811 01:00:19.750572 20084 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:00:19.749690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35338 (local address 127.15.70.61:41085)
0811 01:00:19.749773 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:19.749776 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:19.749846 (+ 70us) server_negotiation.cc:407] Connection header received
0811 01:00:19.749937 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:19.749939 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:19.749954 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:19.750021 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:19.750488 (+ 467us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35338: BlockingRecv error: recv got EOF from 127.0.0.1:35338 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260811 01:00:19.785189 20084 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:00:19.784301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35350 (local address 127.15.70.61:41085)
0811 01:00:19.784397 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:19.784399 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:19.784493 (+ 94us) server_negotiation.cc:407] Connection header received
0811 01:00:19.784567 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:19.784568 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:19.784582 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:19.784630 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:19.785107 (+ 477us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35350: BlockingRecv error: recv got EOF from 127.0.0.1:35350 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260811 01:00:19.851918 20084 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:00:19.850832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35364 (local address 127.15.70.61:41085)
0811 01:00:19.850966 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:19.850968 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:19.851028 (+ 60us) server_negotiation.cc:407] Connection header received
0811 01:00:19.851168 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:19.851169 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:19.851184 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:19.851249 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:19.851824 (+ 575us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35364: BlockingRecv error: recv got EOF from 127.0.0.1:35364 (error 108)
Metrics: {"server-negotiator.queue_time_us":101}
W20260811 01:00:19.982494 20084 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:00:19.981497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35374 (local address 127.15.70.61:41085)
0811 01:00:19.981606 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:19.981608 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:19.981700 (+ 92us) server_negotiation.cc:407] Connection header received
0811 01:00:19.981825 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:19.981826 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:19.981842 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:19.981927 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:19.982421 (+ 494us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35374: BlockingRecv error: recv got EOF from 127.0.0.1:35374 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
W20260811 01:00:20.241204 20084 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:00:20.240239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35378 (local address 127.15.70.61:41085)
0811 01:00:20.240320 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:20.240323 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:20.240344 (+ 21us) server_negotiation.cc:407] Connection header received
0811 01:00:20.240386 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:20.240387 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:20.240401 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:20.240479 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:20.241076 (+ 597us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35378: BlockingRecv error: recv got EOF from 127.0.0.1:35378 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 01:00:20.500170 20245 catalog_manager.cc:1259] Loaded cluster ID: d51b9567edaf4de5af934b5ae7740261
I20260811 01:00:20.500300 20245 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c2d10c44d71948fba35930a1caf45b45: loading cluster ID for follower catalog manager: success
I20260811 01:00:20.501302 20245 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c2d10c44d71948fba35930a1caf45b45: acquiring CA information for follower catalog manager: success
I20260811 01:00:20.501727 20245 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c2d10c44d71948fba35930a1caf45b45: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 01:00:20.522410 20267 catalog_manager.cc:1259] Loaded cluster ID: d51b9567edaf4de5af934b5ae7740261
I20260811 01:00:20.522535 20267 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2cbe7f50fd424aaab76b4261387cb277: loading cluster ID for follower catalog manager: success
I20260811 01:00:20.523618 20267 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2cbe7f50fd424aaab76b4261387cb277: acquiring CA information for follower catalog manager: success
I20260811 01:00:20.524035 20267 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2cbe7f50fd424aaab76b4261387cb277: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 01:00:20.758031 20423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:20.754542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35390 (local address 127.15.70.61:41085)
0811 01:00:20.754731 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:20.754734 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:20.754747 (+ 13us) server_negotiation.cc:407] Connection header received
0811 01:00:20.754787 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:20.754788 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:20.754869 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:20.755162 (+ 293us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:00:20.755449 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:20.756092 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:20.756988 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:20.757199 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:20.757259 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:20.757452 (+ 193us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:00:20.757597 (+ 145us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:00:20.757668 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:20.757838 (+ 170us) server_negotiation.cc:299] Negotiation successful
0811 01:00:20.757862 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":154,"threads_started":1}
I20260811 01:00:20.763577 20434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:20.760771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59200 (local address 127.15.70.60:40237)
0811 01:00:20.760959 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:20.760961 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:20.760971 (+ 10us) server_negotiation.cc:407] Connection header received
0811 01:00:20.761021 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:20.761021 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:20.761074 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:20.761165 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:00:20.761294 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:20.761817 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:20.762621 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:20.762858 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:20.762959 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:20.763201 (+ 242us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:00:20.763337 (+ 136us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:00:20.763412 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:20.763467 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 01:00:20.763488 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":93,"threads_started":1}
I20260811 01:00:20.769294 20434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:20.765752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59204 (local address 127.15.70.60:40237)
0811 01:00:20.765805 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:20.765808 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:20.765957 (+ 149us) server_negotiation.cc:407] Connection header received
0811 01:00:20.765984 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:20.765985 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:20.765997 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:20.766045 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:00:20.766247 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:20.766877 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:20.767931 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:20.768247 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:20.768327 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:20.768514 (+ 187us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:00:20.768552 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:00:20.768613 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:20.769151 (+ 538us) server_negotiation.cc:299] Negotiation successful
0811 01:00:20.769181 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 01:00:20.769944 20447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:20.765764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37166 (local address 127.15.70.62:42529)
0811 01:00:20.765932 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:20.765935 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:20.766160 (+ 225us) server_negotiation.cc:407] Connection header received
0811 01:00:20.766288 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:20.766289 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:20.766372 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:20.766474 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:00:20.766664 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:20.767519 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:20.768725 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:20.769025 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:20.769092 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:20.769361 (+ 269us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:00:20.769544 (+ 183us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:00:20.769632 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:20.769777 (+ 145us) server_negotiation.cc:299] Negotiation successful
0811 01:00:20.769819 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":83,"threads_started":1}
I20260811 01:00:20.770100 20423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:20.766003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35394 (local address 127.15.70.61:41085)
0811 01:00:20.766093 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:20.766095 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:20.766328 (+ 233us) server_negotiation.cc:407] Connection header received
0811 01:00:20.766436 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:20.766438 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:20.766453 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:20.766484 (+ 31us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:00:20.766722 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:20.767512 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:20.768879 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:20.769192 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:20.769232 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:20.769707 (+ 475us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:00:20.769753 (+ 46us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:00:20.769812 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:20.769958 (+ 146us) server_negotiation.cc:299] Negotiation successful
0811 01:00:20.770002 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 01:00:20.772727 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 19837
I20260811 01:00:20.796202 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 19965
I20260811 01:00:20.811872 15640 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN44M8g/build/release/bin/kudu with pid 20090
2026-08-11T01:00:20Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3472 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6866 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (316213 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST